SELU Appendix @SELUAppendix
The appendix from beyond the moon. arxiv.org/abs/1706.02515 Arxiv Joined June 2017-
Tweets63
-
Followers627
-
Following11
-
Likes44
It is always worth reading the appendix x.com/alfcnz/status/…
@quantumVerd @alfcnz The paper got fixed faster than my boiler I tell you
RUDDER: Return Decomposition for Delayed Rewards: "Exponentially faster than TD, MC, and MC Tree Search. Outperforms rainbow, A3C, DDQN, Distributional DQN, Dueling DDQN, Noisy DQN, and Prioritized DDQN". The 50-page Appendix reminds me of @SELUAppendix. arxiv.org/abs/1806.07857
The Autoscaling Group You order a beer. 20 friends join you. The bartender dawdles about. Your friends give up and leave. The bartender brings you 80 beers. #awsdrinks
The “Eventual Consistency” You order a beer, and when you assume the bartender forgot you order another. Suddenly you feel intoxicated and then two beers arrive. #awsdrinks
Please do yourself a favor and check out the #awsdrinks hashtag.
Accurate speech recognition is no longer a red hair ring. It can wreck a nice beach with no error.
First edition of reading notes! Self-Normalizing Neural Networks, by G. Klambauer, T. Unterthiner, A. Mayr, and S. Hochreiter dtsbourg.github.io/thoughts/posts…
Yet another activation function! x.com/chrszegedy/sta…
Yet another activation function! x.com/chrszegedy/sta…
@SELUAppendix you should write a thriller called THE ACTIVATION FUNCTION x.com/tinysubversion…
Does your deep learning framework write its own license? Looks like @pjreddie's does #darknet #yolo x.com/fitzyfitzyfitz…
Does your deep learning framework write its own license? Looks like @pjreddie's does #darknet #yolo x.com/fitzyfitzyfitz…
@octonion they did architecture search over many variants. see the first footnote in the paper:
f(x) = x．sigmoid(x) They call it the Swish, a self-gated activation function. Seems to outperform Relu. arxiv.org/abs/1710.05941
My deepmoon deep learning framework is coming along github.com/paulfitz/deepm…
280 characters of @SELUAppendix: 4x 2 + 2xy + 2.7795x − 2y 2 − 0.9269y − 0.000277982 (2x + y) 2 + 5.39467x . This is equivalent to 0 < 4x 2 + 2xy + 2.7795x − 2y 2 − 0.9269y − 0.000277982 (2x + y) 2 + 5.39467x − (280) −8x 3 − 8x 2 y − 10.9554x 2 + 2xy2 + 1.76901xy -
@hardmaru @edersantana Probably people haven't started using it because they are still reading the appendix.
@StatMLPapers @SELUAppendix FYI: new version today ift.tt/2r7EKi8
Sounds like @SELUAppendix has a new challenger. x.com/algaebarnacle/…
We're up to version 3 of the SELU paper. @SELUAppendix is as long as ever. x.com/statmlpapers/s…
We're up to version 3 of the SELU paper. @SELUAppendix is as long as ever. x.com/statmlpapers/s…
Sepp Hochreiter @HochreiterSepp
11K Followers 395 Following Pioneer of Deep Learning and known for vanishing gradient and the LSTM. I mostly tweet about random ArXiv papers which sparked my interest.
Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Ethan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMind
Utkarsh @Utkarsh736
103 Followers 721 Following Data Scientist & AI/ML Developer | Passionate about sports and numbers Kaggle: https://t.co/Rxkt8xim12
Eltragdors @eltragdors
177 Followers 5K Following
Claus @ClausHofm
68 Followers 198 Following PhD Candidate at the Institute for Machine Learning, Johannes Kepler University Linz. Curious about everything ML
Agnese Marcato @AgneseMarcato
0 Followers 103 Following
Benjamin Minixhofer @bminixhofer
715 Followers 354 Following PhD Student @CambridgeLTL / prev @jkulinz @cohere @huawei @h2oai
godlionwolf @godlionwolf1
20 Followers 439 Following
Kieran Didi @ICLR @DidiKieran
388 Followers 1K Following BioML Developer @nvidia | Learned a lot @emblebi @TBioinf @ChemCambridge @KnowlesLabCamb @BioMed_X
Victor @MrColeslaw972
109 Followers 940 Following -EdTech ML Engineering Manager -OSS Contributor @ontocord -M.Sc Applied Math -2x Kaggle Expert
Jens-Peter M. Zemke (.. @jpmzemke
784 Followers 808 Following Oberingenieur des Lehrstuhles Numerische Mathematik des Institutes für Mathematik der Technischen Universität Hamburg (TUHH).
lorenzoterenzi @lterenzi96
74 Followers 950 Following
Volodymyr Kyrylov @darkproger
2K Followers 2K Following AI student at USI/ETH. Donate https://t.co/GDSkWG2tak
AdityaAS @thisisadityaas
567 Followers 3K Following Machine Learning & Systems @gtcomputing, SAIL lab. alum @bitspilaniindia ex-@WadhwaniAI, @IiscNlp, @ApacheMahout (@gsoc)
Bhavnick Minhas (🧑.. @BhavnickMinhas
202 Followers 1K Following ML Engineer and AI Evangelist, Building RAGs over LLMs in 🥷, @IITGuwahati Alum, Ex-Community Lead @forai_ml, building @dawnofevehq
Sasikanth Kotti @kotti_sasikanth
566 Followers 4K Following Graduate Student @iitjodhpur @CSEIITJ1 / Computer Vision, Trusted AI, Deep Learning. Volunteer Research Engineer @openminedorg. @ml_collective and @forai_ml
belisarius @belisarius0
150 Followers 1K Following a stray R&D engineer. Codec/Image processing➡️DNN/CV. piano beginner. 銭湯lover.
@srijitseal.bsky.soci.. @SrijitSeal
520 Followers 1K Following I am not active here... find more posts where the sky is still blue... Chemoinformatician @broadinstitute PhD Student @ChemCambridge, @Cambridge_Uni
LIUTAO @LIU_TAO_
0 Followers 16 Following
Mohamed Echcharif EL .. @Charif_Lagri
1 Followers 55 Following
ÁLVARO LEONARDO GARC.. @AlvaroGarcia_AI
2 Followers 451 Following | Los listos también sumamos con los dedos | | My website 🚀🌍https://t.co/OdLBTcsw7T |
Philipp Seidl @phseidl
451 Followers 436 Following Postdoc at the IML-JKU Linz. Prev. Intern at MSR Cambridge. Passionate about ML for DD, LLMs, and Zero-shot learning. Opinions are my own and evolving ;)
Johannes Schimunek @JSchimunek
121 Followers 134 Following
Felix Juefei Xu @felixudr
815 Followers 5K Following Research Scientist @AIatMeta (GenAI) | Passionate about Robust, Efficient, Multimodal, Generative AI | Adjunct Faculty @NYUniversity | PhD @CarnegieMellon
Tillmann Rheude @Tillmann_Rhe
34 Followers 124 Following CS PhD Candidate @ChariteBerlin | Previously CS @TUDarmstadt | Deep Learning for Medicine, esp. Medical Computer Vision & Multimodal Learning
Radoslava Švihrová @RSvihrova
98 Followers 980 Following Statistician in training, Machine Learning enthusiast. PhD student at University of Bern. Currently exploring causal inference tools for dynamic treatments.
Aswin V @avi010_
98 Followers 593 Following
Günter Klambauer @gklambauer
3K Followers 412 Following Deep Learning researcher known for self-normalizing neural networks, applications of Machine Learning in Life Sciences areas; ELLIS program Director
Harshvardhan Khanna @harshkhanna28
12 Followers 71 Following
Florian @fses91
94 Followers 749 Following
Sambo @samgassi
114 Followers 523 Following
arsyed @arsyed
47 Followers 2K Following
Awais @deepawais
1K Followers 5K Following Researcher @MBZUAI Prev: @SonyAI_global, Jp 🇯🇵; Noah's Ark Lab, @Huawei, HK 🇭🇰; MLVC Lab, KHU, SK 🇰🇷
ᔕIᗩᗰ ✪ @mosiam_
1K Followers 3K Following Angel Investor. In perpetual pursuit of knowledge with a zest for coding. #Invest #Enterpreneur #Code #Angular #blockchain
Mac Abdul @MacAbdul9
2K Followers 5K Following CSE Undergrad | Research Intern @lcs2iiitd | ML/DL x NLP | LiverpoolFC⚽
Hashimoto @19950409han
15 Followers 510 Following
Martin Müller @marmuel_
385 Followers 646 Following Co-founder @dreamlookai | previously @CedilleAI, PhD @EPFL
Victor Chelule @Chelule
1K Followers 1K Following
Ihama @Ihama15
909 Followers 5K Following
Nikhil Yadala @nikhilyadala
726 Followers 3K Following Building @Healome1 #ODH1 #ODLB1 |Formerly @Bing search, CS @LTIatCMU @IITGuwahati. Interested in intersection of CS, drug discovery and healthy longevity
Yann LeCun @ylecun
715K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Andrej Karpathy @karpathy
983K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
François Chollet @fchollet
471K Followers 771 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.
Erik Bernhardsson @bernhardsson
38K Followers 3K Following Building @modal_labs when I'm not posting bangers about data and software. Previously built the music rec sys at Spotify and ran the eng team at Better.
Christopher D. Long @octonion
22K Followers 7K Following SumerSports - NFL analytics and roster optimization. Ex-San Diego Padres, Detroit Tigers, Houston Rockets. Google Foobar winner. He/him. [email protected]
Neal Wu @WuNeal
15K Followers 391 Following Building @cognition_labs. Previously @tryramp, @GoogleBrain, @Harvard, competitive programming (featured in @Wired). Created https://t.co/pihw5AGvbV.
dr. allison barner @algaebarnacle
4K Followers 1K Following not on here any more. IRL: assistant professor, community ecologist, marine biologist, she/her
Dave Harris @davidjayharris
2K Followers 1K Following Data scientist. Currently working on algorithmic product recommendations.
"The API Gateway" The bartender brings you a bartender. #awsdrinks
The CloudTrail: Somewhere between 5 and 15 minutes after wallet has been pickpocketed and used to buy 10,000 shots of Jägermeister, the bartender advises you that your wallet was stolen and used to buy 10,000 shots of Jägermeister. #awsdrinks
Paper Notes: Self-Normalizing Neural Networks (SNNs/SELU activation) reddit.com/r/MachineLearn…
Recently used ‘selu’ activation in #deeplearning3 challenge on @HackerEarth. While fine tuning my last few layes I thought of going for it and gave me pretty good learning in few epochs.
SELU paper arxiv.org/abs/1706.02515 was mentioned today at #mlprague. (You might know that the @SELUAppendix is the twitter account dedicated to it's 100-page mathematical appendix.)
280 characters of @SELUAppendix: 4x 2 + 2xy + 2.7795x − 2y 2 − 0.9269y − 0.000277982 (2x + y) 2 + 5.39467x . This is equivalent to 0 < 4x 2 + 2xy + 2.7795x − 2y 2 − 0.9269y − 0.000277982 (2x + y) 2 + 5.39467x − (280) −8x 3 − 8x 2 y − 10.9554x 2 + 2xy2 + 1.76901xy -
alias wat='python -m pdb -c continue' # you're welcome
@StatMLPapers @SELUAppendix FYI: new version today ift.tt/2r7EKi8
We're up to version 3 of the SELU paper. @SELUAppendix is as long as ever. x.com/statmlpapers/s…
Self-Normalizing Neural Networks. (arXiv:1706.02515v3 [cs.LG] UPDATED) ift.tt/2r7EKi8
@SELUAppendix you are too long and frankly I don't fully understand you..
"selu" Activation Function and 93 Pages of Appendix datawarrior.wordpress.com/2017/06/15/sel… via @stephenhky #selu #neuralnetworks #deeplearning
@markus_with_k @dennybritz We are running multiple runs now. Will post resultat when finished.
So now that's #selu is trending, i guess that Southeastern Louisiana University will see arise?
Amazing SELU activation function, never seen char rnn so fast....
RT: (dyna_ml)v1.4.3 released! SELU activation function among other additions. ift.tt/2szSq5C #MachineLearning #datascience
🚀 Your ongoing issue: to implement new activation functions, to replicate their magic initializations, to boldly add them to keras core. x.com/bigsnarfdude/s…
I used deep learning to cross a book of dinosaurs X a book of flowers
Trends for United States
You might like
