Fabian Schaipp @FSchaipp
working on optimization for machine learning. currently postdoc @inria_paris. fabian-sp.github.io Paris, France Joined July 2020-
Tweets450
-
Followers1K
-
Following686
-
Likes2K
weight decay seems to be a hot topic of this year's ICLR submissions 👀
1
0
13
1K
1
are models getting nervous when they are set from .train() to .eval()?
Fabian Schaipp retweeted
If you’re scrambling a last-minute submission with an uncertain result, remember: putting it off is hard in the moment. It will sting for 10 minutes (because you care so deeply), but in 10 months you’ll be incredibly proud you made the scientifically rigorous call.
Fabian Schaipp retweeted
Die Berliner Verkehrssenatorin Uta Bonde (CDU) jetzt im Gespräch mit dem Tagesspiegel zum Thema Schulwegsicherheit: „Wir können nicht nach Gutdünken Tempo 30 einführen“ Autofreie Schulstraßen wie in Paris sieht sie skeptisch. Dafür ihr Rat an alle Kinder und Jugendlichen: „Helm…
Fabian Schaipp retweeted
Long in the making, finally released: Apertus-8B and Apertus-70B, trained on 15T tokens of open data from over 1800 languages. Unique opportunity in academia to work on and train LLMs across the full-stack. We managed to pull off a pretraining run with some fun innovations, ...
Long in the making, finally released: Apertus-8B and Apertus-70B, trained on 15T tokens of open data from over 1800 languages. Unique opportunity in academia to work on and train LLMs across the full-stack. We managed to pull off a pretraining run with some fun innovations, ... https://t.co/c8ECD4rp34
🚟 New blog post: On "infinite" learning-rate schedules and how to construct them from one checkpoint to the next fabian-sp.github.io/posts/2025/09/…
FYI Adam will be on holiday the entire august
FYI Adam will be on holiday the entire august
Best tutorials are those that do not only promote the speakers' own work. #ICML2025
🚡 Come check out our poster on understanding LR schedules at ICML. Thursday 11am.
Pogacar didnt have a bad day since TdF 2023, stage 17. Quite astonishing #TDF2025
A paper that contains both the words "sigma-algebra" and "SwiGLU activations" ☑️ Also interesting results on embedding layer LRs.
Fabian Schaipp retweeted
We uploaded V3 of our draft book "The Elements of Differentiable Programming". Lots of typo fixes, clarity improvements, new figures and a new section on Transformers! arxiv.org/abs/2403.14606
is it allowed to write papers on μP only subject to using the most un-intuitive notation?
Dongyang Fan @dyfan22
129 Followers 300 Following PhD student in ML/LLMs @epfl_en 🇨🇭 Previously statistics @ETH_en.
Yann Traonmilin @YTraonmilin
210 Followers 221 Following CNRS researcher at Institut de mathématiques de Bordeaux
Gregor Bachmann @GregorBachmann1
369 Followers 386 Following I am a PhD student @ETH Zürich working on deep learning. MLP-pilled 💊. https://t.co/yWdDEV6Z15
Arya Klara @Noah_1194
1K Followers 4K Following
Vruko @Vruko986
8 Followers 148 Following
BarbaraBenedict @MG9COG86i828G
18 Followers 463 Following
Robert Scoble @Scobleizer
543K Followers 24K Following The best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
Senthil Kumar @SenthilKumarN_
72 Followers 2K Following Aspiring ML Researcher. Interested in Bayesian Machine Learning & RL.
L1Latency @Thoughts2Thrds
135 Followers 5K Following 🧠 Turning thoughts into threads ⚙️ 🔧 GEMMs on Blackwell, Hopper, Ampere!!
Stephen Oates @stephenjaoates
816 Followers 7K Following
Namhoon Lee @namhoonlee09
341 Followers 482 Following Assistant Professor of Computer Science and Engineering at POSTECH; Currently away on Sabbatical at IST Austria
Hexaly @_Hexaly
4K Followers 2K Following Hexaly is the world’s fastest optimization solver for Routing, Scheduling, Packing, and more. Join our fast-growing developer community!
Here we go @AvimanyuRoy3
669 Followers 3K Following
Thibaut Boissin @ThibautBoissin
252 Followers 206 Following
Pietro @aplietexe
6 Followers 713 Following
Saber Darabi @SADarabi
307 Followers 7K Following
Vadim Liventsev @vadimdotme
80 Followers 1K Following lead hip hop engineer @ https://t.co/y80r2iuMsN
Jingfeng Wu @uuujingfeng
1K Followers 1K Following Bsky: https://t.co/hUrRPJZ9BU Postdoc @SimonsInstitute @UCBerkeley; alumnus of @JohnsHopkins @PKU1898; DL theory, opt, and stat learning.
Vlarrerm @Vlarrerm133604
32 Followers 1K Following
Yfleuirdirn @Yfleuirdirn682
27 Followers 1K Following
Mussa Kambi @MussaKambi77202
10 Followers 856 Following
Dayal Kalra @dayal_kalra
400 Followers 571 Following Research intern @AIatMeta FAIR; PhD student @umdcs; Past @UMD_IPST, BS-MS @IISERPune
Valentina Pyatkin @valentina__py
3K Followers 1K Following Postdoc at the Allen Institute for AI @allen_ai and @uwnlp
Amin Karbasi @aminkarbasi
11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.
Mathurin Massias @mathusmassias
2K Followers 181 Following Researcher @INRIA_lyon, Ockham team. Teacher @Polytechnique and @ENSdeLyon Machine Learning, Python and Optimization
Viet Nguyen Trong @ntrongviet
0 Followers 37 Following
Rohan Jain @JainRohan16
191 Followers 523 Following • MSc in ML @UCalgary, ML Researcher @ml_collective • Prev: Math + CS @UofT
Ali Ramlaoui @AliRamlaoui
97 Followers 235 Following ML Researcher | AI4Science and Materials Discovery
Chaim Baskin @ChaimBaskin
598 Followers 2K Following Assistant Prof @ BGU | Efficient & Robust ML • GNNs • Foundation Models | AC ICLR • LoG • WACV | Member of ELLIS | IEEE Sr. Member
Ishaq @ishaqHMK
0 Followers 63 Following
Dongyeop Lee @dongyeop_lee2
32 Followers 196 Following Master's student at the Graduate School of Artificial Intelligence in @postech2020. Previously: student researcher at @google
Raymond Ng @Raymondng_aisg
8 Followers 1K Following
Percy Liang @percyliang
85K Followers 420 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Murat A. Erdogdu @MuratAErdogdu
943 Followers 284 Following Professor at University of Toronto. Research on machine learning, optimization, and statistics.
Matthew Johnson @SingularMattrix
13K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Yann Traonmilin @YTraonmilin
210 Followers 221 Following CNRS researcher at Institut de mathématiques de Bordeaux
Alex Sablayrolles @alexsablay
2K Followers 924 Following Research Scientist, Mistral AI. Interested in LLMs, deep learning, fast nearest-neighbor search and privacy. ex: @Meta, @NYUniversity, @Polytechnique.
Alessandro Favero @alesfav
407 Followers 787 Following AI & Physics PhD candidate @EPFL working on the foundations of AI. Former applied scientist intern at AWS AI.
Gregor Bachmann @GregorBachmann1
369 Followers 386 Following I am a PhD student @ETH Zürich working on deep learning. MLP-pilled 💊. https://t.co/yWdDEV6Z15
Dongyang Fan @dyfan22
129 Followers 300 Following PhD student in ML/LLMs @epfl_en 🇨🇭 Previously statistics @ETH_en.
Giorgia Ramponi @gio_ramponi
4K Followers 285 Following Ass. Prof. @UZH_en @uzh_ifi, PI @ ALPILab 🌼 Working on RL, multi-agent, imitation learning, and other sequential decision-making stuff @gioramponi.bsky.social
Subham Sahoo @ssahoo_
1K Followers 88 Following Pioneering Diffusion LLMs. PhD candidate @cornell. Previously @GoogleAI, @IITKgp.
Gabriel Zucman @gabriel_zucman
114K Followers 939 Following Chasing wealth and income, present and past, onshore and offshore.
Matthias Gallé @mgalle
2K Followers 1K Following Safety, Multilingual & Code lead @CohereAI. Born in 🇧🇷, raised in 🇩🇪, studied in 🇦🇷, living in 🇫🇷.
François Rozet @FrancoisRozet
695 Followers 132 Following datamancer, generative models, bayesian inference, dynamical systems, open-source software, phd with @glouppe
Andrei Semenov @AndreiSemenov17
156 Followers 278 Following MSc in Data Science at @EPFL_en | MIPT Alumnus
CSCS Lugano @cscsch
3K Followers 101 Following CSCS, the Swiss National Supercomputing Centre, develops and promotes technical and scientific services in the fields of high-performance computing. #weareAlps
Thibaut Boissin @ThibautBoissin
252 Followers 206 Following
Hexaly @_Hexaly
4K Followers 2K Following Hexaly is the world’s fastest optimization solver for Routing, Scheduling, Packing, and more. Join our fast-growing developer community!
IIT @IITalk
20K Followers 3K Following By promoting excellence in basic and applied research IIT contributes to the economic development of Italy
Politecnico di Torino @PoliTOnews
21K Followers 201 Following
Jonas Geiping @jonasgeiping
4K Followers 803 Following Machine Learning Research at the ELLIS Institute & Max-Planck for Intelligent Systems// Excited about fundamental questions in Safety & Efficiency of modern ML
EurIPS Conference @EurIPSConf
573 Followers 56 Following EurIPS is a community-organized, NeurIPS-endorsed conference in Copenhagen where you can present papers accepted at @NeurIPSConf
Valentina Pyatkin @valentina__py
3K Followers 1K Following Postdoc at the Allen Institute for AI @allen_ai and @uwnlp
Daniele Grattarola @riceasphait
2K Followers 863 Following Leading generative models @IsomorphicLabs | AI for drug discovery | Previously IDSIA, @EPFL
Amin Karbasi @aminkarbasi
11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.
Sacha Braun @PotoSacho
38 Followers 57 Following PhD student in machine learning with Francis Bach & Michael I. Jordan: uncertainty quantification, conformal prediction, learning theory. https://t.co/dkoZLl0pDg
Sebastian Bordt @sbordt
292 Followers 603 Following Language models and interpretable machine learning. Postdoc @ Uni Tübingen.
Umar Jamil @hkproj
15K Followers 1K Following AI @MistralAI - Join the best AI community on Discord: https://t.co/zYH1DlgdbW - Opinions my own
Q @qtnx_
17K Followers 550 Following codegen @mistralai (prev. applied research; https://t.co/SDROdHKqTQ), husband
davinci @leothecurious
2K Followers 757 Following teaching robots to see by day, learning from nature by night. in search of elegant solutions to the metaproblem. infinitely curious.
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Mathieu @miniapeur
34K Followers 2K Following Non-member of the technical staff in a non-frontier lab. Gradient surfer by day, Möbius stripper by night. PhD @ai_ucl.
Yaroslav Bulatov @yaroslavvb
8K Followers 930 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Fondation Tara Océan @TaraOcean_
19K Followers 3K Following La #FondationTaraOcéan est la première fondation reconnue d’utilité publique consacrée à l’Océan en France. #ExplorerEtPartager
gensyn @gensynai
84K Followers 39 Following Gensyn is building the network for machine intelligence. Build with us: https://t.co/1agn4jO8pp
Kevin Frans @kvfrans
4K Followers 502 Following @berkeley_ai @reflection_ai prev mit, read my thoughts: https://t.co/7CZsOTrKRA
Daria_Surkova @Dari_Designs
4K Followers 222 Following Brand Designer. Exploring how to apply AI for graphic and motion design.
noahamsel @noahamsel
18 Followers 67 Following
James Sanders @james_s48
499 Followers 1K Following Trying to figure out what the heck is going on. I enjoy thinking about economics, AI, philosophy, and the NBA
Epoch AI @EpochAIResearch
27K Followers 0 Following Investigating the trajectory of AI for the benefit of society.
Γ(z) @gammaofzeta
12K Followers 2K Following Anti-speciesism 🌱, deep ecology. Mathematical physics. I like puzzles and riddles.
zed @zmkzmkz
4K Followers 1K Following #1 paperclip maximizer fan, occasionally on x-games mode. I really, really like watching loss graphs go down
Xidulu @xidulu
342 Followers 514 Following Xi Wang, Full-stack Bayesian, ECNU, UMass CICS, JHU CS, Fan of U-Shape
Damien Ferbach @damien_ferbach
579 Followers 195 Following PhD at @Mila_Quebec/ Previously student in Maths and theoretical Physics at @ENS_ULM
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Ryan D'Orazio @RyanDOrazio
500 Followers 355 Following PhD Student at Mila Quebec AI Institute, and Université de Montréal.Trends for United States
159 B posts
49,2 B posts
85,2 B posts
6.838 posts
40,8 B posts
13 B posts
4.679 posts
38,9 B posts
11,4 B posts
6.724 posts
19,8 B posts
46,7 B posts
11 B posts
6.646 posts
6.258 posts
3.652 posts
7.667 posts
2.836 posts
8.014 posts
4.083 posts
You might like
Konstantin Mishchenko
@konstmish
7K Followers
Ben Grimmer
@prof_grimmer
3K Followers
Aaron Defazio
@aaron_defazio
8K Followers
Mathieu Dagréou
@Mat_Dag
504 Followers
Damek
@damekdavis
6K Followers
Franck Iutzeler
@FranckIutzeler
671 Followers
Till Richter
@TillRichter6
224 Followers
Nicolas Loizou
@NicLoizou
1K Followers
Dirk L.
@Dirque_L
1K Followers
Adrien Taylor
@TaylorAdrien
437 Followers
Samuel Horváth
@sam_hrvth
288 Followers
Quentin Bertrand
@Qu3ntinB
1K Followers
Samuel Vaiter
@vaiter
3K Followers
Yann Traonmilin
@YTraonmilin
210 Followers
J. Lyle Kim
@jlylekim
212 Followers