Aditya Varre @adityavardhanv
Student Lausanne Joined August 2015-
Tweets24
-
Followers65
-
Following208
-
Likes342
❓So why do we need weight decay, really? Don't LLMs directly optimize the population loss and regularization is not needed? 🚨 Our new paper provides a modern look at the old question arxiv.org/abs/2310.04415! (joint work with @dngfra, @adityavardhanv, @tml_lab) 🧵1/n
Introducing Landmark Attention! Our method allows #transformers to handle any inference context length, regardless of their training context length. This enables #LLAMA7B to process contexts with 32k+ tokens—just like #GPT4. Read our paper: arxiv.org/abs/2305.16300 🧵👇(1/3)
🚨Happy to share our new paper "SGD with large step sizes learns sparse features" arxiv.org/abs/2210.05337! ❓Why do longer SGD schedules generalize better? What kind of hidden dynamics occurs when the train loss stabilizes? How is that related to sparse feature learning? 🧵1/10
SGD is back! Let's try to find out why it generalises so well. A new blog post: francisbach.com/implicit-bias-…
Will never tire of watching his ball of the century. RIP Shane Warne ❤️🇦🇺
Back in my hotel room and contemplating the magnitude of what a young man from Chinnappampatti achieved today. @Natarajan_91's debut shows us that Indian cricket is a meritocracy. And may it always be that way.
Whether Ruturaj or Shivaji Rao, Gaikwad has always been a popular surname in Chennai!
Our public spend on edu is 4.43% gdp. While 6% is desirable, it is not easy given the fiscal constraints. AP+TS are spending ₹50000 cr/yr on schools with total of 66 lakh kids, or ₹75k/child. Spending wisely and getting outcomes, not allocation of more money, shd be the goal.
Our public spend on edu is 4.43% gdp. While 6% is desirable, it is not easy given the fiscal constraints. AP+TS are spending ₹50000 cr/yr on schools with total of 66 lakh kids, or ₹75k/child. Spending wisely and getting outcomes, not allocation of more money, shd be the goal.
What a Test career @VDP_24 had 🙌 #ThankYouBigVern
Thread: YCP - their movie dialogues obsession during productive sessions .
తెలుగు మాధ్యమాన్ని పాఠశాలలలో ప్రభుత్వం ఆపివెయ్యడానికి సన్నాహాలు చేస్తుంటే ,ఆంధ్రప్రదేశ్ అధికారభాష సంఘం ఏం చేస్తుంది?
“Rugby shouldn’t be something that creates pressure on you, it should be something that creates hope” An eloquent response from @Springboks head coach Rassie Erasmus on the meaning of pressure for South Africans outside of rugby #RWC2019
@AaronFinch5 Maybe you can watch it with a Star(c) @mstarc56 👀 #GameofThrones
@SushmaSwaraj Dear Mam, I am Prudhvi and I live in Dubai. I have been working here from July 2018 after I got recruited from my campus placements from IIT Bombay. My passport is confiscated by the CID officials, Al Ain on feb 26th 2019.

Smoolet @Smoolet192966
107 Followers 7K Following
Soashi @SoashilDP
46 Followers 5K Following
Avrajit Ghosh @GhoshAvrajit
294 Followers 1K Following Postdoc @SimonsInstitute @berkeley_ai. Generalization, optimization, Inverse problems. PhD @MSU_EGR. (No prior) better than (wrong priors).
Gelio @geliop
132 Followers 5K Following
Mohamed Hamed @hamed_mo7amed
932 Followers 5K Following I tweet about Computer Vision, Deep Learning, and Artificial Intelligence (AI).
SherryHarrod @398bkic14PT3S3
72 Followers 6K Following
Gizem Yüce @yucegizem
97 Followers 124 Following Master's Student at D-ITET @ETH_en Specializing in Signal Processing and Machine Learning
Noam Razin @noamrazin
672 Followers 333 Following Postdoctoral Fellow at @PrincetonPLI | Past: Computer Science PhD @TelAvivUni & Apple Scholar in AI/ML | Interested in the foundations of deep learning
Sheethi @Sheethi264765
71 Followers 7K Following A strong woman is one who is determined to do what others are determined not to do.
Elisabetta Cornacchia @Elisabetta68885
83 Followers 119 Following Postdoc at MIT in theoretical machine learning
PatriciaAlcott @6d8YjnbWC5qfml
42 Followers 4K Following
Tasesmoasm @TasesmoasmvORl
61 Followers 7K Following
Anshul Toshniwal @toshniwal8
27 Followers 390 Following
Alex Hägele @haeggee
835 Followers 663 Following Fellow @AnthropicAI + PhD Student in Machine Learning @ICepfl MLO. MSc/BSc from @ETH_en. Previously: Student Researcher @Apple MLR
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
Pensé FFun @inftyCategory
136 Followers 7K Following
Luca Viano @LucaViano4
403 Followers 425 Following Optimist in face of the uncertainty, PhD student @EPFL
Dongyang Fan @dyfan22
128 Followers 301 Following PhD student in ML/LLMs @epfl_en 🇨🇭 Previously statistics @ETH_en.
Ekaterina Lobacheva @KateLobacheva
577 Followers 396 Following Postdoc @Mila_Quebec @UMontreal Like to explain unexpected behavior of neural nets 🤯
Akhil Arora @aroraakhilcs
447 Followers 387 Following Asst Prof @csaudk / Fellow @CPH_SODAS | NLP, Agentic AI, Causality, Graph ML | Previous: CS PhD @ICepfl / RS @americanexpress @Xerox @Intel • 🥾🏔️🚴♂️🏋️♂️🎸
Linara @LinaraAdylova
145 Followers 118 Following Postdoctoral researcher in RC Trust group for trustworthy AI. My main research interest is theory of deep learning. My home university is TU Dortmund.
TML Lab (EPFL) @tml_lab
388 Followers 96 Following Theory of Machine Learning Lab at @EPFL led by Nicolas Flammarion. We develop algorithmic & theoretical tools to better understand ML & make it more robust.
Felix Sarnthein @__safelix__
93 Followers 313 Following PhD student in machine learning at @ELLISInst_Tue, @MPI_IS and @CSatETH with @orvieto_antonio. Prev: MSc in CS at @ETH
Atli Kosson @AtliKosson
240 Followers 483 Following PhD student at @EPFL🇨🇭 working on improved understanding of deep neural networks and their optimization. Previously did NN training @Tesla_AI @CerebrasSystems
fl quan @fl_quan
36 Followers 1K Following
Skander Moalla @SkanderMoalla
260 Followers 351 Following SR @ GDM | PhD @ EPFL, Caglar Gulcehre Lab for AI Research (CLAIRE) | Reinforcement Learning, Large Language Models, AI Alignment
Yatin Dandi @DandiYatin
320 Followers 2K Following PhD student (EPFL, Switzerland), interested in the theory of deep learning and statistical physics of computation
Raj Krishnan V @raj_krishnan_v
237 Followers 2K Following Clinical AI • Robustness • LLM Eval • KDD’25 @GenAIEval • Building diagnostic trust in agentic models • Embedding To Diagnosis: https://t.co/xqS5Fo9gUN
Vidhi Jain @viddivj
4K Followers 3K Following Researcher at @OpenAI. Previously PhD at @CMU_Robotics, @GoogleDeepMind Robotics. @MetaAI, @IndiaMSR.
Ya-Ping Hsieh @yapinghsieh
294 Followers 260 Following
Michael Stone @anoncept
135 Followers 2K Following Security, safety, systems, and software. @[email protected]
David Duvenaud @DavidDuvenaud
31K Followers 4K Following Machine learning prof @UofT. Former team lead at Anthropic. Working on generative models, inference, & latent structure.
Maria Vladarean @mlvl11
28 Followers 120 Following
Aditya Kusupati @adityakusupati
5K Followers 2K Following Been places..... Done things.... Next-Gen Modelling @GoogleDeepMind
Vinitra Swamy @vinitra_s
419 Followers 589 Following Co-Founder + CEO @ Scholé AI | all things ai for education | formerly at @epfl @UCBerkeley @Microsoft @onnxai | ✨👩🏽💻📚🇺🇸✨
Matteo Pagliardini @MatPagliardini
885 Followers 443 Following PhD student in ML @EPFL_en, previously Apple MLR. @matpagliardini.bsky.social
Maksym Andriushchenko @maksym_andr
5K Followers 906 Following Faculty at @ELLISInst_Tue & @MPI_IS, leading the AI Safety and Alignment group. PhD from @EPFL supported by Google & OpenPhil PhD fellowships.
Uday Kusupati @bleak_visual
108 Followers 432 Following
Avrajit Ghosh @GhoshAvrajit
294 Followers 1K Following Postdoc @SimonsInstitute @berkeley_ai. Generalization, optimization, Inverse problems. PhD @MSU_EGR. (No prior) better than (wrong priors).
Dylan O'Sullivan @DylanoA4
118K Followers 549 Following “All is built on sand, but we must build as if the sand were stone.” Working on books @InfiniteB88ks. Working on writing @Essayful. Bylines @TheSpectator, etc.
adithya @00aleph00
13K Followers 237 Following i want to make abstract math accessible to the world!
Jérôme Bolte @jerome_bolte
178 Followers 41 Following Professor of Mathematics, Toulouse School of Economics & ANITI
Oğuz Kaan Yüksel @okyksl
85 Followers 280 Following
Becker Quentin @quent_becker
37 Followers 146 Following Postdoc at EPFL interested in geometry and differentiable physics. Personal website: https://t.co/fJpIWadOeo.
Rozhina Ghanavi @_ghnn_
3K Followers 418 Following PhD @mit & @mitsloan. IO, marketing, econ of tech, privacy, health, education. alum: @UofT @VectorInst @rotmanschool . 🇨🇦
Marco Mondelli @MMondelli
205 Followers 210 Following Professor @ISTAustria. Machine learning, information theory. Prev: @Stanford, @EPFL
deepmath @deepmath1
2K Followers 78 Following Conference devoted to giving visibility to researchers of all disciplines studying deep learning theory.
Epic Maps 🗺️ @theepicmap
1.2M Followers 6 Following Educational and informative world Maps 🗺️. We do not own any content posted. Dm for removal/credit.
Poetry Daily @Poetry_Daily
215K Followers 2K Following Poetry Daily presents a poem each day from new books and journals, along with poetry news, announcements, and more. Est. 1997.
Physics In History @PhysInHistory
1.0M Followers 0 Following Photos from the history of physics | © with mentioned Archives. Shared for educational purposes. Einstein portrait © Ullsteinbild. Subscribe for curated papers.
Subbarao Kambhampati ... @rao2z
26K Followers 68 Following AI researcher & teacher @SCAI_ASU. Former President of @RealAAAI; Chair of @AAAS Sec T. Here to tweach #AI. YouTube Ch: https://t.co/4beUPOmf6y Bsky: rao2z
Gizem Yüce @yucegizem
97 Followers 124 Following Master's Student at D-ITET @ETH_en Specializing in Signal Processing and Machine Learning
Noam Razin @noamrazin
672 Followers 333 Following Postdoctoral Fellow at @PrincetonPLI | Past: Computer Science PhD @TelAvivUni & Apple Scholar in AI/ML | Interested in the foundations of deep learning
Elisabetta Cornacchia @Elisabetta68885
83 Followers 119 Following Postdoc at MIT in theoretical machine learning
Anjana Meenakshi @AnjanaMeenakshi
2K Followers 2K Following Journalist @thenewsminute. Send leads to [email protected] I like to read, write and grumble.
Yen-Huan Li @yenhuan_li
2K Followers 581 Following Associate professor in CS @ National Taiwan University. PhD in CS from EPFL. Learning, optimization, statistics, and some quantum information.
Song Mei @Song__Mei
3K Followers 689 Following Assistant Professor at UC Berkeley, Department of Statistics and EECS. Researcher at OpenAI working on LLM training.
Kasper Green Larsen @kasperglarsen
2K Followers 263 Following Professor and Head of Algorithms, Data Structures and Foundations of Machine Learning at Computer Science, Aarhus University
Python Maps @PythonMaps
77K Followers 573 Following Mapping the world with Python. Contact [email protected] Buy my book here - https://t.co/hAaaAxtaYB
Alex Hägele @haeggee
835 Followers 663 Following Fellow @AnthropicAI + PhD Student in Machine Learning @ICepfl MLO. MSc/BSc from @ETH_en. Previously: Student Researcher @Apple MLR
Shubhendu Trivedi @_onionesque
9K Followers 895 Following Cultivated Abandon. Twitter interests: Machine learning research, applied mathematics, mathematical miscellany, ML for physics/chemistry, books.
Marylou Gabrié @marylougab
667 Followers 159 Following Assistant Prof @ENS_ULM working on Statistical Mechanics & Machine Learning.
Dongyang Fan @dyfan22
128 Followers 301 Following PhD student in ML/LLMs @epfl_en 🇨🇭 Previously statistics @ETH_en.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
fly51fly @fly51fly
8K Followers 2K Following BUPT prof | Sharing latest AI papers & insights | Join me in embracing the AI revolution! #MachineLearning #AI #Innovation
Krzakala Florent @KrzakalaF
3K Followers 386 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.
Pavilion Opinions @pavilionopinion
26K Followers 3K Following 'Without cricket, life would be a mistake' https://t.co/UCUv5W2ldS Moorlands Radio Sport - Tues 7 pm, Sat 2 pm. 🎙️⚽ https://t.co/HmI4HMdjM7
lmarena.ai @arena
95K Followers 207 Following LMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
Gems of Simps @GemsOfSimps
141K Followers 1 Following I post Simps. DM for collaboration & submission.
Ernest Ryu @ErnestRyu
6K Followers 350 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Akhil Arora @aroraakhilcs
447 Followers 387 Following Asst Prof @csaudk / Fellow @CPH_SODAS | NLP, Agentic AI, Causality, Graph ML | Previous: CS PhD @ICepfl / RS @americanexpress @Xerox @Intel • 🥾🏔️🚴♂️🏋️♂️🎸
Blake Bordelon ☕️... @blake__bordelon
1K Followers 809 Following ML/Neuroscience PhD student at @Harvard
Poetic Outlaws @OutlawsPoetic
109K Followers 514 Following The outlaws of poetry and the written word.
Felix Sarnthein @__safelix__
93 Followers 313 Following PhD student in machine learning at @ELLISInst_Tue, @MPI_IS and @CSatETH with @orvieto_antonio. Prev: MSc in CS at @ETH
flair_epfl @flair_epfl
211 Followers 5 Following The Foundations of Learning and AI Research (FLAIR) group @ EPFL aims at providing grounded scientific foundations to foster machine learning of tomorrow
Anindita Maiti @AninditaMaiti7
1K Followers 354 Following Postdoc Fellow @Perimeter | Previously, postdoc @Harvard | PhD @Northeastern & @iaifi_news | UG @IITBombay | Physics for AI; AI for field theory
Clément Hongler @HonglerClement
415 Followers 289 Following Some things happening here: https://t.co/qhvGqkT2Rx
Oishi Deb @DebOishi
651 Followers 683 Following ELLIS PhD Candidate (Industry Track) {@Oxford_VGG + @OxfordTVG + @GoogleDeepMind} British Citizen🇬🇧🇪🇺 @Oxengsci @CompSciOxford @ELLISforEurope @RollsRoyceUK
Consulting Comedy @consultingcmdy
78K Followers 89 Following Your one-stop-shop for workplace chuckles and parody • Applicable to all industries • 700k community on IG