Julia Kempe @KempeLab
Silver Professor at NYU Courant and CDS, Research Scientist at FAIR Research in Machine Learning, past in Quantum Computing & Finance. Posts my own. Joined April 2024-
Tweets137
-
Followers2K
-
Following144
-
Likes255
Julia Kempe retweeted
New @AIatMeta paper. The paper teaches a model to think using continuous tokens during reasoning, then answer using normal tokens. The big deal is that it gives the diversity benefits of continuous reasoning without changing serving or prompts. This keeps single try accuracy…
2
7
28
4K
18
Download Image
Julia Kempe retweeted
🔥New preprint: Soft Tokens, Hard Truths Introduces the first scalable continuous-token RL method for LLMs - no reference CoTs needed; scales to hundreds of thought tokens. Best to train soft, infer hard! Pass@1 parity ⚖️, Pass@32 gains 📈& better robustness 🛡️ vs. hard CoT 1/🧵
Grateful for this great summary of our recent work!
Grateful for this great summary of our recent work!
Julia Kempe retweeted
🔥 NEW PAPER: What makes reasoning traces effective in LLMs? Spoiler: It's NOT length or self-checking. We found a simple graph metric that predicts accuracy better than anything else—and proved it causally. 🧵[1/n]
Julia Kempe retweeted
Beautiful @AIatMeta paper. Shows that when models are rewarded only for getting the final answer right, they do become more accurate, but they also lose variety in the answers they generate. That lack of variety hurts real-world use, because sampling multiple answers at test…
Julia Kempe retweeted
LLMs lose diversity after RL post-training, and this hurts test-time scaling & creativity. Why does this collapse happen, and how can we fix it? Our new work introduces: 🔍 RL as Sampling (analysis) 🗺️ Outcome-based Exploration (intervention) [1/n]
Looking forward to collaborate with some of my favorite colleagues on "The Physics of Learning...". Thanks to @SimonsFdn for selecting our proposal!
Looking forward to collaborate with some of my favorite colleagues on "The Physics of Learning...". Thanks to @SimonsFdn for selecting our proposal!
Great work by great Meta FAIR Paris intern and colleagues !
Great work by great Meta FAIR Paris intern and colleagues !
Julia Kempe retweeted
Our new Simons Collaboration on the Physics of Learning and Neural Computation will employ and develop powerful tools from #physics, #math, computer science and theoretical #neuroscience to understand how large neural networks learn, compute, scale, reason and imagine:…
Julia Kempe retweeted
How would you make an LLM "forget" the concept of dog — or any other arbitrary concept? 🐶❓ We introduce SAMD & SAMI — a novel, concept-agnostic approach to identify and manipulate attention modules in transformers.
Julia Kempe retweeted
❓How to balance negative and positive rewards in off-policy RL❓ In Asymmetric REINFORCE for off-Policy RL, we show that giving less weight to negative rewards is enough to stabilize off-policy RL training for LLMs! 💪 (1/8) Paper: arxiv.org/abs/2506.20520
Julia Kempe retweeted
Congrats to 37 CDS researchers — faculty, postdocs, and PhD students — who had papers accepted to ICLR 2025, including Spotlighted work by @KempeLab, @feeelix_feng, @andrewgwils, @KuangYilun, and @JianyuZhang8. Full list: nyudatascience.medium.com/cds-researcher…
Derek Moore @derekm00r3
3K Followers 6K Following Scientist, technologist, programmer, entrepreneur, engineer https://t.co/CDu5AxFN1m
곽병우 @bwoo_kwak
0 Followers 173 Following
Tomasz Sternal @TomaszSternal
9 Followers 414 Following
🌝 @mathphysicsquit
44 Followers 5K Following
Alex Sherstinsky @AlexSherstinsky
808 Followers 6K Following Scientist, Engineer, Manager, Musician, Athlete, Thespian, Father, Husband, Son, Friend
Adhiraj Singh @AdhirajS1206
64 Followers 1K Following MS in Data Science @NYUDataScience | Prev. Data Scientist (Personalised Search Recommendation) at Lowe’s
K Aayush Mazumdar @Tweeting_Aayush
799 Followers 6K Following Founder Founding Foundations. I tweet to learn better. Platforms are interesting I guess.
Rachel Swanson @SwansonSwansoff
662 Followers 2K Following Neuroscientish, Saxe Lab, UCL Brains | Art 🚨 I'm no longer active on Twitter. Find me on 🦋: @[email protected]
Harsh Desai @dreamerharsh
1 Followers 4K Following
Arnav Jain @arnavkj95
555 Followers 1K Following PhD student University of Montréal and @Mila_Quebec. Prev @Cohere @Microsoft, @IITKgp.
Nihal Singh @nihalssingh
529 Followers 2K Following PhD Candidate @UCSBengineering 🎓◦Translating Spin models and Neural networks to scalable probabilistic computers 💻⚛️◦@bitspilaniindia
chopwatercarry @chopwatercarry
79 Followers 763 Following to superloving superintelligence | prev CS at @ETH | looking for a research engineering job
crostata @atomic_crostata
1 Followers 1K Following
Amit Roy @AmitRoy7781
326 Followers 3K Following PhD Student @PurdueCS | Applied Scientist Intern @Amazon Finance Technology summer '25 | #LLMReasoning #NLP #DeepLearning #DataMining Researcher
laplace_demon @laplacedemon6
128 Followers 1K Following
Gokul Swamy @g_k_swamy
4K Followers 1K Following last year phd student @CMU_Robotics working on efficient algorithms for interactive learning (e.g. imitation / RL / RLHF). no model is an island. prefers email.
Shizhe Diao @shizhediao
4K Followers 2K Following Research Scientist @NVIDIA focusing on efficient post-training of LLMs. Finetuning your own LLMs with LMFlow: https://t.co/UTykmQBwFr Views are my own.
Shuozhe Li @ShuozheL
118 Followers 378 Following CS PhD student at UT-Austin. Eager to learn about the world 💔.
Abdul Ahad Shah 🇵�... @ezioshah
84 Followers 1K Following لَا اِلہَ اِلَا اللہُ مُحَمّدُ رَسُولُ اللہ SWE
Vartan Polodyan @VarPol
194 Followers 6K Following
Vashisth @vash_tiwari
247 Followers 497 Following Student Researcher @GoogleResearch| Incoming PhD @LTIatCMU / @SCSatCMU | prev @uofr @losalamosnatlab @desisurvey
handongxue @likev
5K Followers 5K Following after 80'/气象工作者/不苟同/关注天气变化/向往自由/热爱科学、互联网、编程 Node.js Web C++ Julia Python
Vaibhavi Singh @__Vaibhavi
682 Followers 417 Following @NYU_Courant @nyuniversity MS CS, Prev @Adobe @Salesforce, @cohere Community Lead, @EPFL_en scholar
jordan ezra @JordanFisherEzr
242 Followers 3K Following Research at Anthropic. Mathematician, former fed, lapsed founder. Noodling on how to make all this AI stuff go right.
Delong Chen (陈德�... @Delong0_0
280 Followers 501 Following PhD student @HKUST, Visiting researcher at Meta FAIR Paris @AIatMeta. Working on vision-language world modeling.
Robert Scoble @Scobleizer
543K Followers 24K Following The best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
Exploding Gradients @ExplodingGrads
4 Followers 136 Following Training deep nets until they blow up 💥 Gradients explode, losses skyrocket, memes incoming. ML / DL / AI chaos served fresh daily.
Jerry Robinson @JerryARobinson
4 Followers 419 Following
Juliette Decugis @DecugisJuliette
51 Followers 123 Following PhD student @meta (FAIR) + Inria/ENS Ulm. Working in codegen, RL and exploration methods :)
Yanjun Han @yanjun_han
1K Followers 210 Following Assistant Professor of math and data science @NYU_Courant and @NYUDataScience | Former PhD @stanford_ee, postdoc @SimonsInstitute @mit | views are my own
William Whistler @willwhistler
317 Followers 1K Following Researcher in computational complexity and proof assistants. Still occasionally a reverse engineer.
Nikola Jovanović @ni_jovanovic
582 Followers 508 Following PhD @eth @the_sri_lab | Trustworthy AI, Watermarking, LLM Evals | Prev. @metaai @GoogleResearch @Google @snapchat @Improbableio
Ramon Verastegui @ramonverastegui
518 Followers 507 Following CIO @ Kairos Investment Advisors. Derivatives, Volatility, Correl, Macro, Quant. Columbia Ph.D. No investment advice. Views are my own. RT not = Endorsement.
Arturs Berzins @artuursberzins
548 Followers 240 Following Postdoc in Machine Learning and Geometry at JKU Linz. Previously a PhD at SINTEF & University of Oslo, fellow of https://t.co/Atlj4V3fzw
Christopher Tuck @tuckchrisma
6 Followers 323 Following
Rean Hossain @ReanHossainK
24 Followers 18 Following Anti-war activist ☮️ | Religion is the root of all Evil 🌑 | All life matters 🌏 #WarFreeWorld #EndCruelty #NoWarInGodsName #LetsCoExist
Lucas Simões @_lsimoes
178 Followers 463 Following ML @pimloc || PhD CompNeuro/ML @GatsbyUCL || MSc Physics @usponline 🇬🇧 🇧🇷 🇻🇦 || Also https://t.co/AIPepDfVzS
Thedeeem @Thedeeem170578
1 Followers 161 Following
Julia Linhart @jujulinhart
99 Followers 66 Following Postdoctoral Researcher @NYUDataScience. AI4Science | Machine Learning | Deep Generative Models | Simulation-Based Inference | Validation & Diagnostics
Max Welling @wellingmax
39K Followers 472 Following
Sachin Goyal @goyalsachin007
1K Followers 712 Following PhD @ CMU MLD || Past intern at Meta, Google and MSR
Yanjun Han @yanjun_han
1K Followers 210 Following Assistant Professor of math and data science @NYU_Courant and @NYUDataScience | Former PhD @stanford_ee, postdoc @SimonsInstitute @mit | views are my own
Julia Linhart @jujulinhart
99 Followers 66 Following Postdoctoral Researcher @NYUDataScience. AI4Science | Machine Learning | Deep Generative Models | Simulation-Based Inference | Validation & Diagnostics
Yasaman Bahri @yasamanbb
6K Followers 947 Following Research Scientist @GoogleDeepMind // Neural learning & computation, AI, materials // Ph.D. physics @UCBerkeley.
Cansu Sancaktar @CcansuSancaktar
490 Followers 395 Following PhD Student @MPI_IS & @uni_tue | currently interning @AIatMeta | Working on getting agents to play like children with unsupervised RL 🤖
Mathurin Videau @mathuvu_
113 Followers 69 Following
Ismail Labiad @is_labiad
14 Followers 24 Following
Alessandro @alessandroleite
387 Followers 1K Following Research Scientist building theory & tools to make machine learning interpretable, more reliable & robust #MetaLearning #MachineLearning #ArtificialIntelligence
Natasha Butt @NatashaEve4
360 Followers 253 Following Machine learning PhD student @quvalab @AmlabUva | currently interning @AIatMeta | prev @MSFTResearch
Wassim (Wes) Bouaziz @_Vassim
733 Followers 2K Following AI Security PhD student @MetaAI and @Polytechnique Previously @ENS_ULM @ENS_ParisSaclay I confront equations and inequalities💡
Michal Valko @misovalko
8K Followers 8K Following Building something new · Chief Models Officer @ Stealth Startup & Inria & MVA - Ex: Llama @AIatMeta Gemini and BYOL @GoogleDeepMind
Charles Arnal @arnal_charles
98 Followers 167 Following Postdoc at @MetaAI, mathematician ENS, Cambridge, Inria, FAIR at Meta
Yunhao (Robin) Tang @robinphysics
1K Followers 735 Following Interested in RL. MTS @AnthropicAI. Prev reasoning @MistralAI, Llama RL @AIatMeta, Gemini post-training and deep RL research @Deepmind, PhD @Columbia
Stefani Karp @StefaniKarp
33 Followers 2K Following Research Scientist at Google DeepMind. Previously: RS at Google Research, PhD at CMU, SWE at Google, Princeton CS.
Sanjeev Arora @prfsanjeevarora
25K Followers 100 Following Director, @PrincetonPLI and Professor @PrincetonCS. Seeks math/conceptual understanding of deep learning and large AI models. Also on the "other" social network
Boaz Barak @boazbaraktcs
24K Followers 600 Following Computer Scientist. See also https://t.co/EXWR5k634w . @harvard @openai opinions my own.
𝙷𝚒𝚖𝚊 𝙻... @hima_lakkaraju
16K Followers 1K Following AI Professor @Harvard; Senior Staff Research Scientist @GoogleAI; @trustworthy_ml #AI #Safety #XAI; AI PhD from Stanford; Sloan/Kavli Fellow, MIT TR #35Under35
Eric J. Michaud @ericjmichaud_
3K Followers 1K Following PhD student at MIT. Trying to make deep neural networks among the best understood objects in the universe. 💻🤖🧠👽🔭🚀
Stephane Kasriel @skasriel
23K Followers 3K Following VP at Meta FAIR, Meta Fundamental AI Research. Follow us at @aiatmeta.
Eunsol Choi @eunsolc
6K Followers 914 Following on natural language processing / machine learning. assistant prof at @NYUDataScience @NYU_Courant prev @UTCompSci @googleai, @uwcse, @Cornell.
Nate Gillman @GillmanLab
784 Followers 356 Following ML researcher, interning @Google, PhD-ing @BrownUniversity. I train deep generative models
Konstantin Mishchenko @konstmish
7K Followers 658 Following Research Scientist @AIatMeta Previously Researcher @ Samsung AI Outstanding Paper Award @icmlconf 2023 Action Editor @TmlrOrg I tweet about ML papers and math
Meet Barot @mythosscience
83 Followers 245 Following Self-organizing neural nets and artificial life. PhD from @NYUdatascience
Miles Cranmer @MilesCranmer
13K Followers 983 Following Assistant Prof @Cambridge_Uni, works on AI for the physical sciences.
Pierre Chambon @PierreChambon6
822 Followers 2K Following NLP/Code Generation PhD at FAIR (Meta AI) and INRIA - previously researcher at Stanford University - MS Stanford 22’ - Centrale Paris P2020
Furong Huang @furongh
9K Followers 2K Following Associate professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, AI #Alignment, #RLHF, #Trustworthy ML, #EthicalAI, AI #Democratization, AI for ALL.
Soheil Feizi @FeiziSoheil
11K Followers 806 Following Founder & CEO at RELAI @ReliableAI, CS Prof at UMD, Presidential Award Recipient, AI/ML
Krzakala Florent @KrzakalaF
3K Followers 386 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.
Shobhita Sundaram @shobsund
1K Followers 338 Following PhD student at @MIT_CSAIL working on deep learning || interning at @AIatMeta, previously at @GoogleDeepMind
Gautam Kamath @thegautamkamath
57K Followers 568 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Joining @NYU_Courant September 2026. Co-EiC @TmlrOrg. I lead @TheSalonML.
Kamalika Chaudhuri @kamalikac
5K Followers 2K Following Director and Research Scientist, FAIR @ Meta. Former Professor at UCSD. Researcher in AI privacy, security, and generalization.
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Antonio García Mart�... @antoniogm
205K Followers 15K Following Director, @base Ads. Founder @spindl_xyz (acq. @coinbase). Wrote bestseller 'Chaos Monkeys'. "To fill the hour—that is happiness." גם זה יעבור 🇺🇸🇪🇸
Peter Holderrieth @peholderrieth
2K Followers 435 Following CS PhD student at @MIT • Generative Modeling and AI4Science • Prev: Stats/Neuro @OxfordUni• Math at @HCM_Bonn • Former: @AIatMeta
Matteo Vilucchio @MatteoVilucchio
21 Followers 42 Following
François Fleuret @francoisfleuret
46K Followers 487 Following Research Scientist @meta (FAIR), Prof. @Unige_en, co-founder @nc_shape. I like reality.
Kunhao Zheng @KunhaoZ
1K Followers 655 Following The real AGI is the friends we make along the way. PhD in FAIR CodeGen @AIatMeta. Alumni: @Huggingface, Sea AI Lab, @openai, École Polytechnique, SJTU
Ariel @redtachyon
759 Followers 202 Following p/hd | Big RL energy | 0.71 |research⟩ + 0.71 |engineer⟩ @ Meta, but never speaking on behalf of the company | Prev. lead maintainer of Gym/Gymnasium
Yaqi Duan @YaqiDuanPKU
48 Followers 119 Following Assistant Professor @NYUStern TOPS Former Postdoc @MIT LIDS PhD @Princeton @orfe
SueYeon Chung @s_y_chung
6K Followers 1K Following comp neuro, neural manifolds, neuroAI, physics of learning. assistant professor @harvardphysics @KempnerInst | proj lead @FlatironInst
Andrej Risteski @risteski_a
3K Followers 2K Following Machine learning researcher. Associate Professor, ML department at CMU (@mldcmu).
Dhrupad Bhardwaj @dhrupadbhardwaj
58 Followers 200 Following Data Wrangler, Food Junkie and staunch believer that dogs should rule the world.
André Bergholz @AndreBergholz
102 Followers 1K Following Chief Product Officer (CPO) and Co-Founder @ImplisenseTrends for United States
151 B posts
37,5 B posts
89,4 B posts
72,6 B posts
1.325 posts
3.355 posts
274 B posts
9.000 posts
3.689 posts
2.651 posts
9.820 posts
2.102 posts
1.126 posts
7.115 posts
12,9 B posts
33,8 B posts
You might like
Elon Musk
@elonmusk
226.9M Followers
Barack Obama
@BarackObama
130.0M Followers
Cristiano Ronaldo
@Cristiano
115.2M Followers
Donald J. Trump
@realDonaldTrump
109.5M Followers
Justin Bieber
@justinbieber
107.8M Followers
Rihanna
@rihanna
106.9M Followers
Taylor Swift
@taylorswift13
92.9M Followers
NASA
@NASA
88.0M Followers
Lady Gaga
@ladygaga
81.0M Followers
YouTube
@YouTube
78.4M Followers
Kim Kardashian
@KimKardashian
74.0M Followers
The Ellen Show
@EllenDeGeneres
73.2M Followers
X
@X
68.4M Followers
Virat Kohli
@imVkohli
67.8M Followers
Bill Gates
@BillGates
66.3M Followers
Selena Gomez
@selenagomez
64.5M Followers
CNN Breaking News
@cnnbrk
63.6M Followers
CNN
@CNN
63.6M Followers
Neymar Jr
@neymarjr
63.6M Followers
PMO India
@PMOIndia
59.1M Followers