-
Tweets57
-
Followers26
-
Following287
-
Likes163
The paper tackles LLM flattery and fixes it by training the model’s thinking steps, not just its final answer. Sycophancy here means the model agrees with a wrong claim or backs off a correct one. They show by optimizing the reasoning path, with uncertainty based progress…
📢 Announcing our talk for this Friday (9/26)! 📢 We are thrilled to host Dr. Alane Suhr @alsuhr from UC Berkeley! She'll be presenting her exciting work on: "Training Language-Based Agents" Join us to learn about training embodied agents that learn from human interaction. 🗓️…
This is AGI complete
@soheeyang_ @GoogleDeepMind @KassnerNora @elenagri_ @riedelcastro @dhgottesman @DanaRamati @GurYoav @IdoC0hen @RGiryes 📍2025-07-30 9:00 - 10:30 Room 1.85 @AmitElhelo will introduce MAPS, a general framework for inferring the functionality of attention heads in LLMs directly from their parameters. x.com/megamor2/statu…
@soheeyang_ @GoogleDeepMind @KassnerNora @elenagri_ @riedelcastro @dhgottesman @DanaRamati @GurYoav @IdoC0hen @RGiryes 📍2025-07-30 9:00 - 10:30 Room 1.85 @AmitElhelo will introduce MAPS, a general framework for inferring the functionality of attention heads in LLMs directly from their parameters. x.com/megamor2/statu…
Anyone knows adam?
👉 New preprint! Today, many the biggest challenges in LM post-training aren't just about correctness, but rather consistency & coherence across interactions. This paper tackles some of these issues by optimizing reasoning LMs for calibration rather than accuracy...
👉 New preprint! Today, many the biggest challenges in LM post-training aren't just about correctness, but rather consistency & coherence across interactions. This paper tackles some of these issues by optimizing reasoning LMs for calibration rather than accuracy...
✨ New paper ✨ 🚨 Scaling test-time compute can lead to inverse or flattened scaling!! We introduce SealQA, a new challenge benchmark w/ questions that trigger conflicting, ambiguous, or unhelpful web search results. Key takeaways: ➡️ Frontier LLMs struggle on Seal-0 (SealQA’s…
Are AI scientists already better than human researchers? We recruited 43 PhD students to spend 3 months executing research ideas proposed by an LLM agent vs human experts. Main finding: LLM ideas result in worse projects than human ideas.
I’m looking for a new postdoc to start this fall working on AI for Science/Science-Inspired AI (focusing on chemistry and bioengineering domains for now). Please drop me a CV if interested.
The paper claims coding benchmarks high scores of LLMs may come from memorizing past GitHub issues, not real reasoning.😯 The authors build a tiny test: given only the text of an issue, guess the file path that needs fixing. Models hit up to 76% accuracy on the benchmark set,…
LLM reasoning with reinforcement learning focuses on limited domains, hindering general applicability. This paper develops GURU, a 92,000-example multi-domain dataset, to enable broader reinforcement learning-based reasoning. Methods 🔧: - GURU includes Math, Code, Science,…
Large language models exhibit grokking, where generalization improves significantly long after training loss converges. This paper identifies grokking in large-scale LLM pretraining and provides internal metrics to monitor this delayed generalization without external validation.…
Neat work by my awesome colleagues
Neat work by my awesome colleagues
A bit late but happy to share that LLM-SRBench, our new benchmark targeting memorization issue in LLMs for scientific discovery is selected for *Oral* presentation at #ICML2025 ! Great to see the community recognizing the importance of this direction. Checkout the camera-ready…
A bit late but happy to share that LLM-SRBench, our new benchmark targeting memorization issue in LLMs for scientific discovery is selected for *Oral* presentation at #ICML2025 ! Great to see the community recognizing the importance of this direction. Checkout the camera-ready…
🚨New paper! We know models learn distinct in-context learning strategies, but *why*? Why generalize instead of memorize to lower loss? And why is generalization transient? Our work explains this & *predicts Transformer behavior throughout training* without its weights! 🧵 1/
This is really BAD news of LLM's coding skill. ☹️ The best Frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel. LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI (“International…
This study shows the same models break down on Olympiad problems and cannot even flag their own faulty proofs. Showed that frontier LLM handle fewer than 4 % of Olympiad proofs correctly and misjudge their own flawed reasoning. Current math benchmarks mark a right answer and…
❓How to balance negative and positive rewards in off-policy RL❓ In Asymmetric REINFORCE for off-Policy RL, we show that giving less weight to negative rewards is enough to stabilize off-policy RL training for LLMs! 💪 (1/8) Paper: arxiv.org/abs/2506.20520
We’re hiring @Apple! 📢 Looking for a Computer Vision / ML Engineer to join our team. Work on cutting-edge AI at scale. lnkd.in/gkE_varC Contact me if interested! #ML #ComputerVision #AppleJobs #hiring #hiringNow
Exciting new RL tooling: A modular library for RL training by the Berkeley NovaSky team. While standard RL training is all done in one loop, it is more efficient for modern post-training to separate the generation of the rollouts from the trainer. It also enables asynchronous…
Exciting new RL tooling: A modular library for RL training by the Berkeley NovaSky team. While standard RL training is all done in one loop, it is more efficient for modern post-training to separate the generation of the rollouts from the trainer. It also enables asynchronous…
Jordan @jordancook48
298 Followers 3K Following
WandererHarperMartine... @bGZ6tmJ9A0OCaj2
10 Followers 1K Following LP in the making, but first, I’m learning every day. 📚
Re-energising Your Ca... @career_re
11K Followers 6K Following Re-energising Your Career is an upbeat, accessible Career Development Hub. It's your specially designed personal Pocket Career Coach.
Yu-Min Tseng @ym_tseng
299 Followers 371 Following Ph.D. Student @VT_CS. | Prev. MS @NTU_TW. Visiting Graduate Student @UVA.
John Murzaku @jmurzaku
320 Followers 336 Following Applied Scientist @adobe, building Agent Orchestrator. Prev: PhD @stonybrooku
Asheswari Swain @Asheswari_Swain
342 Followers 928 Following
Yibin Wang @Yibin_Wang_
99 Followers 492 Following Intern @ UIUC | Prev Intern @RutgersU | B.E. @2024_HUST
Qiko @Qiko690
120 Followers 2K Following
Tenghao Huang @TenghaoHuang45
385 Followers 453 Following Ph.D. Candidate @USC ｜B.S. @UNC | Intern @microsoft @ibm @amazon | LLM Agent & Creativity 🤖 📖💡🏅
Peymànn M. Kiasari @PKiasari
29 Followers 115 Following ML researcher and engineer | currently focusing on computer vision, especially DS-CNNs
Joe Stacey @_joestacey_
2K Followers 2K Following NLP postdoc at @SheffieldNLP Ex @Imperial_NLP PhD, @Apple AI/ML Scholar, @UCL MSc Model robustness and now uncertainty quantification
Mengjie Zhao @mengjie_zhao
290 Followers 611 Following an NLP researcher @SBIntuitions @Softbank. Views my own. Previously researcher @Sony, phd @CisLmu. #nlproc
Thinh @thinhphp_vt
81 Followers 522 Following PhD student @VT_CS, supervised by @tuvllms. Interested in search-augmented LLMs. Ex AI resident @VinAI_Research
Zhefei Gong @zhefeigong
151 Followers 2K Following Robot Learning | Looking for 2026 Spring/Fall Phd Opportunities
Xinyan (Lily) Gao @LilyGao_ML
5 Followers 89 Following I'm currently an undergraduate student at the Chinese University of Hong Kong.
InsightEd Writers (Es... @InsightEwriters
248 Followers 1K Following Get expert HELP with Essay, Exam, Quiz, Online class, Discussion, Homework, Assignments, ppt, Thesis, Research Paper and more. DM +1 (520) 203-5047
Margaret Rickss @DisneyMargaret1
2K Followers 2K Following So you want to hear a couple of general and useless tweets?
Pooja Algikar @algikarpooja
151 Followers 351 Following I love philosophy, PhD in uncertainty quantification, all in for finding meaning in data and life-if there is any. postdoc @argonne
Ghazal Khalighinejad @ghazalkhn
309 Followers 428 Following CS PhD @duke_nlp, Intern @Google | Foundation Models & AI4Science | Guest Researcher @SimonsFdn @PolymathicAI prev @AdobeResearch
Ahmet Kaya @ai_ahmetkaya
235 Followers 2K Following ML @Apple · PhD in Physics (@CarnegieMellon)· Working on computer vision & vision-language models · Scaling AI in the real world
Parshin Shojaee @ParshinShojaee
3K Followers 1K Following PhD student @VT_CS | AI for Science, Math, Code, Reasoning | Intern @Apple | prev @Adobe
Plum Lab @LabPlum
23 Followers 138 Following Research lab from UC Davis(@ucdavis) specializing in #NLP, #Multimodal, and #AI4Science (particularly on #LLMs and #VLMs). Directed by Prof. @lifu_huang
JohnSnowLabs @JohnSnowLabs
45K Followers 30K Following Helping healthcare and life science organizations put AI to work faster with state-of-the-art LLM & NLP.
Etienne Gauthier @Gauthier_E_
173 Followers 237 Following PhD Student @Inria @ENS_ULM | Multi-agent decision-making, uncertainty quantification
AI Conference DL Coun... @DlCountdown
19K Followers 11 Following Bot. I daily tweet progress towards machine learning and computer vision conference deadlines. Maintained by @chriswolfvision.
Hsuan-Tien Lin @hsuantienlin
2K Followers 608 Following Professor in Dept of CSIE at National Taiwan U as well as Chief Data Science Consultant with @GoAppier
Andreas Kirsch 🇺�... @BlackHC
14K Followers 6K Following My opinions only here. 👨🔬 RS @DeepMind, @Midjourney 1y 🧑🎓 DPhil @AIMS_oxford @UniofOxford 4.5y 🧙♂️ RE DeepMind 1y 📺 SWE @Google 3y 🎓 TUM 👤 @nwspk
Maya Bechler-Speicher @mayabechlerspei
602 Followers 63 Following AI Research Scientist@Meta, CS PhD@TAU, Lecturer of "Machine Learning with Graphs"@ CS-TAU, Mathematician.
erisa @erisaonX
7K Followers 820 Following PhD candidate in Mathematics @ UTAustin. Interested in nonlocal PDEs, Deep Learning and LLMs. ✨ex intern @ AMD.
Jiao Sun @sunjiao123sun_
12K Followers 577 Following Senior RS @ GoogleDeepMind, improving Gemini Coding \n\n NLP PhD @ USC, Amazon ML Fellow \n\n ex-{Google Brain, Alexa AI} nlper, IIIS Tsinghua-Ren
brakeboosted @brakeboosted
23K Followers 501 Following
Tenghao Huang @TenghaoHuang45
385 Followers 453 Following Ph.D. Candidate @USC ｜B.S. @UNC | Intern @microsoft @ibm @amazon | LLM Agent & Creativity 🤖 📖💡🏅
Qian Huang @qhwang3
14K Followers 330 Following prev @xai | CS PhD student @StanfordAILab (on leave)
SangBin Cho @Saaaang94
3K Followers 489 Following reasoning @xAI | prev-founding engineer @anyscalecompute | senior committer of @raydistributed | committer @vllm_project Sglang | Github: rkooo567
Samaneh Saadat @smn_sdt
364 Followers 268 Following ML SWE @Google | CoreML, Keras | Opinions my own
Taiwei Shi @taiwei_shi
1K Followers 411 Following AI Researcher & Ph.D. student @nlp_usc. Intern @MSFTResearch. Formerly @GeorgiaTech @USC_ISI. NLP & Computational Social Science.
Dimitris Papailiopoul... @DimitrisPapail
20K Followers 1K Following Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
Niloofar @niloofar_mire
7K Followers 2K Following Niloofar Mireshghallah — incoming asst. prof @LTIatCMU @CMU_EPP, RS in @AIatMeta, postdoc @uwcse, Ph.D. @ucsd_cse, former @MSFTResearch -Privacy, ML, NLP
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Mengdi Wang @MengdiWang10
4K Followers 1K Following Professor @Princeton in AIML. Co-Director of #Princeton AI^2. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua. my Erdos number: 3
Matt Gallagher @MattP1Gallagher
917K Followers 440 Following Co-Founder of @MattP1Tommy. Presenter/Commentator [email protected]
P1 with Matt & Tommy @MattP1Tommy
137K Followers 19 Following Two F1 fans bringing you all the latest news, reaction, opinion and predictions from the best sport in the world! Business: [email protected]
Shakir Mohamed @shakir_za
45K Followers 1K Following ML with Social Purpose. @[email protected] | Research Scientist @DeepMind | Strengthening African ML @DeepIndaba. He/Him. South African 🇿🇦🏳️🌈🌍
Charles Sutton @RandomlyWalking
17K Followers 1K Following Research scientist @GoogleAI / Previously academic @InfAtEd / Deep learning to help people write code. / @[email protected] / ❤️s:🐱🐶☕️🍕
Tim Rocktäschel @_rockt
40K Followers 2K Following Director and Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope. Ex @AIatMeta @CompSciOxford
Richard Socher @RichardSocher
113K Followers 1K Following CEO @youdotcom MP @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
PyTorch @PyTorch
454K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Fei-Fei Li @drfeifei
527K Followers 1K Following Prof (CS @Stanford), Co-Director @StanfordHAI, Cofounder/CEO @theworldlabs, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Mustafa Suleyman @mustafasuleyman
170K Followers 486 Following CEO, Microsoft AI | Author: The Coming Wave | Past: Co-founder, @InflectionAI & @GoogleDeepMind
Neil Lawrence @lawrennd
38K Followers 9 Following Professor of machine learning at the University of Cambridge. Opinions are my own. Author of "The Atomic Human" Mainly found on @lawrennd.bsky.social
Edward Grefenstette �... @egrefen
42K Followers 868 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Yee Whye Teh @yeewhye
25K Followers 1K Following Find me @[email protected] Professor at @OxCSML, @oxfordstats and Research Director at @GoogleDeepMind. All opinions are my own.
Behnam Neyshabur @bneyshabur
30K Followers 862 Following Research @AnthropicAI (Co-lead Discovery team) 💼 Past: Gemini @GoogleDeepMind (Co-led Blueshift team) 🧠 LLM Reasoning / AI Scientist 🎒Traveling & Backpacking
Barret Zoph @barret_zoph
22K Followers 1K Following CTO & Co-Founder Thinking Machines Lab (@thinkymachines) Past: - VP Research (Post-Training) @openai - Research Scientist at Google Brain
William Fedus @LiamFedus
31K Followers 1K Following Co-Founder of @periodiclabs Past: VP of Post-Training @OpenAI; Google Brain
Jürgen Schmidhuber @SchmidhuberAI
165K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
Hugging Face @huggingface
568K Followers 210 Following The AI community building the future. https://t.co/VkRPD0Vclr
Zachary Lipton @zacharylipton
64K Followers 2K Following Cofounder & CTO: @AbridgeHQ, Professor: CMU/@acmi_lab, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷
Sebastien Bubeck @SebastienBubeck
58K Followers 1K Following I work on AI at OpenAI. Former VP AI and Distinguished Scientist at Microsoft.
Sham Kakade @ShamKakade6
16K Followers 497 Following Harvard Professor. Full stack ML and AI. Co-director of the Kempner Institute for the Study of Artificial and Natural Intelligence.
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Andrej Risteski @risteski_a
3K Followers 2K Following Machine learning researcher. Associate Professor, ML department at CMU (@mldcmu).
Hossein Mobahi @TheGradient
6K Followers 762 Following Senior Research Scientist @GoogleDeepMind. I ∈ Optimization ∩ Machine Learning. Fan of @IronMaiden🤘.Here to discuss research 🤓
Simon Shaolei Du @SimonShaoleiDu
9K Followers 2K Following Assistant Professor @uwcse. Postdoc @the_IAS. PhD in machine learning @mldcmu.
Zhuoran Yang @zhuoran_yang
2K Followers 1K Following Assistant Professor of Statistics and Data Science @Yale
Dongruo Zhou @DongruoZ
391 Followers 150 Following Assistant Professor of Computer Science, Indiana University
Lunjia Hu @LunjiaH
471 Followers 286 Following Assistant Prof @Northeastern @KhouryCollege. Prev Postdoc Fellow @Harvard @HCRCS. CS PhD @StanfordTheory, Yao Class undergrad @Tsinghua_Uni
Frances Ding @FrancesDing
274 Followers 118 Following PhD student in EECS, UC Berkeley. ML fairness and interpretability. ML for protein design.
Norman Mu @TheNormanMu
2K Followers 827 FollowingTrends for United States
You might like
