Nan Jiang @nanjiang_cs
machine learning researcher, with focus on reinforcement learning. assoc prof @ uiuc cs. Course on RL theory (w/ videos): https://t.co/vqVKwY4RJE nanjiang.cs.illinois.edu Joined November 2017-
Tweets2K
-
Followers10K
-
Following73
-
Likes13K
from @PBSSpaceTime. once I told @JohnCLangford—who wrote a general relativity(!) paper around the time I interned at MSR—abt them and their first host being a Physics PhD working then at NSF. Turns out that was his coauthor on the GR paper… such a small world!
my 2nd blogpost: a rabbit hole I went down with a (wrong) trajectory-coupling interpretation of bisimulation metrics. gets quite technical but I'm glad I set up the blog, otherwise I wouldn't know where to share this :) nanjiang.cs.illinois.edu/2025/08/25/cou…
Once I supervised a project about pollen forecasting. That was eons ago with decision trees. After a year we did not beat the baseline that consists of using the previous day's value.
Once I supervised a project about pollen forecasting. That was eons ago with decision trees. After a year we did not beat the baseline that consists of using the previous day's value.
it is really an unfortunate convention that we choose to use d for occupancy in RL (e.g., d^pi)...
Announcing the first workshop on Foundations of Language Model Reasoning (FoRLM) at NeurIPS 2025! 📝Soliciting abstracts that advance foundational understanding of reasoning in language models, from theoretical analyses to rigorous empirical studies. 📆 Deadline: Sept 3, 2025
@DimitrisPapail @code_star chain rule for KL divergence: you have a token-level loss (good for optimization) but it gives you sequence-level control over behavior
Stats twitter: for IV regression E[Z X'] θ ≈ E[Z Y] (Z,X in R^d, θ in R^d, Y scalar), if I query a new x, LLM told me uncertainty is controlled by x' E[Z X']^{-1} E[ZZ'] (E[ZX']')^{-1} x, generalizing LR case (see concentration in pic). Is this legit? Ref to concentration bound?
last year's edition was so much fun I'm really looking forward to this one!! join us in San Diego :))
last year's edition was so much fun I'm really looking forward to this one!! join us in San Diego :))
Really excited that I will be co-chairing ALT 2026 with Matus Telgarsky! The conference will be Feb 23-26, 2026 at the Fields Institute in Toronto. Website with cfp is now live---stay tuned for updates Please submit your best work and come join us!
missing ICML, and I used this week to write my first technical blog on some recent thoughts on two different roles of simulators in RL and the confusions/misconceptions around them. Comments welcome! nanjiang.cs.illinois.edu/2025/07/16/sim…
Provably Learning from Language Feedback TLDR: RL theory can help us do better inference-time exploration with feedback. Work done with @wanqiao_xu, @ruijie_zheng12, @chinganc_rl, @adityamodi94, @adith387 📰 arxiv.org/pdf/2506.10341 📍EXAIT Best Paper/Oral Sat 8:45-9:30 am
For those at ICML, Audrey will be presenting this paper at the 4:30 poster session this afternoon! West Exhibition Hall B2-B3 W-1009
For those at ICML, Audrey will be presenting this paper at the 4:30 poster session this afternoon! West Exhibition Hall B2-B3 W-1009 https://t.co/p8YMKpT8g3
I thought what disappeared was test (replaced by benchmark evals), not val. If you use the “test” split from train data (1) more than once and (2) without reporting it, then that’s just val?
I thought what disappeared was test (replaced by benchmark evals), not val. If you use the “test” split from train data (1) more than once and (2) without reporting it, then that’s just val?
this sounds more like unreal/unity…?
this sounds more like unreal/unity…?
Re prompt injection in papers: what if reviewers do their job seriously using LLM as a useful tool (given conf permission)? Aren’t we supposed to be “not afraid of LLMs” as in eg education? somehow we become extremely conservative when it comes to ourselves…?
First position paper I ever wrote. "Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence" arxiv.org/abs/2506.23908 Background: I'd like LLMs to help me do math, but statistical learning seems inadequate to make this happen. What do you all think?
HUGE congrats to @wanqiao_xu -- this paper just got the best theory paper award at ICML 2025 EXAIT (Exploration in AI) -- proposing a new provably efficient exploration algorithm 🛣️ with the right level of abstraction to leverage the strengths of LLMs 💭.
HUGE congrats to @wanqiao_xu -- this paper just got the best theory paper award at ICML 2025 EXAIT (Exploration in AI) -- proposing a new provably efficient exploration algorithm 🛣️ with the right level of abstraction to leverage the strengths of LLMs 💭. https://t.co/A5tcDrnXm6
E66: Satinder Singh: The Origin Story of RLDM @ RLDM 2025 Professor Satinder Singh of @GoogleDeepMind and @UMich is co-founder of @RLDMDublin2025. Here he narrates the origin story of the Reinforcement Learning and Decision Making meeting (not conference).
Csaba Szepesvari @CsabaSzepesvari
11K Followers 723 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
Eugene Vinitsky (@RLC... @EugeneVinitsky
20K Followers 2K Following This is the site where I talk about the attacks on science and immigration. Science is on the other site. Lab website: https://t.co/vrtbcqRyRn
Marc G. Bellemare @marcgbellemare
16K Followers 348 Following CSO & co-founder, Reliant AI. Ex RL research lead at Google Brain, DeepMind. Known for Atari 2600 RL benchmark, Distributional RL (MIT Press 2023).
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Pablo Samuel Castro @pcastr
13K Followers 829 Following Señor swesearcher @ Google DeepMind. Adjunct prof @ U de Montreal & Mila. Musician. From 🇪🇨 living in 🇨🇦.
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Shane Gu @shaneguML
41K Followers 2K Following Gemini Thinking, Senior Staff RS @GoogleDeepMind. 🇯🇵-born 🇨🇳🇨🇦. ex: Gemini Multilinguality Post-Train Lead, GPT-4 @OpenAI (JP: @shanegJP)
Behnam Neyshabur @bneyshabur
29K Followers 858 Following Research @AnthropicAI (Co-lead Discovery team) 💼 Past: Gemini @GoogleDeepMind (Co-led Blueshift team) 🧠 LLM Reasoning / AI Scientist 🎒Traveling & Backpacking
Michal Valko @misovalko
8K Followers 8K Following Building something new · Chief Models Officer @ Stealth Startup & Inria & MVA - Ex: Llama @AIatMeta Gemini and BYOL @GoogleDeepMind
Kevin Patrick Murphy @sirbayes
61K Followers 530 Following Research Scientist at Google DeepMind. Interested in Bayesian Machine Learning.
Ben Recht @beenwrekt
32K Followers 335 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Natasha Jaques @natashajaques
30K Followers 1K Following Assistant Professor @uwcse and Staff Research Scientist at @GoogleAI. Let's get off this app: https://t.co/jbH2oAjbPN
Thomas G. Dietterich @tdietterich
58K Followers 619 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. Sustainability
Yuandong Tian @tydsh
26K Followers 875 Following Research Scientist Director in Meta FAIR. Reasoning, Optimization and Understanding LLM. Novelist in spare time. PhD in @CMU_Robotics.
Sebastien Bubeck @SebastienBubeck
56K Followers 1K Following I work on AI at OpenAI. Former VP AI and Distinguished Scientist at Microsoft.
Amin Karbasi @aminkarbasi
11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.
Prof. Anima Anandkuma... @AnimaAnandkumar
34K Followers 2K Following Bren Professor @caltech, Time100, Fmr Sr Director of #AI research @nvidia Fmr Principal Scientist @awscloud
Gergely Neu @neu_rips
11K Followers 685 Following ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days! BTW you should go find me on another website where i post more actively
shreyashparajuli7@gma... @sparajuli77
5 Followers 94 Following
Yifan Zhang @yifan_zhang_
325 Followers 355 Following Ph.D. student at Princeton University, focusing on LLMs.
Scott Tyler @_SRTyler
1 Followers 245 Following
sbabouche @sbabouche
17 Followers 201 Following
lulg @lulgabc
216 Followers 6K Following
Akira @AkiraAWan1
1 Followers 30 Following
Lawrence Schultz @LawrenceSc97755
85 Followers 4K Following
TJ @latent_musings
124 Followers 2K Following
Shizhe Diao @shizhediao
4K Followers 2K Following Research Scientist @NVIDIA focusing on efficient post-training of LLMs. Finetuning your own LLMs with LMFlow: https://t.co/UTykmQBwFr Views are my own.
Shivam Khandelwal @ShivamK22606887
3 Followers 109 Following
Nikolas Papadakis @Nick17_s
2 Followers 251 Following
Rebu @RebuSystems
22 Followers 127 Following Building scalable AI to eliminate your slowest work processes
Vinayak Mane @VinayakMan55843
0 Followers 13 Following
Gabriel P. Andrade @gab_p_andrade
116 Followers 116 Following Researcher @GensynAI. Working on multi-agent RL, game theory, alg econ, and decentralized learning.
Andrew @sandreyw
36 Followers 995 Following
FEI LAN @FEILAN549587
43 Followers 654 Following
Glory @_briven
0 Followers 878 Following
Youssef Achenchabe @Yachench
2 Followers 26 Following
SN Sharma @TNSouth_80
0 Followers 29 Following
Jeevesh Juneja @xdfbhkl
4 Followers 227 Following
ONYEGBULE @onyebguleobinna
75 Followers 1K Following
Antonio Knez @antoniok1406
3K Followers 352 Following building @sentientAGI prev @princeton @pwaterpolo
Constantin Hartmann @co_hartmann
150 Followers 2K Following
Daniel Truong @DanielTruong999
15 Followers 538 Following MSc student in Intelligent Robotics, Robotics Innovatory Laboratory, Sungkyunkwan University
Md. Saleh Ibtasham @MdIbtasham
1 Followers 81 Following
Pastorale @Pastora25093166
0 Followers 30 Following
Achal @vx6Fid
10 Followers 10 Following Obsessed with Linux, systems & backend architecture | I write to structure the noise
云创兽Ai @Irjeaawworf662
0 Followers 21 Following 🌟 wealth goddess with a knack for hunting value stocks! eager for trend talks. Chat GDP growth via DM! 💸 #NYSE #Markets
Charlie Tang @tang_1c
205 Followers 610 Following AI Researcher, Quant, Founder, and Investor | Previously at D.E. Shaw, Apple Inc, PhD (deep learning) from Univ of Toronto.
Marco Da Cruz Silva @MarcoSilvaUK
45 Followers 162 Following Fitness, engineer, developer. Currently building my own Self-Evolving AI. IG: @marcosilvaz1 @saiorigin
Ganchao Wei @ganchao_wei
0 Followers 68 Following
SGY. @SGY2157
0 Followers 118 Following
Mike @Mike1711368
1 Followers 31 Following
Jeune Conscient @ali71341000
23 Followers 57 Following Psycho, kan9essi fel frach o nkewek fel kitchen.
Purvi Zaveri @PurZave
147 Followers 6K Following
Navarasa @Businesslamasia
0 Followers 177 Following
Reed Zhang @rzsquirrel
0 Followers 32 Following
Shivam Sharma @ShivamS91273664
1 Followers 64 Following
Csaba Szepesvari @CsabaSzepesvari
11K Followers 723 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
Sergey Levine @svlevine
108K Followers 133 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
Marc G. Bellemare @marcgbellemare
16K Followers 348 Following CSO & co-founder, Reliant AI. Ex RL research lead at Google Brain, DeepMind. Known for Atari 2600 RL benchmark, Distributional RL (MIT Press 2023).
Kyunghyun Cho @kchonyc
77K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
Behnam Neyshabur @bneyshabur
29K Followers 858 Following Research @AnthropicAI (Co-lead Discovery team) 💼 Past: Gemini @GoogleDeepMind (Co-led Blueshift team) 🧠 LLM Reasoning / AI Scientist 🎒Traveling & Backpacking
Michal Valko @misovalko
8K Followers 8K Following Building something new · Chief Models Officer @ Stealth Startup & Inria & MVA - Ex: Llama @AIatMeta Gemini and BYOL @GoogleDeepMind
Ben Recht @beenwrekt
32K Followers 335 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Thomas G. Dietterich @tdietterich
58K Followers 619 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. Sustainability
Gergely Neu @neu_rips
11K Followers 685 Following ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days! BTW you should go find me on another website where i post more actively
Yisong Yue @yisongyue
22K Followers 3K Following Machine Learning @Caltech (@YueLabCaltech). AI for invention at @AsariAILabs.
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Daniel Russo @DanielRuss0
1K Followers 143 Following Researcher. Prof of OR at Columbia. Tweeting about reinforcement learning.
Amir-massoud Farahman... @SoloGen
6K Followers 2K Following Goal: Understanding the computational and statistical principles required to design adaptive agents. Associate Prof @polymtl @Mila_Quebec 🇨🇦 #MahsaAmini
Sam Power @sp_monte_carlo
19K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. @OnlineMCSeminar. (he / him)
Khimya @khimya
4K Followers 975 Following Research Scientist @GoogleDeepmind Affiliate Faculty @Mila_Quebec Past: PhD @mcgillu @MSFTResearch @Intel @UF @IITKanpur Bosch @VIT_univ she/her Views are mine!
Michael Littman @mlittmancs
8K Followers 152 Following
Sasha Rakhlin @rakhlin
32 Followers 15 Following
Audrey Huang @auddery
137 Followers 81 Following
Wen Sun @WenSun1
723 Followers 76 Following Assistant professor at @cornell_tech and research scientist at @Databricks; working on Reinforcement Learning.
Joelle Pineau @jpineau1
15K Followers 442 Following Chief AI Officer, @cohere Professor of Computer Science, @mcgillu Core academic member, @Mila_Quebec Ex-Meta (FAIR team)
Ching-An Cheng @ICML2... @chinganc_rl
2K Followers 101 Following Senior Research Scientist at @Google Research, working on usable theory and algorithms for Reinforcement Learning, Generative Optimization, and Robotics
shiemannor @shiemannor
297 Followers 12 Following Prof@Technion, Researcher@Nvidia, Founder@Jether Energy. Trying to get machine learning to really work.
Yu-Xiang Wang @yuxiangw_cs
3K Followers 350 Following Faculty @hdsiucsd, director of S2ML lab. Visitor @awscloud. Prev @ucsbcs @SCSatCMU. Researcher in #machinelearning, #reinforcementlearning, #differentialprivacy
Han Zhao @hanzhao_ml
3K Followers 1K Following Assistant Professor @siebelschool; Amazon scholar; Ph.D. @mldcmu; work on trustworthy machine learning and AI.
Alessandro Lazaric @alelazaric
123 Followers 4 Following
Thejakeyboy @Thejakeyboy
772 Followers 631 Following Associate Professor at Georgia Tech Computer Science. Machine Learning researcher. Former professional juggler 🤹🏻♀️, a career I aim to return to.
Nathan Kallus @nathankallus
2K Followers 238 Following 🏳️🌈👨👨👧👦 Assoc Prof @Cornell @Cornell_Tech @Netflix @NetflixResearch causal inference, experimentation, optimization, RL, statML, econML, fairness
mtelgars @mtelgars
695 Followers 55 Following
Clément Canonne (on ... @ccanonne_
37K Followers 66 Following Senior Lecturer @Sydney_Uni. Formerly Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @ccanonne.bsky.social
Debadeepta Dey @debadeepta
2K Followers 2K Following Distinguished Researcher, DataRobot | ex MSR, CMU
Yu Bai @yubai01
6K Followers 2K Following Research @OpenAI. Trained models for GPT5 Thinking / Mini; Contributor to gpt-oss, o3-mini, o1. Previously @SFResearch, PhD @Stanford.
Shimon Whiteson @shimon8282
18K Followers 420 Following Professor of Computer Science at Oxford. Senior Staff Research Scientist at Waymo.
Yuxi Li @yuxili99
900 Followers 189 Following Decentralized RL/AI. Guest editor, MLJ SI. Co-Chair for workshops in AAAI, ICML, NeurIPS. PhD @UAlberta.
Ofir Nachum @ofirnachum
5K Followers 354 Following Research at @OpenAI. Previously at @GoogleAI on the Brain Team. Doing work on #ReinforcementLearning and #MachineLearning
Zico Kolter @zicokolter
23K Followers 680 Following Professor and Head of Machine Learning Department at @CarnegieMellon. Board member @OpenAI and @Qualcomm. Chief Technical Advisor @GraySwanAI.
RL Theory Virtual Sem... @RLtheory
5K Followers 0 Following Virtual seminar series featuring the latest advances in theoretical reinforcement learning. Seminars (approximately) every Tuesday at 6pm UTC.
TalkRL Podcast @TalkRLPodcast
3K Followers 95 Following TalkRL Podcast is All Reinforcement Learning, All the Time. Follow for interviews with brilliant folks from across the world of RL. Host @robinc. DMs open.
Michael Kearns @mkearnsupenn
6K Followers 231 Following CS prof at Penn. Amazon Scholar. Interests in ML, fairness, privacy, algorithmic game theory, algo trading. Author of "The Ethical Algorithm" (with Aaron Roth).
Ruoyu Sun @RuoyuSun_UI
1K Followers 572 Following Associate Prof at CUHK-Shenzhen. Prev: assistant prof @UofIllinois; postdoc @Stanford; visitor @AIatMeta Work on optimization of machine learning, DL, LLM.
John Langford @JohnCLangford
10K Followers 43 Following Solving Machine Learning at Microsoft in New York. https://t.co/ZpdQV4IsHY pandemic past president. https://t.co/MkluiHpWF7 makes RL real. https://t.co/wK8xQaQGwf for thinking out loud.
Zhaoran Wang @zhaoran_wang
4K Followers 1K Following Associate Professor @NorthwesternU | PhD @Princeton | studying Reinforcement Learning
Bo Dai @daibond_alpha
3K Followers 793 Following Assistant Professor at @gtcse, Research Scientist at @GoogleDeepMind | ex @googlebrain
Yao Liu @yaoliucs
315 Followers 199 Following Research Scientist at AWS AI. Opinions are my own. Previously @AIforHI @StanfordAILab
Kianté Brantley @xkianteb
2K Followers 1K Following Assistant Professor at Harvard | Fitness enthusiast | (He/Him/His)
Sham Kakade @ShamKakade6
16K Followers 495 Following Harvard Professor. Full stack ML and AI. Co-director of the Kempner Institute for the Study of Artificial and Natural Intelligence.
Rose Yu @yuqirose
9K Followers 575 Following Machine Learning Prof @UCSanDiego, Scholar @amazon, Previously @google, @Northeastern, @Caltech, @USC, #Physics-Guided #AI, MIT TR-35 Innovator.
Yuxin Chen @yuxinch
1K Followers 423 Following Machine Learning Researcher, Assistant Professor at @UChicagoCS
Jan Peters @Jan_R_Peters
5K Followers 416 Following #RobotLearning Professor (#MachineLearning #Robotics) at @ias_tudarmstadt of @TUDarmstadt (Part of @ELLISforEurope, @Hessian_AI and @DFKI)
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Lihong Li @LihongLi20
3K Followers 382 Following AI researcher in large language models, reinforcement learning & contextual bandits.
Andrej Risteski @risteski_a
3K Followers 2K Following Machine learning researcher. Associate Professor, ML department at CMU (@mldcmu).
Matt O'Dowd @matt_of_earth
12K Followers 66 Following Earthling, astrophysicist, professor at @LehmanCollege, Physics DEO at @GC_CUNY, associate at @AMNH, host & writer of @PBSSpaceTime, free to a good home
PBS SpaceTime @PBSSpaceTime
28K Followers 2K Following A PBS show about the universe! Written and hosted by astrophysicist Matt O'Dowd @matt_of_earthTrends for United States
You might like
