Kaj Bostrom @alephic2
NLP geek with a PhD from @utcompsci, now @ AWS. I like generative modeling but not in an evil way I promise. Also at https://t.co/qxYqjaWU5W He/him bostromk.net New York, NY Joined December 2018-
Tweets105
-
Followers359
-
Following436
-
Likes1K
For inputs involving many steps, the operands for each step remain important until an identical depth. This indicates that the model is *not* breaking down the computation, solving subproblems, and composing their results together. 2/6
Definitely updated my mental model of CoT based on these results - give it a read, the paper delivers right off the bat and then keeps following up with more!
Definitely updated my mental model of CoT based on these results - give it a read, the paper delivers right off the bat and then keeps following up with more!
🍓 still has a way to go for solving murder mysteries. We ran o1 on our dataset MuSR (ICLR ’24). It doesn’t beat Claude-3.5 Sonnet with CoT. MuSR requires a lot of commonsense reasoning and less math/logic (where 🍓 shines) MuSR is still a challenge! More to come soon 😎
Super excited to bring ChatGPT Murder Mysteries to #ICLR2024 from our dataset MuSR as a spotlight presentation! A big shout-out goes to my coauthors, @xiye_nlp @alephic2 @swarat and @gregd_nlp See you all there 😀
Super excited to bring ChatGPT Murder Mysteries to #ICLR2024 from our dataset MuSR as a spotlight presentation! A big shout-out goes to my coauthors, @xiye_nlp @alephic2 @swarat and @gregd_nlp See you all there 😀
After extensive training with various music generation neural networks and dedicating countless hours to prompting them, it's become even more evident to me that relying solely on text prompts as interface for music creation significantly limits the creative process.
After extensive training with various music generation neural networks and dedicating countless hours to prompting them, it's become even more evident to me that relying solely on text prompts as interface for music creation significantly limits the creative process.
GPT-4 can write murder mysteries that it can’t solve. 🕵️ We use GPT-4 to build a dataset, MuSR, to test the limits of LLMs’ textual reasoning abilities (commonsense, ToM, & more) 📃 arxiv.org/abs/2310.16049 🌐 zayne-sprague.github.io/MuSR/ w/ @xiye_nlp @alephic2 @swarat @gregd_nlp
While demand for generative model training soars 📈, I think a new field is coalescing that’s focused on trying to make sense of generative models _once they’re already trained_: characterizing their behaviors, differences, and underlying mechanisms…so we wrote a paper about it!
LLMs are used for reasoning tasks in NL but lack explicit planning abilities. In arxiv.org/abs/2307.02472, we see if vector spaces can enable planning by choosing statements to combine to reach a conclusion. Joint w/ @alephic2 @swarat & @gregd_nlp NLRSE workshop at #ACL2023NLP
📣Call for papers! The Natural Language Reasoning and Structured Explanations Workshop will be the first of its kind at ACL 2023, and the deadline for paper submissions is April 24. Learn more and submit here: nl-reasoning-workshop.github.io
Three years in the making - our big review/position piece on the capabilities of large language models (LLMs) from the cognitive science perspective. Thread below! 1/ arxiv.org/abs/2301.06627

Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Ana Marasović @anmarasovic
5K Followers 597 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷
Greg Durrett @gregd_nlp
8K Followers 892 Following Associate professor at NYU (Courant CS + Center for Data Science) | advisor for @bespokelabsai | large language models and NLP | he/him
Sam Bowman @sleepinyourhat
50K Followers 3K Following AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Jessy Li @jessyjli
4K Followers 998 Following Associate Professor @UT_Linguistics, computational linguistics and #NLProc
Eunsol Choi @eunsolc
6K Followers 914 Following on natural language processing / machine learning. assistant prof at @NYUDataScience @NYU_Courant prev @UTCompSci @googleai, @uwcse, @Cornell.
Tim Dettmers @Tim_Dettmers
39K Followers 994 Following Creator of bitsandbytes.Research Scientist @allen_ai and incoming professor @CarnegieMellon. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Xi Ye @xiye_nlp
3K Followers 399 Following I study NLP. Postdoc fellow @PrincetonPLI. Incoming assistant professor @UAlberta (Summer 2025). CS PhD @UTAustin.
Ofir Press @OfirPress
15K Followers 7K Following I build tough benchmarks for LMs and then I get the LMs to solve them. SWE-bench & SWE-agent. Postdoc @Princeton. PhD @nlpnoah @UW.
Nathan Schneider @complingy
5K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.social
Leo Boytsov @srchvrs
9K Followers 2K Following Machine learning scientist and engineer speaking πtorch & C++. Past @LTIatCMU, @awscloud. Opinions sampled from MY OWN 100T param LM.
Sarah Wiegreffe @sarahwiegreffe
5K Followers 1K Following Research in NLP (mostly LM interpretability & explainability). Assistant prof @umdcs @clipumd Formerly @allen_ai @uwnlp @icatgt @gtcomputing Views my own.
Niloofar @niloofar_mire
7K Followers 2K Following Niloofar Mireshghallah — incoming asst. prof @LTIatCMU @CMU_EPP, RS in @AIatMeta, postdoc @uwcse, Ph.D. @ucsd_cse, former @MSFTResearch -Privacy, ML, NLP
cael 🦀 @calenquest
2K Followers 912 Following creative director & writer @aggrocrabgames. Any pronouns
Brendan Dolan-Gavitt @moyix
30K Followers 6K Following Building offsec agents: https://t.co/G9EtnC2Gl3 PGP https://t.co/3WXr0RfRkv
Partha Pratim Saha @partha_wish
186 Followers 5K Following Udacity Bertelsmann Scholar, Masters (with Distinction), Looking for PhD in Natural Language Processing, Deep Learning, NeuroMatch Deep Learning scholar
SeanRoboticsAILLMVLM @SeanRoboticsAI
35 Followers 3K Following
Marc Marone @ruyimarone
807 Followers 717 Following Token Enthusiast/Research Intern @meta 🦙 & PhD @jhu, prev @databricks MosaicML @microsoft, @mstranslator, @GeorgiaTech
Muhammad Aamir Gulzar @m_aamir_gulzar
17 Followers 342 Following Student | Tech Innovator | AI & Data Enthusiast
Alexander Naumenko @AlexanderNaume2
1K Followers 6K Following I Solve Intelligence | Book Multidimensional Intelligence https://t.co/PJiAS8iMWx
Shoadue @shoadue90025
27 Followers 2K Following People who want to keep their love, please keep % of yourself
RockyParadox @RockyParadox44
128 Followers 7K Following
Avinash @avilearning
1 Followers 6K Following
Peter Hase @peterbhase
3K Followers 1K Following Visiting Scientist at Schmidt Sciences. Visiting Researcher at the Stanford NLP Group Previously: Anthropic, AI2, Google, Meta, UNC Chapel Hill
Zhongzhi Li @ZhongzhiLi4
114 Followers 529 Following Ph.D Student of Computer Science @MSFTResearch, Red Inc. Research Intern,Visiting Student of HKUST,in LARK Lab
Nayoung Lee @nayoung_nylee
220 Followers 336 Following ECE Ph.D. Candidate @UWMadison Soon to be on the job market https://t.co/21MsvK4XhF
HessianFree @HessianFree
2K Followers 2K Following something new. prev: @AIatMeta, @Caltech, @UCLA @NASAJPL PSGD PhD
Dongwei Jiang @Dongwei__Jiang
523 Followers 803 Following Currently working on LLM reasoning, agents and self-improvement. Six years of prior industrial research experience in speech processing and NLP
Aryo Lotfi @aryolotfi
61 Followers 207 Following PhD @ EPFL | ML researcher focusing on reasoning | ex-Apple intern
Evans Kate Skyla @Evanskateskyla
83 Followers 1K Following Don't change yourself so that other people will like you. Be yourself so that the right people will love you 😘
Sotio @SotioM6BOT4
12 Followers 311 Following
Dionysis Manousakas @neuralvertigo
314 Followers 4K Following Applied scientist @AWS AI/ML. Ex @Meta|@Cambridge_Uni|@ucl|@ecentua 🇬🇷. No cats.
Emily Ballinger @HildegardS63468
7 Followers 677 Following Top traders reveal their secrets to huge profits in stocks and cryptocurrencies!! Join Group:https://t.co/OCXhYTXKxU
JaanV @its_jaanV
23 Followers 376 Following 🌱 Lifelong learner | Exploring ML & AI 🤖 | Building my first startup 🚀 | From learning to creating, one step at a time!
Ark.Zhang @MonteCristo_ARK
136 Followers 840 Following 🚀 Founder of iSpiral Inc 📍Bay Area, USA🇺🇸 🏃Running AI Startup
Jenn Mensink @JennMensink
707 Followers 4K Following UXR with a passion for LXD seeking opportunities to commiserate, parlay, and noodle with other innovators who believe tech is for everyone.
Jared Moore @jaredlcm
222 Followers 301 Following @jaredlcm.bsky.social AI Researcher, Writer Stanford
Oliver Li @oliveraochongli
258 Followers 1K Following phd in language models at @Cornell_CS; prev @columbianlp
Pratyay Banerjee (ন... @Neilzblaze007
301 Followers 7K Following I live in the shadows, but I watch everything.
Xinting Huang @timhuangxt
142 Followers 347 Following Senior Researcher @TencentGlobal, working on LLMs. Ph.D. at @UniMelb; Ex @BytedanceTalk, @MSFTResearch
Hanqi Xiao @hanqi_xiao
98 Followers 528 Following UG Research Assistant at MURGe-Lab w/ @mohitban47, undergrad at @unccs. Interested in LLM Compression, interpretability, and embedded applications
CompJJ @completejjj
0 Followers 63 Following
Mina Huh @mina1004h
1K Followers 837 Following Ph.D. student @UTCompSci | Google Ph.D. Fellow | Research Scientist Intern @AdobeResearch | GenAI for Creativity & Accessibility
Yağız. @yagizdemir
218 Followers 1K Following CogSci MA Student @UniBogazici, interested in common sense reasoning in LLMs #NLProc
Fatima Jahara @FatimaJahara1
191 Followers 926 Following CS PhD student @RutgersCS| NLP, Responsible AI, LLM Reasoning | Senior Assessment Developer @workera_ | Predoctoral Fellow 2023 @fatimafellowshp
Rosa (Eun-Kyoung) Lee @ekrosalee
51 Followers 75 Following PhD Candidate in Linguistics at University of Maryland, College Park. Research focus on sentence processing using experimental and computational approaches.
Sathvik @sathvikn4
838 Followers 1K Following computational psycholinguistics @ umd, nsf grfp fellow | he/him | fmr: cognitive & computer science @ uc berkeley | also on bluesky (sathvik@)
Csordás Róbert @robert_csordas
1K Followers 460 Following Research scientist @OpenAI. Ex postdoc at Stanford working on systematic generalization and algorithmic reasoning. Ex IDSIA PhD, Ex @DeepMind intern.
Guneet Singh Kohli @guneetsk99
866 Followers 4K Following PhD in LLM reasoning and evaluations at QMUL, ex AI Engineer @ GreyOrange, Building Indian LLM
Sourav Saha @souravs1987
60 Followers 2K Following
Ji Porter @PorterJi37110
52 Followers 951 Following Software Engineer at @awscloud , AWS Aurora Serverless V2, AWS Zero-ETL, Agentic memory database
Ben Lipkin @ben_lipkin
678 Followers 1K Following phd @mit. research @genlm. prev: intern @apple. language, programs, probability.
Allen Nie (🇺🇦�... @allenainie
2K Followers 2K Following Stanford CS PhD working on RL. Co-creator of Trace. Advised by Emma Brunskill and Chris Piech. Previously: @GoogleDeepMind @MSFTResearch
Kate Sanders @kesnet50
305 Followers 355 Following Final year Ph.D. candidate in NLP, CV @jhuclsp. Researching transparent reasoning, multimodality, and fact verification.
Joe Stacey @_joestacey_
2K Followers 2K Following NLP postdoc at @SheffieldNLP Ex @Imperial_NLP PhD, @Apple AI/ML Scholar, @UCL MSc Model robustness and now uncertainty quantification
Gautham Krishna Gudur @gauthamkrishna_
599 Followers 5K Following Ph.D. student @UTAustin and @wncg_UT. Prev. @BellLabs @ericsson. Mostly into efficient/human-centered AI/ML + multimodal sensing. Always GPU poor.
(((ل()(ل() 'yoav)))... @yoavgo
66K Followers 2K Following
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Ana Marasović @anmarasovic
5K Followers 597 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷
Greg Durrett @gregd_nlp
8K Followers 892 Following Associate professor at NYU (Courant CS + Center for Data Science) | advisor for @bespokelabsai | large language models and NLP | he/him
Akari Asai @AkariAsai
19K Followers 870 Following Incoming Assistant Professor @SCSatCMU & research scientist @allen_ai. akariasai @ 🦋
Sam Bowman @sleepinyourhat
50K Followers 3K Following AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Jacob Andreas @jacobandreas
20K Followers 951 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Graham Neubig @gneubig
40K Followers 710 Following Associate professor @LTIatCMU. Co-founder/chief scientist @allhands_ai. I mostly work on modeling language.
Jessy Li @jessyjli
4K Followers 998 Following Associate Professor @UT_Linguistics, computational linguistics and #NLProc
Eunsol Choi @eunsolc
6K Followers 914 Following on natural language processing / machine learning. assistant prof at @NYUDataScience @NYU_Courant prev @UTCompSci @googleai, @uwcse, @Cornell.
Naomi Saphra @nsaphra
10K Followers 1K Following Waiting on a robot body. All opinions are universal and held by both employers and family. Now a dedicated grok hate account. Accepting ML/NLP PhD students.
Talia Ringer 💚 @TaliaRinger
29K Followers 7K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, justice. Mom. They/היא, ND, bi
Tim Dettmers @Tim_Dettmers
39K Followers 994 Following Creator of bitsandbytes.Research Scientist @allen_ai and incoming professor @CarnegieMellon. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Sewon Min @sewon__min
14K Followers 819 Following Assistant professor @Berkeley_EECS @berkeley_ai || Research scientist at @allen_ai || PhD from @uwcse @uwnlp
Percy Liang @percyliang
85K Followers 420 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Xi Ye @xiye_nlp
3K Followers 399 Following I study NLP. Postdoc fellow @PrincetonPLI. Incoming assistant professor @UAlberta (Summer 2025). CS PhD @UTAustin.
@emilymbender.bsky.so... @emilymbender
57K Followers 2K Following Prof, Linguistics, UW // Faculty Director, CLMS // she/her // @[email protected] & bsky // rep by @ianbonaparte
Alex Mordvintsev @zzznah
18K Followers 2K Following Mad Scientist, DeepDream creator. Designing Self-Organising Systems and Programmable Artificial Life. https://t.co/rntipHzHW3
Marc Marone @ruyimarone
807 Followers 717 Following Token Enthusiast/Research Intern @meta 🦙 & PhD @jhu, prev @databricks MosaicML @microsoft, @mstranslator, @GeorgiaTech
Joseph Suarez 🐡 @jsuarez5341
17K Followers 104 Following I build sane open-source RL tools. MIT PhD, creator of Neural MMO and founder of PufferAI. DM for business: non-LLM sim engineering, RL R&D, infra & support.
Konpat Ta Preechakul @konpatp
555 Followers 227 Following Learning abstraction from pixels. PhD student at @berkeley_ai. I'm from Bangkok, Thailand 🐘.
Zhengyang Geng @ZhengyangGeng
1K Followers 651 Following PhD student @SCSatCMU with @zicokolter / curiosity&love / dynamics to super intelligence
Davis Blalock @davisblalock
15K Followers 168 Following Research scientist @GoogleDeepMind. Past: @Databricks, first hire @MosaicML, @MIT PhD. I post about AI technical progress + sometimes the business side.
Teortaxes▶️ (Deep... @teortaxesTex
45K Followers 3K Following We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization. @deepseek_ai stan #1, 2023–Deep Time «C’est la guerre.» ®1
Steven Strogatz @stevenstrogatz
164K Followers 3K Following Mathematician, writer, Cornell professor. All cards on the table, face up, all the time.
Charles Goddard @chargoddard
1K Followers 282 Following Chief of Frontier Research @arcee_ai MergeKit author Github: https://t.co/Hkx6IaA0qx
neural oscillator of ... @mycoliza
21K Followers 1K Following wow, everything’s computer at @oxidecomputer
Nayoung Lee @nayoung_nylee
220 Followers 336 Following ECE Ph.D. Candidate @UWMadison Soon to be on the job market https://t.co/21MsvK4XhF
HessianFree @HessianFree
2K Followers 2K Following something new. prev: @AIatMeta, @Caltech, @UCLA @NASAJPL PSGD PhD
Evan Walters @evaninwords
635 Followers 519 Following ML/RL enthusiast, second-order optimization, plasticity, environmentalist. JAX is easy. @LeonardoAi_ / @canva prev 🖍 @craiyonAI
Yaroslav Bulatov @yaroslavvb
8K Followers 929 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Dilip Arumugam @Dilip_Arumugam
709 Followers 819 Following @PrincetonCS postdoc w/ Tom Griffiths @cocosci_lab |@StanfordAILab PhD w/ Benjamin Van Roy |@BrownCSDept BS+MS w/ Michael Littman @mlittmancs | RL & Info Theory
EIR @endsinrambles
950 Followers 549 Following
Marco Pasini @marco_ppasini
856 Followers 77 Following Generative AI + Audio and Music. Student Researcher @GoogleDeepMind. PhD with @CDT_AI_Music and @SonyCSLMusic.
Dongwei Jiang @Dongwei__Jiang
523 Followers 803 Following Currently working on LLM reasoning, agents and self-improvement. Six years of prior industrial research experience in speech processing and NLP
Haibin (on leave) @eric_haibin_lin
2K Followers 977 Following On the path to AGIs. Bytedance Seed LLM Systems, @verl_project, Megascale. Prev. @AmazonScience @ApacheMXNet
Durk Kingma @dpkingma
50K Followers 404 Following @AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
Zichen Wang @ZichenWangPhD
265 Followers 443 Following ML Scientist @awscloud. #MachineLearning, Healthcare, Biology. Formerly PhD & research faculty @IcahnMountSinai. Views are my own.
Dionysis Manousakas @neuralvertigo
314 Followers 4K Following Applied scientist @AWS AI/ML. Ex @Meta|@Cambridge_Uni|@ucl|@ecentua 🇬🇷. No cats.
Jeremy Bernstein @jxbz
7K Followers 614 Following 🧪 @thinkymachines ✍️ anon feedback @ https://t.co/RIhBhjMRdD
Emmett Shear @eshear
119K Followers 971 Following CEO of Softmax: Applied developmental cybernetics research
Nat McAleese @__nmca__
15K Followers 358 Following Research @AnthropicAI. Previously @OpenAI, @DeepMind. Views my own.
Jared Moore @jaredlcm
222 Followers 301 Following @jaredlcm.bsky.social AI Researcher, Writer Stanford
Mike A. Merrill @Mike_A_Merrill
659 Followers 306 Following Postdoc @StanfordAILab Building https://t.co/KWJvsMlWva with @alexgshaw and many others Go Bills
Felix Hill @FelixHill84
12K Followers 742 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else's
Aryo Lotfi @aryolotfi
61 Followers 207 Following PhD @ EPFL | ML researcher focusing on reasoning | ex-Apple intern
Seijin Kobayashi @SeijinKobayashi
202 Followers 153 Following Research Scientist at Google | ETH Zurich | École Polytechnique
Andrew Lampinen @AndrewLampinen
9K Followers 2K Following Interested in cognition and artificial intelligence. Research Scientist @DeepMind. Previously cognitive science @StanfordPsych. Tweets are mine.
Mina Huh @mina1004h
1K Followers 837 Following Ph.D. student @UTCompSci | Google Ph.D. Fellow | Research Scientist Intern @AdobeResearch | GenAI for Creativity & Accessibility
Yağız. @yagizdemir
218 Followers 1K Following CogSci MA Student @UniBogazici, interested in common sense reasoning in LLMs #NLProc
Noam Brown @polynoamial
92K Followers 856 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus superhuman poker AIs, CICERO Diplomacy AI, and OpenAI o3 / o1 / 🍓 reasoning models
Logan Kilpatrick @OfficialLoganK
215K Followers 3K Following Lead product for @GoogleAIStudio + the Gemini API. My views!
Joselyn Rodriguez @jrodri___
83 Followers 414 Following Ph.D. student at UMD | cognitive modeling & second language acquisition | she/her |@umdnacs
Rosa (Eun-Kyoung) Lee @ekrosalee
51 Followers 75 Following PhD Candidate in Linguistics at University of Maryland, College Park. Research focus on sentence processing using experimental and computational approaches.
Sathvik @sathvikn4
838 Followers 1K Following computational psycholinguistics @ umd, nsf grfp fellow | he/him | fmr: cognitive & computer science @ uc berkeley | also on bluesky (sathvik@)
David Samuel @davidsamuelcz
575 Followers 127 Following PhD student at University of Oslo, Language Technology Group. Interested in small and efficient language models.
Jason Weston @jaseweston
13K Followers 723 Following @Meta+NYU. NLP from scratch(Pretrain+FT LLM) 2008,MemNet (pre-Transformer) 2015, DrQA(pre-RAG) 2017, BlenderBot(dialog pre-ChatGPT) 2018+, Self-Rewarding+more!
LaurieWired @lauriewired
105K Followers 284 Following researcher @google; serial complexity unpacker; https://t.co/Vl1seeNgYK ex @ msft & aerospace
Scott H. Hawley @drscotthawley
3K Followers 1K Following Professor of Physics & Senior Data Fellow @BelmontUniv, teaching Audio Engineers. Head of Research @Hyperstate_AI. Mostly: ML for music producers.