Zeyuan Allen-Zhu @ZeyuanAllenZhu
physics of language models @ Meta / FAIR IOI - USACO - MCM - ACM/ICPC - Codejam Tsinghua - MIT - Princeton/IAS - MSR - FAIR zeyuan.allen-zhu.com Joined April 2010-
Tweets206
-
Followers8K
-
Following273
-
Likes245
可愛らしい絵。 Eugeo Zuberg はパート 3.2 でも見つかります。 はアリス・ユージオ・ズバーグを使おうと思っていたが、アリスはアーニャに近すぎる。 正直に言うと、『LMの物理学』に決める前は『Alicization』というシリーズタイトルを考えていました
可愛らしい絵。 Eugeo Zuberg はパート 3.2 でも見つかります。 はアリス・ユージオ・ズバーグを使おうと思っていたが、アリスはアーニャに近すぎる。 正直に言うと、『LMの物理学』に決める前は『Alicization』というシリーズタイトルを考えていました
1
14
54
19K
39
Download Image
I shouldn't say common crawls are "junks". Thanks to Common Crawls CTO for correcting me. What we meant is, lots of knowledge from CC (e.g. serial number of a random product) may not be useful. We synthetically generate data to mimic such knowledge, and we refer to that as junk.
I shouldn't say common crawls are "junks". Thanks to Common Crawls CTO for correcting me. What we meant is, lots of knowledge from CC (e.g. serial number of a random product) may not be useful. We synthetically generate data to mimic such knowledge, and we refer to that as junk. https://t.co/t18gs8n2TX
Incredibly honored to have worked with Avi as his postdoc. Avi's vision is certainly beyond the theory of computation. He asked me in 2016 whether I believe gradient descent can solve everything. He has probably envisioned AGI at that point. 👍
Incredibly honored to have worked with Avi as his postdoc. Avi's vision is certainly beyond the theory of computation. He asked me in 2016 whether I believe gradient descent can solve everything. He has probably envisioned AGI at that point. 👍
Another example of how simple things work
Another example of how simple things work
Did anyone notice: if paper title has period (or perhaps colon) in it, I will lose many citations. For instance @QuanquanGu 's Rephrase paper cites Part 3.2 but it isn't on Google Scholar. scholar.google.com/scholar?oi=bib… Should I use Part 3A, 3B, 3C instead? Who else cited our work?
Amazing team to work with!
Zeyuan Allen-Zhu retweeted
Our team in FAIR labs (at Meta) is hiring researchers (RE, RS & PostDoc)! DM if interested. We work on the topics of Reasoning, Alignment and Memory/architectures (RAM). Recent work: Self-Rewarding LMs: arxiv.org/abs/2401.10020 Pairwise Cringe Loss: arxiv.org/abs/2312.16682…
Truly heartbroken to see that nowadays we have to explicitly, reiterate that calling for genocide (against any group) is a violence and should be prohibited.
Truly heartbroken to see that nowadays we have to explicitly, reiterate that calling for genocide (against any group) is a violence and should be prohibited.
Huge thanks to my coauthors and especially the first author @CathyYLi who is just amazing at handling this huge project. Before this, I thought my coauthors were just being crazy... I was wrong, LLMs (+ human designs) can break some Crypto systems.
Huge thanks to my coauthors and especially the first author @CathyYLi who is just amazing at handling this huge project. Before this, I thought my coauthors were just being crazy... I was wrong, LLMs (+ human designs) can break some Crypto systems.
Many starts to talk about "reread my request and try again". For knowledge questions, we made it clear why "try again" works. Knowledge is first loaded; and in the repeated run, model sees it and can manipulate knowledge in context. Examples in the figs such as "Tell me why."
Many starts to talk about "reread my request and try again". For knowledge questions, we made it clear why "try again" works. Knowledge is first loaded; and in the repeated run, model sees it and can manipulate knowledge in context. Examples in the figs such as "Tell me why."
Clément Canonne @ccanonne_
31K Followers 925 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]
Gautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.
Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.
Amin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.
Jason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning
Peter Richtarik @peter_richtarik
6K Followers 591 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦
Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpacking
Csaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6
Dimitris Papailiopoul.. @DimitrisPapail
11K Followers 957 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez Lily
Yuandong Tian @tydsh
16K Followers 795 Following Research Scientist and Senior Manager in Meta AI (FAIR). AI-guided Optimization and Representation Learning. Novelist in spare time. PhD in @CMU_Robotics.
Alex Dimakis @AlexGDimakis
13K Followers 2K Following UT Austin Professor. Researcher in Machine Learning and Information Theory. National AI Institute on the Foundations of Machine Learning (IFML) Co-director.
Sam Power @sp_monte_carlo
16K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)
Aaron Roth @Aaroth
10K Followers 639 Following CS professor at Penn. Amazon Scholar at AWS. Author of The Ethical Algorithm (w/ Michael Kearns). I study machine learning, privacy, game theory, and fairness.
Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.
Tengyu Ma @tengyuma
25K Followers 510 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Pravesh K. Kothari @praveshkkothari
3K Followers 293 Following Assistant Professor @PrincetonCS, @the_ias Research: Theoretical Computer Science, Optimization, Algorithmic Statistics.
Yiping Lu @2prime_PKU
3K Followers 2K Following Kernel, ML for PDE, Robust learning,non-parametric stats/🌈/PKU👉Stanford👉NYU Courant👉Northwestern IEMS/ Previous Intern @RIKEN_AIP
Michal Valko @misovalko
5K Followers 2K Following Llama @AIatMeta Paris & Inria & MVA - Ex: Gemini and BYOL @GoogleDeepMind
Hanzhe Hu @hanzhe_hu
129 Followers 301 Following PhD student at RI @SCSatCMU, previously cs major @PKU1898, working on 3d reconstruction
Klee @xiaonando
1 Followers 22 Following
全球外围|伦敦|�.. @CarneyMadd16610
0 Followers 15 Following 💕为什么Y炮老是被套路💕因为我们来晚了💕 ✨对不起✨各位绅士！ 承诺✨见人付款✨秒杀套路✨海选资源 飞机频道💕进入关注：https://t.co/t9g1cWpjj7 飞机客服💕马上安排：https://t.co/EaeDOss2iC
Dah Gwan @dah_gwan
0 Followers 38 Following
Jason Lopatecki @jason_lopatecki
366 Followers 303 Following Founder/CEO @arizeai, entrepreneur, 2x founder, passion for ML & building companies - Berkeley EECS
Horizon Events @HorizonEvents9
6 Followers 269 Following Events consultancy dedicated to advancing R&D in AI safety
frank lu @jt120lz
26 Followers 81 Following
Sam Passaglia @SamPassaglia
309 Followers 855 Following Working on Japanese LLMs @ELYZA_inc Prev. PhD @UChicagoAstro 🇺🇸🇯🇵🇫🇷
Tatsuya Shirakawa @s_tat1204
1K Followers 785 Following Human / 合同会社nouu代表 機械学習や数理最適化、データサイエンスの周辺領域に生息しています。 アドバイザリーや技術支援もしています。 お仕事の依頼/ご相談はお気軽にどうぞ。
Baiji He @hebaiji
107 Followers 481 Following
Yash Malik @_yash_malik_
16 Followers 357 Following
Jindong Gu @Jindong73504766
143 Followers 540 Following Senior Research Fellow in University of Oxford Faculty Researcher @Google Homepage: https://t.co/YOSVO3jb6h
Himanshu Chaudhary @hcpv10
0 Followers 46 Following
Shichang Zhang @ShichangZhang
211 Followers 215 Following Computer Science PhD @UCLA working on #GraphNeuralNetworks. Research intern @AWS @Snap
BS @BS3519241223690
43 Followers 50 Following
Jerome Ku @KuJerome
91 Followers 5K Following
Ganxiang Yang @P4leWa1ker
94 Followers 311 Following Incoming CS Ph.D. @Columbia | Senior Undergraduate @sjtu1896 | ACM Honors Class | system
qingsong @qingsong6
43 Followers 857 Following
Xiao Hu @xiaohupan10
0 Followers 14 Following
baba yaga’s chicken.. @SeesEmily
1K Followers 5K Following None of it matters. All of it matters. Servant/Leader. Oracle. Cartographer. Proudly neurodivergent. Views=mine. Bridging the gap since 19xx. 💗🔥🌊🍍🇺🇦🐕🇺🇸
Owain Evans @OwainEvans_UK
7K Followers 241 Following Research Associate @fhioxford, Oxford University. AI alignment. Prefer email to DM.
Edmar Miyake @emiyake
38 Followers 421 Following
Chenguang Xi @7cloudXiXi
22 Followers 23 Following
Name @quantinvers
0 Followers 377 Following
Marian Gottlieb @_mariangot
62 Followers 1K Following
yuntian gu @yuntian_gu
9 Followers 7 Following
Shulin Tian @shulin_tian
9 Followers 82 Following
Ellis Brown @_ellisbrown
368 Followers 936 Following CS PhD Student @NYU_Courant | Prev: @CarnegieMellon, https://t.co/EkTzprGc4i, @VanderbiltU
Xiangming Gu @gu_xiangming
19 Followers 90 Following Ph.D. candidate from Computer Science, @NUSingapore. BE in Electronic Engineering and BS in Finance from @Tsinghua_Uni.
allenisnothere @WANGTONG58
0 Followers 17 Following
jingming zhuo @JingmingZh69871
29 Followers 72 Following
Freund @sindfreund
42 Followers 181 Following
Adarsh Kumar @adarshkr_
75 Followers 904 Following Building Something New | Founding Member @ Dashworks, Alexa AI, Bing @Microsoft, Microsoft Research UW-Madison, IIT Guwahati
Luke Liu @LukeXuanLiu
88 Followers 73 Following
Clément Canonne @ccanonne_
31K Followers 925 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]
Gautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.
Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Jelani Nelson @minilek
22K Followers 184 Following Professor @Berkeley_EECS. Research Scientist (part-time) @GoogleAI. Founder @addiscoder. 🇻🇮🇺🇸🇪🇹
Amin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.
Jason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning
Boaz Barak @boazbaraktcs
17K Followers 415 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.
Peter Richtarik @peter_richtarik
6K Followers 591 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦
Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpacking
Csaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6
Dimitris Papailiopoul.. @DimitrisPapail
11K Followers 957 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez Lily
Ben Recht @beenwrekt
26K Followers 361 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Yuandong Tian @tydsh
16K Followers 795 Following Research Scientist and Senior Manager in Meta AI (FAIR). AI-guided Optimization and Representation Learning. Novelist in spare time. PhD in @CMU_Robotics.
Alex Dimakis @AlexGDimakis
13K Followers 2K Following UT Austin Professor. Researcher in Machine Learning and Information Theory. National AI Institute on the Foundations of Machine Learning (IFML) Co-director.
Aaron Roth @Aaroth
10K Followers 639 Following CS professor at Penn. Amazon Scholar at AWS. Author of The Ethical Algorithm (w/ Michael Kearns). I study machine learning, privacy, game theory, and fairness.
Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.
Tengyu Ma @tengyuma
25K Followers 510 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Institute for Advance.. @the_IAS
27K Followers 384 Following Latest news, research, and campus updates from one of the world's leading centers for theoretical research and intellectual inquiry.
Aman Karmani @tmm1
6K Followers 3K Following full stack tinkerer and perf nerd. formerly vp of infra @github and ruby-core committer. now @getchannels working on ffmpeg/go. dabbling in machine learning.
Martin Jinye Zhang @martinjzhang
799 Followers 859 Following Assistant professor @CMUCompBio | postdoc @HarvardChanSPH | PhD @Stanford_EE | statistical genetics & machine learning
Armen Aghajanyan @ArmenAgha
6K Followers 261 Following Research Scientist @ Meta AI (FAIR) https://t.co/8XF2vtiIVy Opinions are my own.
Jorge Nocedal @nocedal
127 Followers 3 Following Professor at Northwestern University. Research areas: operations research, computer science, optimization
刘江/LIU Jiang @turingbook
54K Followers 3K Following Exploring AGI. Co-Founder of Turing Company. ex Meituan, BAAI, CSDN. 图灵联合创始人。曾任：智源研究院副院长，CSDN&《程序员》杂志总编，美团技术学院院长。
Maria Skoularidou (sh.. @skoularidou
5K Followers 600 Following •Researcher in theoretical CS+statistics applied to healthcare @broadinstitute @Schmidt_Center •PhD in probabilistic ML @Cambridge_Uni •Founder @AiDisability
Adam Elmachtoub @Adam235711
3K Followers 3K Following Associate Professor of Industrial Engineering and Operations Research @Columbia @CUSEAS @DataSciColumbia / @AmazonScience Visiting Academic
Lukas Biewald @l2k
25K Followers 4K Following Machine Learning Tools. Founder of @weights_biases. Previously founder of Figure Eight, now @appenglobal.
Olga Golovneva @OlgaNLP
57 Followers 82 Following
Kuang Xu 许匡 @ProfKuangXu
675 Followers 68 Following Professor @StanfordGSB. Operations Research, Data Science & AI Strategy. https://t.co/qS8dfEG3zJ. I write https://t.co/LgsSID9Va6
Jiaqi Zhai @Lunarmony
39 Followers 324 Following
Adina Williams @adinamwilliams
4K Followers 901 Following Computational linguistics, cognitive science, NLP; semantics + syntax; @AIatMeta (FAIR NYC); formerly @nyuling @[email protected]
Martin Takac @TakacMartin
284 Followers 128 Following
Rad Niazadeh @rad_niazadeh
2K Followers 452 Following Assistant professor @ChicagoBooth @UChicago; past: computer science @Stanford @Cornell; studying incentives, algorithms & learning in markets & online platforms
Eshan Chattopadhyay @Eshan_chattopad
134 Followers 136 Following Assistant Professor @Cornell CS. Interested in theoretical computer science.
Luke Zettlemoyer @LukeZettlemoyer
8K Followers 2K Following
Ledell Wu @LedellWu
690 Followers 235 Following AI Research Scientist (Generative AI/LLM/Multimodal) Co-founder @CreatifyLab, Past: FAIR @MetaAI, @BAAIBeijing Recipient of ICML 2023 Test-of-Time Award
Zhigang Suo @zhigangsuo
24K Followers 1K Following Professor of Mechanics and Materials at Harvard University. Member of US National Academy of Engineering. Member of US National Academy of Sciences.
Fan Long @FanLong16
2K Followers 60 Following Assistant Professor at the University of Toronto. Co-Founder of Conflux. Hacker. Love to build, analyze, break, and fix programs/systems.
Adam Tauman Kalai @adamfungi
1K Followers 85 Following
Rati Gelashvili @rgelash
47K Followers 493 Following Concurrency 🥷 Blockchain researcher @aptoslabs, prev @novi. even prior eng team lead @neuralmagic, PhD @mit.
Surya Ganguli @SuryaGanguli
15K Followers 457 Following Associate Prof of Applied Physics @Stanford, and departments of Computer Science, Electrical Engineering and Neurobiology. Venture Partner @a16z
Tianbao (TB) Yang @yang_ML
235 Followers 199 Following Professor at Texas A&M University; Machine learning researcher; working on optimization for ML and AI; developing LibAUC library for training deep neural nets.
Mengdi Wang @MengdiWang10
796 Followers 240 Following Princeton professor in AIML, optimization and data science. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua
Van Dijk Lab @david_van_dijk
4K Followers 3K Following Assistant Professor @Yale @YaleMed @YaleCompsci | ML/AI comp bio
Fei Sha @feishaAI
2K Followers 311 Following Researcher and engineers in AI and ML; now at Google Research, formerly Professor at USC
Last Week Tonight @LastWeekTonight
3.0M Followers 358 Following Breaking news on a weekly basis. #LastWeekTonight with John Oliver (@iamjohnoliver) Sundays at 11PM on @HBO.
Chris Olah @ch402
90K Followers 173 Following Reverse engineering neural networks at @AnthropicAI. DMs open! Previously @distillpub, OpenAI Clarity Team, Google Brain. Personal account.
Sanae Lotfi @LotfiSanae
2K Followers 251 Following PhD student @NYUDataScience, prev. Visiting Researcher @MetaAI (FAIR), @DeepMind and @MSFTResearch Fellow
Preetum Nakkiran @PreetumNakkiran
10K Followers 2K Following ML research @Apple. @sh_reya’s fiancé | PhD @Harvard, postdoc @UCSanDiego, EECS @Berkeley_EECS, "AI" @OpenAI, @GoogleAI
Volkan Cevher @CevherLIONS
3K Followers 576 Following Associate Professor of Electrical Engineering, EPFL. Amazon Scholar. ELLIS Fellow.
Ravid Shwartz Ziv @ziv_ravid
2K Followers 1K Following Faculty Fellow and Assistant Professor at @NYUDataScience, working with @ylecun
Brandon Amos @brandondamos
14K Followers 2K Following research scientist @MetaAI (FAIR) | optimization, machine learning, control, and reinforcement learning | PhD from @SCSatCMU
Shai Shalev-Shwartz @shai_s_shwartz
2K Followers 132 Following Computer Science @HebrewU; CTO @Mobileye #selfdrivingcars #ai #machinelearning Opinions are my own.
Beidi Chen @BeidiChen
6K Followers 348 Following Asst. Prof @CarnegieMellon, Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.
Ilya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openai
Sainbayar Sukhbaatar @tesatory
2K Followers 284 Following Researcher Scientist at FAIR @MetaAI Research: Memory Networks, Asymmetric Self-Play, CommNet, Adaptive-Span, System2Attention, ...
Jason Weston @jaseweston
9K Followers 568 Following Research @MetaAI+NYU. Pretrain+FT: NLP from Scratch (2011). Multilayer attention+position embed+LLM: MemNets (2015). Recent (2023+):Sys 2 Attn, Self-Rewarding..
Sushant Sachdeva @sushnt
1K Followers 762 Following Google research, Faculty@UToronto CS, Vector Institute affiliate. Algorithms, Optimization, Learning.
Shiqian Ma @ShiqianMa
1K Followers 1K Following associate professor@Rice University. PhD from Columbia IEOR. Work on optimization and machine learning.
Song Mei @Song__Mei
1K Followers 547 Following Assistant Professor at UC Berkeley, Department of Statistics and EECS. Researcher working on foundations of generative AI.
François Charton @f_charton
2K Followers 20 Following AI for maths, cryptography and theoretical physics FAIR, MetaTrends for United States
1,31 Mn posts
79,3 B posts
101 B posts
40,7 B posts
304 B posts
32,3 B posts
34,3 B posts
24,7 B posts
102 B posts
63,5 B posts
180 B posts
67,2 B posts
19,8 B posts
120 B posts
183 B posts
43,5 B posts
62,8 B posts
19 B posts
77 B posts
51,4 B posts
You might like
Tengyu Ma
@tengyuma
25K Followers
Sham Kakade
@ShamKakade6
12K Followers
Sebastien Bubeck
@SebastienBubeck
33K Followers
Elad Hazan
@HazanPrinceton
11K Followers
Greg Yang
@TheGregYang
53K Followers
Simon Shaolei Du
@SimonShaoleiDu
6K Followers
Aleksander Madry
@aleks_madry
31K Followers
Sanjeev Arora
@prfsanjeevarora
21K Followers
Jason Lee
@jasondeanlee
10K Followers
Zico Kolter
@zicokolter
15K Followers
Nan Jiang
@nanjiang_cs
7K Followers
Yuandong Tian
@tydsh
16K Followers
Gergely Neu
@neu_rips
9K Followers
Quanquan Gu
@QuanquanGu
9K Followers
Hadi Salman
@hadisalmanX
5K Followers