Julie Kallini ✨ @JulieKallini
CS PhD @StanfordNLP 🌲 Previously: SWE @Meta, Class of '21 @PrincetonCS juliekallini.com Joined January 2018-
Tweets156
-
Followers605
-
Following341
-
Likes694
Huge congrats to @isabelpapad!!! 🎊🎉
Join us online for the May 13–14 for a star-studded #NSF-sponsored workshop: New Horizons in Language Science: Large Language Models, Language Structure, and the Cognitive & Neural Basis of Language! Interdisciplinary talks & discussion on three themes: 1/ newhorizonsinlanguagescience.github.io
The idea of "machine unlearning" is getting attention lately. Been thinking a lot about it recently and decided to write a long post: ai.stanford.edu/~kzliu/blog/un… 📰 Unlearning is no longer just about privacy and right-to-be-forgotten since foundation models. I hope to give a gentle…
What do great teachers do to be good at teaching? What can this teach us about LMs? Most of us experience the “front stage” of teaching—as students. Few see the *back stage*: the planning, pedagogical decisions… 🌉 Bridge, at NAACL’24, surfaces these hidden decisions🧵
@thegautamkamath I have no doubt about the positive intentions behind this, but my fear is that it's yet another policy that will benefit kids with already exceptional access to education and mentorship. How about a specific track for work on AI that aims to equalize educational opportunity?
That's a wrap, for the first Bay Area Language Processing Interest Group meeting! Featuring a diverse collection of talks from Stanford, UCSF, UC Berkeley and UC Davis, and bringing together around 100 language researchers from our community. Looking forward to the next one!
After a meteoric rise, DSPy is now the @stanfordnlp repository with the most GitHub stars. Big congratulations to @lateinteraction and his “team”. DSPy: Programming—not prompting—Foundation Models github.com/stanfordnlp/ds…
btw Hugging Face official Chinese name is 抱抱脸 which is very cute ("huggy huggy face")
btw Hugging Face official Chinese name is 抱抱脸 which is very cute ("huggy huggy face")
Amazing work from @aryaman2020 and @ZhengxuanZenWu!
Amazing work from @aryaman2020 and @ZhengxuanZenWu!
ReFT: Representation Finetuning for Language Models 10x-50x more parameter-efficient than prior state-of-the-art parameter-efficient fine-tuning methods repo: github.com/stanfordnlp/py… abs: arxiv.org/abs/2404.03592
Thrilled to announce the 2024 recipients of #KempnerInstitute Research Fellowships: Thomas Fel, Mikail Khona, Bingbin Liu, Isabel Papadimitriou, Noor Sajid, & Aaron Walsman! bit.ly/4aBQ6MS @Napoolar @KhonaMikail @BingbinL @isabelpapad @nsajidt @aaronwalsman
For this week’s NLP Seminar, we are thrilled to host @alsuhr to talk about "Artificial and Natural Language Agents in Interaction"! When: 04/04 Thurs 11am PT Non-Stanford affiliates registration form (closed at 9am PT on the talk day): forms.gle/Vb44u8ZfjGBTAm…
But it is shocking that next word prediction can drive learning the fine structure and meaning of human languages, profoundly so given Chomsky’s claims that dominated much of linguistics, while LLMs work less well on unnatural signals; see @JulieKallini: arxiv.org/abs/2401.06416
Provocative correspondence in Nature today: nature.com/articles/d4158… I have to admit that I don't really understand these arguments, though...
I know I am late in the project cycle for this, but I do have suggested edits for the team behind nature.com/articles/d4158… My overall comment is that the central claims in the original are lacking in empirical support.
Our paper on formal and functional competence in language models is now out in Trends in Cognitive Science! With co-lead @neuranna along with @IbanDlank, @Nancy_Kanwisher, Josh Tenenbaum and @ev_fedorenko. Paper: mahowak.github.io/assets/pdf/mah… Thread below. 1/n
Hey, a cameo appearance in today’s @washingtonpost! “Meta aims to procure 350,000 of the specialized GPUs necessary to run gargantuan calculations on AI models. In contrast, Stanford’s Natural Language Processing Group has 68 GPUs for all of its work.” wapo.st/3Ix9deO
Despite having almost no money, academics still developed (just since 2020) diffusion models, FlashAttention, prefix tuning, DPO, essentially every neural IR model, many of the methods for long contexts, and the majority of the important benchmarks, among many other things.
Despite having almost no money, academics still developed (just since 2020) diffusion models, FlashAttention, prefix tuning, DPO, essentially every neural IR model, many of the methods for long contexts, and the majority of the important benchmarks, among many other things.
_d_awn @dawn26550494601
0 Followers 53 Following
Nicole Meister @ ICLR @nicole__meister
102 Followers 150 Following phd student @stanfordnlp, previously @princeton @VisualAILab (she/her)
Zhaoyang Wang @wangwan83764204
436 Followers 5K Following CS PhD student at Uni of Birmingham in the United Kingdom. Research interests: Automated Machine Learning (BayesianOp), and Reinforcement Learning🏳️🌈
Ben Lipkin @ben_lipkin
407 Followers 763 Following phd student @mitbrainandcog. (cogsci | ai) & (language | code). he/him.
Gaara 01 @Gaara01740885
185 Followers 5K Following
Parth Sarthi @parthsarthi03
457 Followers 647 Following Researching Language Models @StanfordNLP, @StanfordAILab Prev: @ContextualAI
Rashew @Rashew221539
4 Followers 393 Following
Limx0fz @limx0fz
85 Followers 625 Following
Xiang Fu @thisisxfu
46 Followers 2K Following Researcher @BUSPH | @BU_CDS | Founder of @ModularNLP | Deep Learning | Data Science |
Salvatore Greco @_salvatoregreco
114 Followers 498 Following PhD Student | Explainable Artificial Intelligence and Natural Language Processing at Politecnico di Torino
Alyssa, Yi CHENG @YiCheng77783310
96 Followers 215 Following Ph.D. student, working on NLP for social good and conversational AI.
Ashutosh Mehra @ashutoshmehra
2K Followers 6K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.
Ryan M.C. Law @rmc_law
536 Followers 636 Following neuroscience, psycholinguistics, semantics // PhD candidate @Cambridge_Uni @Gates_Cambridge // Bornean Malaysian 🇲🇾 // on bluesky @rmc-law
Cooper Leong @cooperleong22
109 Followers 2K Following
Trilok Padhi @trilokpadhi_
292 Followers 3K Following PhD student at @GeorgiaStateU | Computational Social Science | Graph Machine Learning | Knowledge Graphs | Ex-@Rakuten, @nvidia, @BoschGlobal
Hester Albina @AlbinaHest64057
138 Followers 1K Following Challenge to increase the number of fans by more than 1,000 within one month.
Magdalena Kachlicka @mkachlicka
920 Followers 3K Following Postdoctoral Researcher @bbkpsychology @audioneurolab working on speech+sounds+brains 🧠 cognitive sci, auditory neuroscience, brain imaging, language, methods
Yu Sun @sflsy1
478 Followers 2K Following PhD student of Applied Linguistics, Tongji University, China.
Jennifer Higa @jennybean_h
5 Followers 258 Following
Siyan Sylvia Li ✨ @Sylvia_Sparkle
1K Followers 507 Following 1st year PhD @columbianlp • Prev @stanfordnlp @GeorgiaTech • Weird Little Guy Academic • NLP, Dialogue Systems • Caffeine Gremlin
Shijia Zhou @shijiazho
38 Followers 110 Following Master Student in Computational Linguistics @cislmu of @LMU_Muenchen.
Alexander Wan @alexwan55
476 Followers 945 Following CS at Berkeley; @BerkeleyML @BerkeleyNLP; NLP research
kumar @kumar__nn
0 Followers 1K Following
Hongwei Jiang @yukko74609113
8 Followers 56 Following PhD student at Shanghai Jiao Tong University @sjtu1896. Interested in Intelligent Transportation, Human Computer Interaction, and LLMs Agent.
Abhinav @abhinavdutta555
22 Followers 395 Following
Damien Teney @DamienTeney
1K Followers 433 Following Research Scientist @ Idiap Research Institute. @Idiap_ch Adjunct lecturer @ Australian Institute for ML. @TheAIML Occasionally cycling across continents.
Cathy Lee @CathyLe62452856
14 Followers 1K Following
Benjamin Riley @benjaminjriley
7K Followers 1K Following Founder of Cognitive Resonance, a new venture to improve understanding of human cognition and generative AI.
Vishala Mishra @vishala_mishra
275 Followers 4K Following Physician and Clinical Informaticist interested in using data for health equity.
Juan Hmmm @JuanAH03488233
77 Followers 3K Following
Anthony Ng @algo_hunter
1K Followers 3K Following Love discovering, sharing and teaching data science, quant finance, R and Python. Father of 2 special ladies thanks to my lovely wife. His grace my anchor. NFA
Nicole Meister @ ICLR @nicole__meister
102 Followers 150 Following phd student @stanfordnlp, previously @princeton @VisualAILab (she/her)
Ben Lipkin @ben_lipkin
407 Followers 763 Following phd student @mitbrainandcog. (cogsci | ai) & (language | code). he/him.
Matthias Gerstgrasser @MGerstgrasser
77 Followers 43 Following I teach AIs to play nice with one another, and sometimes with us humans.
Parth Sarthi @parthsarthi03
457 Followers 647 Following Researching Language Models @StanfordNLP, @StanfordAILab Prev: @ContextualAI
Nitya Thakkar @nityabt
43 Followers 57 Following CS PhD @Stanford. @BrownUniversity '23. Interested in machine learning for health
Russ Altman @Rbaltman
8K Followers 166 Following Professor at Stanford Univ. in Bioengineering, Genetics and more. Hosts "Future of Everything" podcast. Threads: russbaltman
Princeton PLI @PrincetonPLI
1K Followers 20 Following Princeton University initiative enhancing fundamental understanding of AI, enabling its use in academic disciplines, and examining AI's societal implications.
Jill Kries @KriesJill
271 Followers 558 Following Cognitive neuroscientist. Postdoc @StanfordBrain @StanfordPsych working with @GwilliamsL on speech comprehension. Passionate about music! She/her
Kempner Institute at .. @KempnerInst
1K Followers 96 Following The Kempner Institute for the Study of Natural and Artificial Intelligence at @Harvard University. RTs ≠ Endorsements
Siyan Sylvia Li ✨ @Sylvia_Sparkle
1K Followers 507 Following 1st year PhD @columbianlp • Prev @stanfordnlp @GeorgiaTech • Weird Little Guy Academic • NLP, Dialogue Systems • Caffeine Gremlin
Weixin Liang @liang_weixin
631 Followers 627 Following CS Ph.D. Student @Stanford @StanfordAILab https://t.co/pOjcCS4gUk
Damien Teney @DamienTeney
1K Followers 433 Following Research Scientist @ Idiap Research Institute. @Idiap_ch Adjunct lecturer @ Australian Institute for ML. @TheAIML Occasionally cycling across continents.
Adele Goldberg @adelegoldberg1
7K Followers 2K Following Linguist, experimentalist, constructionist usage-based approach to language (she's)
Damian Blasi @blasi_lang
2K Followers 3K Following Human languages, cultures and minds, their evolution and diversity. ICREA Research Professor at @cbcupf. Latinoamericano y oriundo de las Pampas y el Paraná.
Virginia Adams @itsvadams
10 Followers 164 Following
Kanishka Misra 😶�.. @kanishkamisra
1K Followers 571 Following Postdoc at UT Austin. Research Asst. Prof at @ttic_connect starting Fall 2024! Works on concepts and categories in minds and machines (mostly machines). he/him.
xAI @xai
1.0M Followers 36 Following
Jürgen Schmidhuber @SchmidhuberAI
108K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
Martijn Bartelds @BarteldsMartijn
423 Followers 305 Following Postdoctoral Scholar @stanfordnlp | Visiting researcher @tudelft | Formerly @univgroningen, @GroNlp and @Penn
Cas (Stephen Casper) @StephenLCasper
3K Followers 1K Following #AI safety & responsibility. PhD Candidate @ #MIT_CSAIL.
Zhehao Zhang @Zhehao_Zhang123
110 Followers 391 Following Graduate student at @Dartmouthcs ; Visiting Research Intern @SALT_NLP; Prev. Research Intern @MSFTResearch; Formerly undergrad from @sjtu1896; NLP&ML #NLProc
Daneshvar Amrollahi @AmrollahiD
86 Followers 193 Following Computer Science PhD student @Stanford | Automated Reasoning, SMT Solving, Verification, Computer Systems.
Yanchen Liu @_yanchenliu
87 Followers 161 Following 2nd-Year Master's Student @Harvard | Visiting @StanfordNLP BSc in CS @TU_Muenchen | CL @LMU_Muenchen Seeking Ph.D. positions for Fall 24 | NLP
Yanzhe Zhang @StevenyzZhang
106 Followers 137 Following 张彦哲, Computer Science Ph.D. student @ICatGT @GeorgiaTech @SALT_NLP Previously Intern @AdobeResearch CS undergrad @ZJU_China
Onur Keleş @Onr_Kls
603 Followers 388 Following MA in Linguistics, Research Assistant @UniBogazici | Interested in visual-gestural modality, quantitative linguistics, and computational social science #stats
Josh Waldman @joshfwaldman
137 Followers 1K Following
Owen Dugan @OwenDugan
21 Followers 83 Following Undergraduate student at @MIT. I research AI and Physics.
Ryan.M.Nefdt @ryan_nefdt
179 Followers 139 Following Philosopher of science in linguistics, cognitive science, & AI. Author of 'Language, Science, and Structure' @OxUniPress, PhD @StAndrewsPhil, work @UCT_Research
Carina Kauf @KaufCarina
603 Followers 493 Following Ph.D. Candidate at MIT | Brain and Cognitive Sciences https://t.co/D6vnrfKbbm
Michael Ryan @michaelryan207
592 Followers 473 Following NLP Masters Student @stanfordnlp. || Working on DSPy 🧩 || Prev @GeorgiaTech @Microsoft
Michael C. Frank @mcxfrank
15K Followers 2K Following Cognitive scientist at Stanford. Open science advocate. @stanfordsymsys director. Bluegrass picker, slow runner, dad.
Been Kim @_beenkim
23K Followers 457 Following Research Scientist at Google DeepMind, PhD from MIT. Make machines empower people. @[email protected]
Alona Fyshe (she/her) @alonamarie
2K Followers 1K Following ML + language + neuroscience. Associate prof UofAlberta CS/Psych. Opinions are my own. (she/her) @[email protected] on mastadon
Jakub Szymanik @Logic_Cognition
2K Followers 729 Following Meaning and Computation Lab @cimec_unitrento and @UniTrento_DISI. @[email protected]
Büşra Marşan @BusraMarsan
37 Followers 108 Following feminist killjoy, academic in the making // PhD student @Stanford Linguistics // MA @UniBogazici Linguistics
Verna Dankers @vernadankers
534 Followers 200 Following PhD student in #NLProc 🇳🇱 👩💻 🏴@Edin_CDT_NLP. interpretability x figurative language processing x compositional generalisation. she/her
Mistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCP
Arthur Mensch @arthurmensch
40K Followers 875 Following Co-founder and CEO @MistralAI. Apply https://t.co/yHGRZAtjcx
Lucy Jiang @lucyajiang
496 Followers 1K Following 👩🏻💻 PhD Student at @CornellCIS | @NSF GRFP Fellow | Previously @uwcse | she/her
Laura Gwilliams @GwilliamsL
3K Followers 1K Following Speech comprehension - Neuroscience - Machine Learning - Assistant Prof at Stanford University - She/Her - {also in the other place}
Hans Hanley @Hans_Hanley
173 Followers 4 Following A Florida man. CS PhD Candidate @Stanford. @NSF & @Meta PhD Fellow. Researching Disinformation, Security, and NLP. Blog at https://t.co/UtFg2GbiOo
Andrew Lampinen @AndrewLampinen
7K Followers 1K Following Interested in cognition and artificial intelligence. Research Scientist @DeepMind. Previously cognitive science @StanfordPsych. Tweets are mine.
Ryan Rhodes ⚙️�.. @cogscidude
4K Followers 1K Following Cognitive Science! Assistant Teaching Professor @rutgersccs Catch me on YouTube: https://t.co/wrkV0d0Udp
Rohan Pandey (e/acc) @khoomeik
4K Followers 1K Following multimodal codegen @ReworkdAI (YC S23+AIG3) || prev research @Microsoft + @CarnegieMellon '23 || 10x hackathon winner || living @AGIHouseSF
Alex Dimakis @AlexGDimakis
13K Followers 2K Following UT Austin Professor. Researcher in Machine Learning and Information Theory. National AI Institute on the Foundations of Machine Learning (IFML) Co-director.
Max Bartolo @max_nlp
2K Followers 788 Following I lead the Command modelling team at @Cohere and co-chair the @DynabenchAI @MLCommons working group. Prev @DeepMind, @MetaAI / FAIR & @BloomsburyAI.
Really really excited to be joining @UBCLinguistics! I'm so happy to get to work with the lovely people in the department I'll be going to @KempnerInst in the interim, again lucky to work with lovely, interdisciplinary people I'd love to hang if you're in Boston or Vancouver!
We are thrilled that Isabel Papadimitriou (@isabelpapad) will be joining @UBCLinguistics as an Assistant Professor as of Sept 2025!
Congrats to @YonatanOren_, @nicole__meister, @niladrichat, @faisalladhak on getting a best paper honorable mention for their work on provably detecting test set contamination for LLMs! If you’re interested in contamination, or fun statistical tests, their talk is Thu 4-4:15pm!
Say hi to @ericzelikman at #ICLR2024 who is presenting our work today on the state of using Vision-Language Models for image description evaluation! Read the paper here: openreview.net/pdf?id=j0ZvKSN…
Excited to present ContextRef this morning at ICLR, in collaboration w/ co-lead @ElisaKreiss, and @ChrisGPotts & @nickhaber. We benchmark metrics for image description in context, investigating their varying strengths in capturing human preferences and how we might improve them!
Excited to present ContextRef this morning at ICLR, in collaboration w/ co-lead @ElisaKreiss, and @ChrisGPotts & @nickhaber. We benchmark metrics for image description in context, investigating their varying strengths in capturing human preferences and how we might improve them!
We are thrilled that Isabel Papadimitriou (@isabelpapad) will be joining @UBCLinguistics as an Assistant Professor as of Sept 2025!
So excited for @isabelpapad! And for @UBCLinguistics! And for all the great computational linguistics happening in linguistics departments! Great news on all counts.
We are thrilled that Isabel Papadimitriou (@isabelpapad) will be joining @UBCLinguistics as an Assistant Professor as of Sept 2025!
Remember those scaling law results I tweeted out in March? I ran a bunch more experiments and will be submitting to @NeurIPSConf soon. The draft is ~70% done and I'm looking for community reviews before I put it on arxiv. Please comment/dm if interested & available! 🙏
Say your training compute budget = ~1.5e13 FLOPs If your dataset has a gzip compressibility ratio of 0.14, you should *max out your param count* and skimp on dataset size But if your dataset is less compressible (gzip=0.61), *keep your model small* and train it on a ton of data
I’m really excited to be starting a new adventure with multiple amazing friends & colleagues. Our company is called Physical Intelligence (Pi or π, like the policy). A short thread 🧵
cleaning/tidying your apartment can be refreshing/peaceful, but have you tried cleaning your github repositories?
Congratulations to @Stanford's @chrmanning on his 2024 @IEEEorg John von Neumann Medal, sponsored by @IBM, for advances in computational representation and analysis of natural language: bit.ly/43TG5YZ #IEEEAwards2024
Join us online for the May 13–14 for a star-studded #NSF-sponsored workshop: New Horizons in Language Science: Large Language Models, Language Structure, and the Cognitive & Neural Basis of Language! Interdisciplinary talks & discussion on three themes: 1/ newhorizonsinlanguagescience.github.io
The idea of "machine unlearning" is getting attention lately. Been thinking a lot about it recently and decided to write a long post: ai.stanford.edu/~kzliu/blog/un… 📰 Unlearning is no longer just about privacy and right-to-be-forgotten since foundation models. I hope to give a gentle…
Announcing the first Mechanistic Interpretability workshop, held at ICML 2024! We have a fantastic speaker line-up @ch402 @JacobSteinhardt @davidbau @ghandeharioun, $1,750 in best paper prizes, and a lot of recent progress to discuss! Paper deadline: May 29, either 8 or 4 pages
The GenBench workshop is back! Do you work on generalisation (benchmarking) in #NLProc? Submit to the 2nd edition (genbench.org/workshop/) co-located with #EMNLP2024. We have a regular track and a ✨collaborative benchmarking task (CBT)✨ that's fully LLM-focused this year (1/6)
GenBench will be back at #EMNLP2024!🎉 Submit a paper or participate in the Collaborative Benchmarking Task: submit evaluation data based on distribution shift wrt LLMs' pretraining corpora. Looking forward to participants' creativity & innovation for generalisation evaluation!💡
The GenBench workshop is back! Do you work on generalisation (benchmarking) in #NLProc? Submit to the 2nd edition (genbench.org/workshop/) co-located with #EMNLP2024. We have a regular track and a ✨collaborative benchmarking task (CBT)✨ that's fully LLM-focused this year (1/6)
What do great teachers do to be good at teaching? What can this teach us about LMs? Most of us experience the “front stage” of teaching—as students. Few see the *back stage*: the planning, pedagogical decisions… 🌉 Bridge, at NAACL’24, surfaces these hidden decisions🧵
📢 Calling the #EdTech community! Intrigued by the [potential/positive/negative] impact of LLMs on education? Submit your work to this workshop at #EDM2024 🪇👩🏫 ➡️sites.google.com/view/llmworksh… Deadline: May 10th Looking forward to the discussions!!!
How will ed tech change w LLMs? What is and isn't possible? If these Qs have been on your mind, submit your work to a workshop I'm organizing: Leveraging LLMs for Next Gen Ed Tech @ EDM 2024 by May 10th! ➡️sites.google.com/view/llmworksh… #EDM #EdTech
Is generative AI doomed? 😱 Our new study investigates the terrifying phenomenon of "model collapse" that could spell the end for AI's future! 🤖💀 1/N
Sorry if you tried emailing me and got the wrong Daniel. Learn to spell I guess
oh one thing i'm looking forward to about presenting ReFT is tricking engineers (who will think we're just interested in benchmark hill-climbing) into learning about interpretability
Trends for United States
You might like
