Alex Warstadt @a_stadt
Postdoc @ ETH Zürich | Future Asst Prof. @ UCSD | Former PhD @ NYU | computational linguistics, NLProc, CogSci, pragmatics | he/him 🏳️🌈 alexwarstadt.com Joined September 2016-
Tweets418
-
Followers1K
-
Following449
-
Likes1K
🚨Job Announcement🚨 I'm looking for a PhD student w/ an interest in low-resource #NLProc and #NLProc for medical applications to join my group (@NALACUJGU) at JGU (@uni_mainz), Germany. More details here: t.ly/2dJP3 Application deadline: 05/15/24 Please retweet!😊
The goat that the cat that the dog that the stick that the fire that the water that the ox that the butcher that the Angel of Death that the Holy One, Blessed be He smote killed slaughtered drank quenched burned beat bit ate was purchased by my father for two zuzim.
The Question Under Discussion❓is to discourse what the CFG is to syntax, but how speakers choose which❓to address next is VASTLY understudied. Excited for another big advance from this group: human jgmts on salience of a potential future❓AND models that can predict salience‼️
The Question Under Discussion❓is to discourse what the CFG is to syntax, but how speakers choose which❓to address next is VASTLY understudied. Excited for another big advance from this group: human jgmts on salience of a potential future❓AND models that can predict salience‼️
Did you know that most LLM’s vocabularies contain around 40% near duplicate entries? Check out our new work to learn more about how this may affect your model’s training efficiency! arxiv.org/abs/2404.06508 (details in thread) with T. Hofmann @ImanolSchlag @tpimentelms
👶 BabyLM Challenge is back! Can you improve pretraining with a small data budget? BabyLMs for better LLMs & for understanding how humans learn from 100M words New: How vision affects learning Bring your own data Paper track babylm.github.io 🧵
🔑 🗝️ The Article+Adjective+Numeral+Noun (e.g., “a lovely five days”) construction is quite rare, and yet people and LMs know it’s grammatical. What is the key to learning such a rare construction? @kmahowald and I answer this question in the context of LMs in our new paper:
I'm hiring! 2 year postdoc with research specialization in formal semantics/pragmatics, prosody, and/or social meaning. Please share widely!
I'm hiring! 2 year postdoc with research specialization in formal semantics/pragmatics, prosody, and/or social meaning. Please share widely!
Check out our new paper, harnessing the power of LLMs 💪 to scale up high quality manual annotations of CHILDES 👶
Check out our new paper, harnessing the power of LLMs 💪 to scale up high quality manual annotations of CHILDES 👶
🏛📣 Life Update 📣🏛 This fall, I’ll be starting a position as an Assistant Professor of Computational Linguistics at @Georgetown University! I’m excited to be moving to DC🇺🇸 and to be joining many wonderful colleagues at @GU_Linguistics
I am hoping to hire a postdoc who would start in Fall 2024. If you are interested in the intersection of linguistics, cognitive science, and AI, I encourage you to apply! Please see this link for details: rtmccoy.com/prospective_po…
This is good advice!!
🔉We just released EmphAssess, a benchmark for evaluating emphasis in speech to speech models. This work is a product of my internship at @metaai, and we’d gladly appreciate any feedback ! 📝 : arxiv.org/abs/2312.14069 👩💻 : github.com/facebookresear…
We have a survey! forms.gle/QLR4DpxxNAf6di…
We have a survey! forms.gle/QLR4DpxxNAf6di…
An incredible result: a model trained on 100m words gets 85% on BLiMP's linguistic minimal pairs.
An incredible result: a model trained on 100m words gets 85% on BLiMP's linguistic minimal pairs.
Now this is the kind of result that actually bears on poverty of the stimulus arguments! (And it also shows how tricky it is to make the case that the stimulus is un fact poor, as there's probably still more progress to be made on data efficient language model architectures)
Now this is the kind of result that actually bears on poverty of the stimulus arguments! (And it also shows how tricky it is to make the case that the stimulus is un fact poor, as there's probably still more progress to be made on data efficient language model architectures)
Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Najoung Kim 🫠 @najoungkim
2K Followers 493 Following At @BULinguistics and visiting @GoogleAI part-time. 🤖🔠🐱
Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.social
Dr. Hadas Kotek 🦄�.. @HadasKotek
6K Followers 1K Following Linguist in tech | NLP, data, safety | former academic | AltAc advocate | cat lover | feminist | she/her | demi | 🏳️⚧️ ally | BLM | powered by coffee & spite
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
DAC @lingdustin
3K Followers 3K Following {Neuro/psycho}linguistics, syntax, S Asian/Romance lgs. Views are noone's. He/him 🌈. lingdustin@bsky Also: horror movies, video games, cats
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Sebastian Gehrmann @sebgehr
5K Followers 2K Following Head of NLP, CTO office, @Bloomberg. (he/him) Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
Anna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/her
Ryan David Cotterell @ryandcotterell
9K Followers 1K Following
Tiwa Eisape @tiwa_eisape
1K Followers 1K Following PhD student at @MIT working on NLP and cognitive science - @NSF grfp fellow. Previously with @GoogleAI and @Meta FAIR
Aniello De Santo @ani.. @AnyDs
1K Followers 1K Following The mystery of the Universe is its comprehensibility. he\him. Not really here anymore, email or find me on the sky app. (pfp cc. Dustin Nguyen).
Cory Shain (coryshain.. @coryshain
2K Followers 745 Following Language in minds, brains, and machines. Postdoc, BCS@MIT. Faculty, Linguistics@Stanford (fall 2024). He/him. https://t.co/U9ulwMUitL
Abhishek Purushothama.. @ab_purushothama
57 Followers 360 Following This Fall!! Maybe coming to a PhD near you. Grad from CU Boulder. NLP Researcher-in-training. Wallpaper from TED_ED. he/him Mastodon: @[email protected]
Alina @a_ll_in_a_ll
0 Followers 10 Following
𝕋𝕒𝕥𝕤𝕦�.. @tatsuru_kikuchi
365 Followers 3K Following Research Officer at Faculty of Economics, The University of Tokyo. Keywords: Entrepreneur/OpenAI/Quantum/Crypto/Analytics/Consulting. Views are my own. 
Paul Soulos @paulsoulos
291 Followers 332 Following Computational Cognitive Science @JhuCogsci researching neurosymbolic methods. Previously wearable engineering @fitbit and @Google. @[email protected]
Tommy Botch @tommy_botch
213 Followers 367 Following
Hayley Ross @HayleyRossLing
11 Followers 42 Following PhD Student at @Harvard, working on computational semantics and LLM interpretability
Imperial NLP @imperial_nlp
66 Followers 336 Following We are the Natural Language Processing community here at Imperial College London. Looking forward to sharing more of our work over the coming months! #NLProc
Zola Mahlaza @nqongeveg
122 Followers 458 Following Computer Scientist. Working on Natural Language Generation for Nguni languages.
Jingyuan @JingyuanJysen
37 Followers 166 Following Postdoc KUL/neural encoding and decoding/BCI/NeuroAI/to see through the mind
Colton Casto @_coltoncasto
111 Followers 326 Following PhD student @Harvard @MIT - neuroscience, language, AI
Judit Fazekas @fffjudit
344 Followers 544 Following MSCA postdoc @DondersInst Predictive Brain Lab • language acquisition • neurobiology of language • open science • she/her
Ken Ngala @KenNgala2
20 Followers 70 Following
Alexander Naumenko @AlexanderNaume2
704 Followers 3K Following Theory of intelligence, #AGI, #NLP paper - https://t.co/zS8V7Ymwiq book - https://t.co/PJiAS8iMWx
Ricky W.J. Choi @RickyWJChoi
79 Followers 272 Following “I will not 사과 for my love for 사과“ 🍎 Developmental cognitive scientist in training 💭 Swarthmore '23 | PhD student @cmupsych
Donya Rooein @donyarooein
163 Followers 722 Following Postdoc @MilaNLProc @Unibocconi. Work in Conversational AI, Large Language Models and Education
Dennis Ulmer (is on t.. @dnnslmr
1K Followers 975 Following PhD @NLPnorth on low-resource NLP, uncertainty & more | Formerly @amazonscience @parameterlab @pacmedhealth, @UvA_amsterdam, @HD_NLP | he/him, same on 🐘/🌌
C.M. Downey @cmdowney
110 Followers 117 Following PhD candidate at @UWlinguistics, @uwnlp \ Incoming assistant prof. at @UofR Ling and Data Science \ NLP for low-resource, endangered, and Indigenous languages
Nicholas Lourie @NickLourie
138 Followers 287 Following I build things. 🤖 Doing a PhD at @nyuniversity (@CILVRatNYU) on better empirical methods for deep learning and data science. Advised by @kchonyc and @hhexiy.
Kavel Rao @kavel_r
56 Followers 223 Following BS/MS student and researcher at @uwcse @uwnlp Incoming intern at @databricks
jerry @gerasimoss
1K Followers 1K Following he/him, assist. prof. @MaastrichtU data miner+machine learner,☕ addict,📺 🎬 binge-watcher, #avgeek ✈️, G&T🍸, proud geek- views my own
Scherezade Dastur @SDastur
36 Followers 210 Following Linguist Doctoral candidate @iitmadras working on #bilingualism #codemixing #codeswitching interested in sociolinguistics, pragmatics, language typology etc.
Esma Aslan @blueandlime
4 Followers 308 Following
cenk çivici @cenk__civici
0 Followers 165 Following
Kelly Wu @tttttiam_real
4 Followers 155 Following
ben @ben_woodward
321 Followers 312 Following
alyssa loo @alyssamloo
81 Followers 212 Following 🇸🇬 | cs + linguistics undergrad @Brown_NLP | language model interpretability & probing human v. machine cognition
Aditya Yadavalli @AdityaYadavall2
181 Followers 258 Following Speech/NLP Engineer @karya_inc | Formerly CS + Linguistics student @iiit_hyderabad
Jon Willits @jonwillits
295 Followers 808 Following Cognitive Scientist and Assistant Professor @Illinois_Alma. Studies language and semantic development and computational models.
Eleonore Neufeld @EleonoreNeufeld
1K Followers 818 Following Philosophy prof @UMassAmherst. Cognition, language, social philosophy. she/her
Morgan @Morgan70633631
41 Followers 321 Following
Derek Dai @theo_2048
7 Followers 168 Following
Michael Hu @michahu8
263 Followers 291 Following PhD student @NYU. NLP & training data. @NSF GRFP fellow. Previously @princeton_nlp, @cocosci_lab.
Bob Frank @bob_frank
108 Followers 145 Following
Amirhossein Abaskohi @AmirAbaskohi
145 Followers 871 Following Master Student @UBC_CS | NLP Researcher @UBC_NLP | Content Creator @YouTube and @Medium #NLProc #MachineLearning
Jade Martin @Jade6467
860 Followers 4K Following LVMH Investment Analyst,Choice is more important than effort, and the direction of steps is more important than .Love fitness, travel, reading,
Saibo-Creator @SaiboGeng
121 Followers 159 Following CS PhD @ EPFL 🇨🇭 | focusing on Constraining LLMs using Parsing | Incoming intern at Microsoft
juan vásquez @juanmvsa
326 Followers 2K Following inside of me there are two (gay) wolves : phd student in computer science at @CUBoulder / letterboxd filmbro (https://t.co/GAOYaQWm4Z)
Philippe Schlenker-Pe.. @phschlenker_per
5 Followers 977 Following Senior Researcher at Institut Jean-Nicod, CNRS; Global Distinguished Professor at NYU. This is my non-academic account. (Academic account: @phschlenker_ac)
Yasmin @YasminC_Ling
13 Followers 381 Following Language acquisition, computational modelling, the neurobiology of language. Aberdeen/London
Adrian Valente @lowrank_adrian
1K Followers 2K Following I'm a small dynamical system, trying to make sense of a bigger dynamical system. Previously Phd student with @srdjan_ostojic, in search of a new home.
morph(em)ing @nlprookie
17 Followers 116 Following
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Christopher Potts @ChrisGPotts
11K Followers 620 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science, and member of @stanfordnlp and @StanfordAILab. He/Him/His.
Christopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Najoung Kim 🫠 @najoungkim
2K Followers 493 Following At @BULinguistics and visiting @GoogleAI part-time. 🤖🔠🐱
Dr. Hadas Kotek 🦄�.. @HadasKotek
6K Followers 1K Following Linguist in tech | NLP, data, safety | former academic | AltAc advocate | cat lover | feminist | she/her | demi | 🏳️⚧️ ally | BLM | powered by coffee & spite
@emilymbender@dair-co.. @emilymbender
58K Followers 2K Following Prof, Linguistics, UW // Faculty Director, CLMS // she/her // @[email protected] & bsky // rep by @ianbonaparte
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Fernanda Ferreira @fernandaedi
7K Followers 1K Following Psycholinguist at UCDavis, feminist, social democrat, runner, cycling advocate. Made in Portugal, raised in Canada, living and working in California.
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Felix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else's
DAC @lingdustin
3K Followers 3K Following {Neuro/psycho}linguistics, syntax, S Asian/Romance lgs. Views are noone's. He/him 🌈. lingdustin@bsky Also: horror movies, video games, cats
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Yonatan Belinkov @boknilev
4K Followers 1K Following Assistant professor of computer science @TechnionLive. #NLProc
Anna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/her
Paul Soulos @paulsoulos
291 Followers 332 Following Computational Cognitive Science @JhuCogsci researching neurosymbolic methods. Previously wearable engineering @fitbit and @Google. @[email protected]
Tommy Botch @tommy_botch
213 Followers 367 Following
University of Zurich @UZH_en
25K Followers 288 Following News of the University of Zurich. Deutsche Tweets: @UZH_ch
Dennis Ulmer (is on t.. @dnnslmr
1K Followers 975 Following PhD @NLPnorth on low-resource NLP, uncertainty & more | Formerly @amazonscience @parameterlab @pacmedhealth, @UvA_amsterdam, @HD_NLP | he/him, same on 🐘/🌌
Michael Hu @michahu8
263 Followers 291 Following PhD student @NYU. NLP & training data. @NSF GRFP fellow. Previously @princeton_nlp, @cocosci_lab.
Bob Frank @bob_frank
108 Followers 145 Following
Candace Ross @candacerossio
2K Followers 2K Following currently postdoc at Facebook AI @MetaAI, formerly PhD student at MIT @MIT_CSAIL | she/hers
Adam Ek @adamekemada
85 Followers 247 Following PhD student @ CLASP (Uni of Gothenburg). Neural nets are strange, language is fun.
David Mortensen @dmort27
2K Followers 2K Following I make colorless green GPUs sleep brriously @LTIatCMU. phonology • morphology • language change • #NLProc data resources.
Isabel Papadimitriou @isabelpapad
765 Followers 97 Following PhD student at @stanfordnlp, working with @jurafsky. Understanding neural models using typology, multilinguality🌹
Aditya Yedetore @AdityaYedetore
75 Followers 27 Following Graduate Student at Boston University in the Linguistics Department. Studying language acqusition, syntax, and semantics
Luke Zettlemoyer @LukeZettlemoyer
8K Followers 2K Following
Nico Daheim @ndaheim_
200 Followers 391 Following @ELLISforEurope PhD student in NLP and ML at @UKPLab @TUDarmstadt and @ETH_en. Previously MSc. in Data Science @RWTH.
Browning.jake00 @Jake_Browning00
1K Followers 470 Following Visiting Scientist at NYU working on the philosophy of AI, philosophy of mind, and the history of philosophy.
Asad Sayeed @asayeed@.. @asayeed
2K Followers 833 Following Computational psycholinguist in @OfClasp, Senior Lecturer at the University of Gothenburg. Decided to become thought leader. Ready to lead your thoughts.
Cameron Buckner @cameronjbuckner
2K Followers 571 Following Phil.- CogSci - AI Associate Prof., U. Houston All views my own - he/him Author: From Deep Learning to Rational machines (OUP) https://t.co/RvijkxzwpK
MH Tessler 🇺🇦 @mhtessler
1K Followers 675 Following research scientist @DeepMind. previously MIT, Stanford. interested in society, language, humans, and coffee. enjoying living in the 🇬🇧
Luca Malagutti @Malagutti_Luca
53 Followers 321 Following Provided 'as is' without warranties of any kind || CS MSc @ETH_en
zeb @tweetByZeb
217 Followers 281 Following PhD Student @CambridgeNLP | Festival Director of @WaterspriteFilm | Creativity enthusiast | he/him
Irina Proskurina @irproskurina
32 Followers 91 Following NLP, PhD student at @UniversiteLyon Université Lumière Lyon 2
Amanpreet Singh @apsdehal
3K Followers 621 Following CTO @ContextualAI. Past: @huggingface and @MetaAI.
Yair Lakretz @lakretz
136 Followers 69 Following
Stanford NLP Group @stanfordnlp
145K Followers 179 Following Computational Linguists—Natural Language—Machine Learning @chrmanning @jurafsky @percyliang @ChrisGPotts @tatsu_hashimoto @MonicaSLam @Diyi_Yang @StanfordAILab
Joachim Wagner @Wjrgo
464 Followers 2K Following Natural Language Processing #NLPProc, #MachineLearning, High Performance Computing #HPC @ADAPTCentre @DublinCityUni
Noga Zaslavsky @NogaZaslavsky
1K Followers 692 Following Computational cognitive scientist, developing integrative models of language, perception, and action. Asst Prof @UCIrvine, previously postdoc @MIT
Chengxu Zhuang @ChengxuZhuang
435 Followers 204 Following Make artificial intelligence models more human like! ICoN Postdoctoral Fellow at MIT. Previously Stanford PhD student @NeuroAILab.
XY Han @XYHan_
1K Followers 978 Following Incoming Assistant Professor @ChicagoBooth | Postdoc @Stanford | Papers: “Neural Collapse in Deep Nets” & “Survey Descent: Nonsmooth Gen. of GD”
Sandy Abu El Adas @sandyabuadas
663 Followers 1K Following Postdoc at @bcbl_ | previously @NYU_CSD | SLP | Palestinian | Interested in perception/production variability, dyslexia, bilingualism (she/her)
Marius Mosbach @mariusmosbach
714 Followers 877 Following Postdoc @Mila_Quebec & @mcgillu | NLP researcher
Julius Steuer @Julius_Steuer
13 Followers 48 Following
David Samuel @davidsamuelcz
218 Followers 112 Following PhD student at University of Oslo, Language Technology Group. Interested in small and efficient language models.
Will Timkey @wtimkey8
290 Followers 299 Following aspiring computational psycholinguist | (first gen!) PhD student @nyuling | transit & urbanism enthusiast (he/they)
Miyu Oba @Rodamille
1K Followers 627 Following PhD candidate at @NAIST_NLP Comp(psycho)Ling, Multi(Cross)linguality, LanguageModel Looking for visiting student or internship opportunities
Julie Kallini ✨ @JulieKallini
601 Followers 338 Following CS PhD @StanfordNLP 🌲 Previously: SWE @Meta, Class of '21 @PrincetonCS
Elias Stengel-Eskin @EliasEskin
1K Followers 783 Following Current postdoc @uncnlp with @mohitban47 in NLP and CL, PhD @jhuclsp. @NSF grad fellow, 2x intern @MSFTResearch, undergrad @mcgillu cogsci. He/him
Tamar Regev @tamaregev
475 Followers 218 Following Postdoc @ MIT lab of @ev_fedorenko. Cognitive neuroscience of language and speech.
Eva Portelance @EvaPortelance
191 Followers 172 Following AI/Cognitive scientist interested in language learning and understanding. Incoming Assistant Professor in decision sciences @HEC_Montreal! She/Her
🎉Congrats to CDS PhD student Will Merrill (@lambdaviking) on receiving the prestigious @twosigma PhD Fellowship! 🎓 Will's research uses theoretical computer science to better understand the capabilities and limitations of language models. Well done, Will! 👏
🚨Job Announcement🚨 I'm looking for a PhD student w/ an interest in low-resource #NLProc and #NLProc for medical applications to join my group (@NALACUJGU) at JGU (@uni_mainz), Germany. More details here: t.ly/2dJP3 Application deadline: 05/15/24 Please retweet!😊
@amazingmap It is a convoluted puzzle that only a British person can understand 😎
On the linguistic side, this is a first step towards ranking potential questions and linking them with QUDs, a gap that @a_stadt pointed out once in his “just don’t ask” paper ojs.ub.uni-konstanz.de/sub/index.php/…
Super excited about this new work! Empirical: although LLMs have good abilities to generate questions, they don’t inherently know what’s important. We try to solve this! Linguistic: is reader expectation predictable and if so, how well does that align with what’s in the text?
LLMs can mimic human curiosity by generating open-ended inquisitive questions given some context, similar to how humans wonder when they read. But which ones are more important to be answered?🤔 We predict the salience of questions, substantially outperforming GPT-4.🌟 🧵1/5
How do we predict salience score? 💡 We introduce our fine tuned models on Mistral-7B-Instruct, Llama-2-7b-chat, TinyLlama-1.1B-chat, Flan-t5-base which outperforms LLM zero-shot/few-shot baseline even with stronger prompting techniques. 🧵4/5
Is a high-salience question more likely to be answered?👀 Yes! This connects expectation-driven potential questions with QUDs. Additionally, we demonstrate that answering high-salience questions can serve as an indicator of summarization quality in news articles. 🧵3/5
LLMs can mimic human curiosity by generating open-ended inquisitive questions given some context, similar to how humans wonder when they read. But which ones are more important to be answered?🤔 We predict the salience of questions, substantially outperforming GPT-4.🌟 🧵1/5
I got tenure! It was fitting that I got to celebrate with the lab right after the news. Working together for the last 6.5 years has been a blast.
Thrilled to share a review on THE LANGUAGE NETWORK AS A NATURAL KIND—a culmination of ~20 yrs of thinking about+studying language from linguistic, psycholinguistic, and cog neuro perspectives. @NatRevNeurosci rdcu.be/dEylV With the amazing @neuranna @tamaregev 🥳 🧵1/n
Did you know that most LLM’s vocabularies contain around 40% near duplicate entries? Check out our new work to learn more about how this may affect your model’s training efficiency! arxiv.org/abs/2404.06508 (details in thread) with T. Hofmann @ImanolSchlag @tpimentelms
How much does an LM depend on information provided in-context vs its prior knowledge? Check out how @vesteinns, @niklas_stoehr, @JenniferCWhite, @AaronSchein, @ryandcotterell + I answer this by measuring a *context's persuasiveness* and an *entity's susceptibility*🧵
BabyLM is back for round two! This time we have: 1. Multimodal track 2. Bring your own data and 3. Paper track! See the CfP for all the juicy details!
👶 BabyLM Challenge is back! Can you improve pretraining with a small data budget? BabyLMs for better LLMs & for understanding how humans learn from 100M words New: How vision affects learning Bring your own data Paper track babylm.github.io 🧵
Thanks @raquel_dmg, @sandropezzelle, and @ELLISforEurope for this amazing initiative. Wonderful people, inspiring ideas and productive discussions -- I want more of this! 🤩
22 researchers from 12 European institutions discussed future directions in open #LLMs and multimodal language technologies at the Oberwolfach Research Institute for Mathematics. The workshop was organised by @raquel_dmg & @sandropezzelle on behalf of the ELLIS #NLP program! #ML
Very happy to announce that I will soon join the MIT linguistics and philosophy department as an assistant professor!
I am helping organize BUCLD this year! Please consider submitting your abstracts and symposium ideas. bu.edu/bucld/
🔑 🗝️ The Article+Adjective+Numeral+Noun (e.g., “a lovely five days”) construction is quite rare, and yet people and LMs know it’s grammatical. What is the key to learning such a rare construction? @kmahowald and I answer this question in the context of LMs in our new paper:
Najoung and I are hiring a postdoc to start at BU this fall! You'll get to lead a team working on a cool and potentially highly impactful eval project, so please apply! :)
🧙🍪🧙♀️ I'm hiring a postdoc with @sebschu to start in Fall 2024! We are looking for someone with experience in EITHER: (1) building systems that use language models as a core component to solve complex tasks, or (2) leading human annotation/behavioral experiments.
Trends for United States
You might like
