Ethan Gotlieb Wilcox @weGotlieb
Postdoc at ETH Zurich. Formerly PhD student at Harvard Linguistics, affiliated with MIT Brain & Cog Sci. Language, Computers, Cognition. wilcoxeg.github.io Joined June 2012-
Tweets173
-
Followers921
-
Following415
-
Likes404
The goat that the cat that the dog that the stick that the fire that the water that the ox that the butcher that the Angel of Death that the Holy One, Blessed be He smote killed slaughtered drank quenched burned beat bit ate was purchased by my father for two zuzim.
BabyLM is back for round two! This time we have: 1. Multimodal track 2. Bring your own data and 3. Paper track! See the CfP for all the juicy details!
BabyLM is back for round two! This time we have: 1. Multimodal track 2. Bring your own data and 3. Paper track! See the CfP for all the juicy details!
🔑 🗝️ The Article+Adjective+Numeral+Noun (e.g., “a lovely five days”) construction is quite rare, and yet people and LMs know it’s grammatical. What is the key to learning such a rare construction? @kmahowald and I answer this question in the context of LMs in our new paper:
Tal Linzen @tallinzen
16K Followers 894 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
Christopher Potts @ChrisGPotts
11K Followers 620 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science, and member of @stanfordnlp and @StanfordAILab. He/Him/His.
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Tiwa Eisape @tiwa_eisape
1K Followers 1K Following PhD student at @MIT working on NLP and cognitive science - @NSF grfp fellow. Previously with @GoogleAI and @Meta FAIR
Najoung Kim 🫠 @najoungkim
2K Followers 493 Following At @BULinguistics and visiting @GoogleAI part-time. 🤖🔠🐱
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Robert Hawkins @hawkrobe
3K Followers 1K Following computational cognitive scientist @UWPsych. he/they. https://t.co/TI4yjMJIfR.
Masoud @linguistMasoud
6K Followers 2K Following Assistant Professor @UCDavis researching language, logic, and learning in humans & sometimes machines
Ev (like in 'evidence.. @ev_fedorenko
13K Followers 3K Following I study language using tools from cognitive science and neuroscience. I also like snuggles. @evfedorenko.bsky.social
Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.social
Cory Shain (coryshain.. @coryshain
2K Followers 745 Following Language in minds, brains, and machines. Postdoc, BCS@MIT. Faculty, Linguistics@Stanford (fall 2024). He/him. https://t.co/U9ulwMUitL
Anna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/her
Ryan David Cotterell @ryandcotterell
9K Followers 1K Following
Roger Levy @roger_p_levy
4K Followers 403 Following @rplevy.bsky.social @[email protected] Director, MIT Computational Psycholinguistics Lab. President-Elect, Cognitive Science Society. He.
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Aniello De Santo @ani.. @AnyDs
1K Followers 1K Following The mystery of the Universe is its comprehensibility. he\him. Not really here anymore, email or find me on the sky app. (pfp cc. Dustin Nguyen).
Yuhan Zhang @YuhanZhang_
404 Followers 380 Following Ph.D. student in Linguistics at Harvard University;
Yevgeni Berzak @whylikethis_
903 Followers 564 Following Assistant Prof. at the Technion. Research Affiliate at MIT BCS. Computational Psycholinguistics, Cognitive Science and NLP. https://t.co/22eYN1gc0V
Leshem Choshen 🤖�.. @LChoshen
4K Followers 547 Following 🥇 Collaborative LLMs 🥈 Opinionatedly sharing #ML & #NLP 🥉 Propagating us underdogs we owe science an alternative hype @IBMResearch & @MIT_CSAIL
Noga Zaslavsky @NogaZaslavsky
1K Followers 692 Following Computational cognitive scientist, developing integrative models of language, perception, and action. Asst Prof @UCIrvine, previously postdoc @MIT
Say Young Kim @SayYoung_Kim
12 Followers 123 Following I have no middle name. Young Kim is not my last name. non-bilingual for bilingual research; swim lover but not swimming now
Tommy Botch @tommy_botch
213 Followers 367 Following
Lany Bu @BuLany0916
19 Followers 26 Following
Alexandra Pafford @ANPafford
20 Followers 199 Following Psychology Research MSc student at University of Amsterdam
Chengxu Zhuang @ChengxuZhuang
435 Followers 204 Following Make artificial intelligence models more human like! ICoN Postdoctoral Fellow at MIT. Previously Stanford PhD student @NeuroAILab.
daisyy18 @daisyyu95170330
6 Followers 101 Following
Reza Sheikhi @resheikhi
78 Followers 1K Following
Yasmin @YasminC_Ling
13 Followers 381 Following Language acquisition, computational modelling, the neurobiology of language. Aberdeen/London
Xu Chen @XuChen77939
12 Followers 48 Following
Carlos Hartmann @_smogshaik
42 Followers 166 Following Computational Linguist | Digital Archivist | Film Lover | SM64 Speedrunner | Pro Sleep | He interested in all things They
AJ @mathylinguist
9 Followers 60 Following here to dish thoughts so that IRL convos don’t have to hear them
Senaida Rosso @ros_senaid
67 Followers 5K Following
Eva Portelance @EvaPortelance
191 Followers 172 Following AI/Cognitive scientist interested in language learning and understanding. Incoming Assistant Professor in decision sciences @HEC_Montreal! She/Her
tushar madaan @webgeektushy
59 Followers 1K Following
Ke Lin @kelinguistics
49 Followers 97 Following PhD Student in Linguistics @Georgetown | #sociophonetics, sociolinguistic #variation, phonetic convergence|
Andreas Säuberli @_saeub
10 Followers 71 Following
Colton Casto @_coltoncasto
111 Followers 326 Following PhD student @Harvard @MIT - neuroscience, language, AI
Süheyda Basiç-Sarı.. @suheydabasic
118 Followers 290 Following psycholinguistics enthusiast • PhD candidate in Linguistics @AnkaraUni_en, Turkey • (she/her)
Yaqian (borogjoon) Ba.. @Borogjoon_
15 Followers 67 Following PhD student at Cognitive Science of Language @mac_readinglab, Mongolian girl who love Brain 🧠 and Grassland 🐎!
Nobody @hening_wang
30 Followers 114 Following
Devika Tiwari @DevikaTiwari5
3 Followers 16 Following
Roma Patel @996roma
2K Followers 506 Following research scientist @deepmind london. language & rl & interpretability & safety. phd @BrownUniversity '22 with ellie pavlick. (she/her)
Geoff V @IILearning
3K Followers 3K Following Educator. PhD (Year 2): Are We Out Of Our Minds? Regeneration as a theory of learning. Where is the homunculus? Views own. 🗺️🔭
Scarlett-rose Godinho @GodinhoSca71057
76 Followers 5K Following
Ruochen Zhang @ruochenz_
327 Followers 1K Following PhDing @BrownCSDept, working on multilingual NLP. Prev: Undergrad @sutdsg, she/her
Ceola Strayham @CeolaS2733
94 Followers 5K Following
Jason Geller @jgeller_phd
1K Followers 1K Following Cognitive Scientist | Word Nerd | Learning and Memory | Open Science| Pupillometry|Eye-tracking | Lecturer @princeton | Stats
Dota Tianai Dong @DotaDong
135 Followers 760 Following Phd student at @MPI_NL@Donders, working on multimodal semantic representations in 🖥️ and 🧠
Fangru Lin @FangruLin99
109 Followers 192 Following DPhil NLP student @UniofOxford; Clarendon Scholar; Ex SDE intern @Microsoft; Computational Linguist; know how and know why
ben @ben_woodward
321 Followers 312 Following
Yuhang Liu @JoyceLuckyLiu
0 Followers 34 Following
Dr. Candice Chi-Hang .. @CandiceCheung12
897 Followers 3K Following Guest researcher with the focus on #Autism Spectrum Disorders and #linguistics @AutismINSAR | @AutismScienceFd | @AutismEurope | @APA | @AAAS
Joana Rosselló ||*||.. @JoanaRossello
792 Followers 4K Following Linguist, UB. Syntax, speech/sign origins, comparative cognition, autism, schizophrenia, neurobiology of speech/sign. Mare de tres. Triatleta ;). Sea lover
Abhilasha Ravichander @lasha_nlp
3K Followers 2K Following Postdoc @allen_ai, working on Natural Language Processing (#NLProc) | PhD @SCSatCMU @LTIatCMU | Friend of @NLPWithFriends | @[email protected]
Christine Donez @ChristineD31503
97 Followers 5K Following
Candace Ross @candacerossio
2K Followers 2K Following currently postdoc at Facebook AI @MetaAI, formerly PhD student at MIT @MIT_CSAIL | she/hers
flying @FlyingKid16
10 Followers 601 Following
Verna Dankers @vernadankers
530 Followers 200 Following PhD student in #NLProc 🇳🇱 👩💻 🏴@Edin_CDT_NLP. interpretability x figurative language processing x compositional generalisation. she/her
Tal Linzen @tallinzen
16K Followers 894 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Fernanda Ferreira @fernandaedi
7K Followers 1K Following Psycholinguist at UCDavis, feminist, social democrat, runner, cycling advocate. Made in Portugal, raised in Canada, living and working in California.
Christopher Potts @ChrisGPotts
11K Followers 620 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science, and member of @stanfordnlp and @StanfordAILab. He/Him/His.
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Tiwa Eisape @tiwa_eisape
1K Followers 1K Following PhD student at @MIT working on NLP and cognitive science - @NSF grfp fellow. Previously with @GoogleAI and @Meta FAIR
Najoung Kim 🫠 @najoungkim
2K Followers 493 Following At @BULinguistics and visiting @GoogleAI part-time. 🤖🔠🐱
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Robert Hawkins @hawkrobe
3K Followers 1K Following computational cognitive scientist @UWPsych. he/they. https://t.co/TI4yjMJIfR.
Masoud @linguistMasoud
6K Followers 2K Following Assistant Professor @UCDavis researching language, logic, and learning in humans & sometimes machines
Ev (like in 'evidence.. @ev_fedorenko
13K Followers 3K Following I study language using tools from cognitive science and neuroscience. I also like snuggles. @evfedorenko.bsky.social
Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.social
Cory Shain (coryshain.. @coryshain
2K Followers 745 Following Language in minds, brains, and machines. Postdoc, BCS@MIT. Faculty, Linguistics@Stanford (fall 2024). He/him. https://t.co/U9ulwMUitL
Jennifer Hu @_jennhu
2K Followers 97 Following Research Fellow at @Harvard and incoming Asst Prof at @JohnsHopkins interested in language, computation, and cognition. @jennhu.bsky.social
Anna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/her
Ryan David Cotterell @ryandcotterell
9K Followers 1K Following
Roger Levy @roger_p_levy
4K Followers 403 Following @rplevy.bsky.social @[email protected] Director, MIT Computational Psycholinguistics Lab. President-Elect, Cognitive Science Society. He.
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Christopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Aniello De Santo @ani.. @AnyDs
1K Followers 1K Following The mystery of the Universe is its comprehensibility. he\him. Not really here anymore, email or find me on the sky app. (pfp cc. Dustin Nguyen).
Marianne de Heer Kloo.. @mariannedhk
1K Followers 992 Following I'm a linguist in AI & CogSci 🧠👩💻🤷♀️ PhD student @ILLC_Amsterdam / @AmsterdamNLP 😃 @[email protected] 🐘 https://t.co/KVhclGzv1W 🟦
Lee Fang @lhfang
320K Followers 3K Following Independent Journalist. Reporting primarily on Substack via https://t.co/HRdowb0oxD Contributing Editor at @Unherd Contact via Signal at (202) 394-9170
Gary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.
Isaac L. Bleaman @IsaacBleaman
337 Followers 210 Following Assistant Professor of Linguistics at UC Berkeley
Tommy Botch @tommy_botch
213 Followers 367 Following
S Sebag Montefiore @simonmontefiore
86K Followers 17K Following Historian.The World a Family History.Jerusalem: a History of the MiddleEast. StalinRedTsar. YgStalin. TheRomanovs. CatherinetheGreat. Novels: the Moscow Trilogy
Chengxu Zhuang @ChengxuZhuang
435 Followers 204 Following Make artificial intelligence models more human like! ICoN Postdoctoral Fellow at MIT. Previously Stanford PhD student @NeuroAILab.
Eva Portelance @EvaPortelance
191 Followers 172 Following AI/Cognitive scientist interested in language learning and understanding. Incoming Assistant Professor in decision sciences @HEC_Montreal! She/Her
Shabnam Behzad @Shabnam_Behzad
137 Followers 407 Following CS PhD Student @Georgetown. Interested in CL, NLP.
Tristan Thrush @TristanThrush
3K Followers 762 Following PhD-ing @StanfordAILab @stanfordnlp. Advisor @PlaytestAI. Past: @ContextualAI, @huggingface, @Meta FAIR, @mitbrainandcog, @MIT_CSAIL, @NASAJPL
Ke Lin @kelinguistics
49 Followers 97 Following PhD Student in Linguistics @Georgetown | #sociophonetics, sociolinguistic #variation, phonetic convergence|
David Samuel @davidsamuelcz
218 Followers 112 Following PhD student at University of Oslo, Language Technology Group. Interested in small and efficient language models.
Jason Geller @jgeller_phd
1K Followers 1K Following Cognitive Scientist | Word Nerd | Learning and Memory | Open Science| Pupillometry|Eye-tracking | Lecturer @princeton | Stats
Candace Ross @candacerossio
2K Followers 2K Following currently postdoc at Facebook AI @MetaAI, formerly PhD student at MIT @MIT_CSAIL | she/hers
Maayan Keshev @MKeshev
799 Followers 618 Following Assistant professor at the Hebrew University of Jerusalem. Interested in syntactic processing and sewing. She/her
Elliott Ash @ellliottt
5K Followers 3K Following Prof @ETH Zurich: Law, Economics, and Data Science; @cepr_org affiliate (PE). Previously @warwickecon, @PrincetonSPIA, @columbia_econ, @ColumbiaLaw, @UTAustin.
Michael Hu @michahu8
263 Followers 291 Following PhD student @NYU. NLP & training data. @NSF GRFP fellow. Previously @princeton_nlp, @cocosci_lab.
Zoey Liu @zoeyliu_18
231 Followers 801 Following Typology, Multilingual NLP and Equality of language technologies | Food too | Professorship is my hobby @UFLinguistics
Jacob Luber @JacobLuber
511 Followers 552 Following Asst. Prof of CS; BioE + Bio by courtesy @utarlington @mavengineering | @CPRITTexas Scholar in Cancer Research | @theNCI @BIG_Harvard_PhD @Trinity_U alum
Sachin Kumar @shocheen
955 Followers 636 Following Incoming Asst. Prof. at @OhioStateCSE ('24). Postdoc at @allen_ai. Visiting @UWNLP. Ph.D. from @LTICMU. He/Him. Taking new students this cycle, reach out!
Andrew Lampinen @AndrewLampinen
7K Followers 1K Following Interested in cognition and artificial intelligence. Research Scientist @DeepMind. Previously cognitive science @StanfordPsych. Tweets are mine.
Dima Brezhnev @dimabrez
174 Followers 1K Following Random stream on ML, tennis, history and other musings. ML Eng at Google, previously at Qualia and Stanford.
Tobias Gerstenberg @tobigerstenberg
4K Followers 867 Following Tea drinking assistant professor in cognitive psychology @Stanford.
Adam Poliak @azpoliak
1K Followers 1K Following Assistant Professor @BrynMawrCollege | PhD from @jhucompsci & @jhuclsp
Yujin Julia Jung @YJuliaJung
1K Followers 2K Following Incoming Assistant Professor in Political Science @MSMU; PhD Candidate @MizzouTSGPA; Research: Democracy, East Asia; Committee @OPUSinitiative, @PopulismTeam
Marcos Zampieri @marcos_zampieri
2K Followers 2K Following Tweeting about language and computing. #NLProc
McKenzie Andrews @mckandrews
110 Followers 529 Following MD/MPH student 👩🏻⚕️ @SUNYDownstate | STEM 👩🏻💻 educator 👩🏻🏫 | Do all the good you can | @stanford grad
Georgetown University.. @GUCompLing
392 Followers 38 Following Interdisciplinary group researching computational linguistics and NLP at Georgetown University
Georgetown Linguistic.. @GU_Linguistics
806 Followers 62 Following The Department of Linguistics @Georgetown
Georgetown University @Georgetown
85K Followers 1K Following #Georgetown is a major international, student-centered research institution in Washington DC and the country’s oldest #Catholic, #Jesuit university. #HoyaSaxa
Felicity Frinsel @FFrinsel
141 Followers 92 Following Cornell Ph.D. | Studying language learning and processing | Member of the @CSL_Lab | FiGLI | she/her
Morten H. Christianse.. @MH_Christiansen
4K Followers 298 Following Cognitive scientist interested in the processing, acquisition and evolution of language; statistical learning; computational modeling
maybe: leif weatherby @leifweatherby
3K Followers 2K Following i study the history of knowledge and try to make some of it too; bylines @nytimes, @BostonGlobe, @thenation, @jacobin; views not my own
Yifan Hou @yyyyyyyyifan
91 Followers 192 Following Hi! I'm a PhD student in the Department of Computer Science at ETH Zurich.
Tatsuya Aoyama @t_aoyam
19 Followers 72 Following Ph.D. student in Computational Linguistics @ Georgetown University
Gareth Roberts @garicgymro
5K Followers 4K Following Welsh linguist in Philadelphia. I grow languages in the lab. Opinions my own. He. Ieithydd o Gymro yn Philadelphia. Tyfaf ieithoedd yn y lab. Barnau fy hun. Fo.
alyssa loo @alyssamloo
81 Followers 212 Following 🇸🇬 | cs + linguistics undergrad @Brown_NLP | language model interpretability & probing human v. machine cognition
Ochieng Millicent @iam_OchiengM
731 Followers 826 Following Data & Applied Scientist at Microsoft Africa Research Institute (MARI)
Kai-Wei Chang @kaiwei_chang
6K Followers 711 Following Associate Professor @UCLAengineering/@UCLA. Area: #NLProc/#ML/#AI https://t.co/zj1ssZj9ox
José Eduardo Ochoa-L.. @eduardo_ol
154 Followers 346 Following AI scientist, Professor at the Department of Computer Science (@UCSP), Postgraduate Coordinator
Richard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
Amélie Thu Tâm Reym.. @amelie_reymond
75 Followers 154 Following computational linguistics @uw • compositional generalisation and multilingual nlp • she/her • 🩰📚🍵🍂
Nina Varsava @NinaVarsava
2K Followers 2K Following Professor @WisconsinLaw. JD @YaleLawSch, PhD @Stanford, MA @UBC, BA @ualberta. Procedure, Courts, Professional Responsibility, Jurisprudence. Climber. 🇨🇦
Katie Collins @katie_m_collins
1K Followers 1K Following Machine Learning PhD Student @Cambridge_Uni & Marshall Scholar | Student Researcher, @CambridgeMLG & @MITCoCoSci | @MIT '21 | Founder, @mitxharvard_wai
Ryan-Rhys Griffiths @Ryan__Rhys
5K Followers 4K Following Postdoc Researcher @Meta | PhD @Cambridge_Uni | ML4Science | Bayesian Optimisation | ex-@Mila_Quebec | ex-@Huawei | ex-@SecondmindLabs | Chess FIDE Master
Arturo Deza @ArtDeza
3K Followers 5K Following Assistant Professor in Computer Science @UTECuniversidad 🤖 • Founder & CEO @Artificio_Org 👁️ • Prev: NeuroAI @ MIT/Harvard/UCSB/UNI 🧠 • Peruviano 🇵🇪 •🦈
@EvelinaLeivada @alexandersclark @LanguageMIT @lexfridman This is a meta linguistic question. For goodness sake, I’m a language researcher and *I* have to think about what part of speech “array” is in that context. This type of knowledge has very little to do with actual use of language!
Training a bilingual model on two identical (cloned) languages with a 90/10 split yields better results *on both languages* than with a 50/50! It also leads to gradients and hidden states which are more aligned across languages. Interested? Check out @antonschafer's new paper!
LLMs can do amazing things these days—not only in their main language (English?), but also in other ones! Our paper identifies a surprising *potential* reason why: language imbalance! (see caveats in 🧵!) arxiv.org/pdf/2404.07982… + @ravfogel T. Hofmann @tpimentelms @ImanolSchlag
LLMs can do amazing things these days—not only in their main language (English?), but also in other ones! Our paper identifies a surprising *potential* reason why: language imbalance! (see caveats in 🧵!) arxiv.org/pdf/2404.07982… + @ravfogel T. Hofmann @tpimentelms @ImanolSchlag
I'm deeply honored to receive one of this year's @cogsci_soc Glushko Dissertation Prizes. While I'm still in a state of disbelief about the award, what I can say in no uncertain terms, is that developing these ideas with @rebecca_saxe has been immensely formative and rewarding.
The Cognitive Science Society is thrilled to announce the winners of the 2024 Glushko Dissertation Prize! 🏆 Let’s meet the brilliant minds behind groundbreaking research in Cognitive Science 🧵👇
✨🎓 I defended my dissertation “The Relationship between Linguistic Representations in Biological and Artificial Neural Networks” on Tuesday! 🎓✨ Incredibly grateful for my amazing PhD advisor @ev_fedorenko and a wonderful journey at @mitbrainandcog! 🧠🤖
I am incredibly honored to receive a Glushko Dissertation Prize! A huge thank-you goes to: - My dissertation advisors, @tallinzen and @paul_smolensky, for being incredibly supportive throughout my PhD - (continued in next tweet) 1/2
The Cognitive Science Society is thrilled to announce the winners of the 2024 Glushko Dissertation Prize! 🏆 Let’s meet the brilliant minds behind groundbreaking research in Cognitive Science 🧵👇
Happy to share that my latest work on the grounding capabilities of retrieval-augmented #LLMs was accepted as a findings paper at #NAACL2024! #NLProc
Some very cool recent work from @ChengxuZhuang on visually grounded language learning. Surprisingly, standard text/image repr learning gives great image reprs but doesn't change behavior much on language tasks---how can we use image data for better learning of *language*?
Two papers! Can visual grounding help LMs learn more efficiently? 1. We show that algs like CLIP don't learn language better (t.ly/eQHA9) 2. We then propose a new one, LexiContrastive Grounding, which does! (t.ly/KB818) Code: t.ly/C0wu- 🧵
Two papers! Can visual grounding help LMs learn more efficiently? 1. We show that algs like CLIP don't learn language better (t.ly/eQHA9) 2. We then propose a new one, LexiContrastive Grounding, which does! (t.ly/KB818) Code: t.ly/C0wu- 🧵
👶 BabyLM Challenge is back! Can you improve pretraining with a small data budget? BabyLMs for better LLMs & for understanding how humans learn from 100M words New: How vision affects learning Bring your own data Paper track babylm.github.io 🧵
New preprint w/ @mcxfrank: bit.ly/3VMdl2u How can we ascribe cognitive abilities to language models? We evaluate them! But evals impose challenges separate from the underlying ability of interest. These "task demands" affect LM performance, esp. for smaller models! 1/8
BIG NEWS: I will be joining the department of decision sciences of @HEC_Montreal as an Assistant Professor of machine learning this summer!! I'm excited to bring cognitive science and ML together at one of the best business schools around, and in my all time favorite city!
Particularly excited about this, @kanishkamisra's latest with me at UT, which uses my favorite little linguistic construction (“a beautiful five days”) to explore a more general problem, how a learner can come to know that something rare is grammatical. 🧵
🔑 🗝️ The Article+Adjective+Numeral+Noun (e.g., “a lovely five days”) construction is quite rare, and yet people and LMs know it’s grammatical. What is the key to learning such a rare construction? @kmahowald and I answer this question in the context of LMs in our new paper:
🔑 🗝️ The Article+Adjective+Numeral+Noun (e.g., “a lovely five days”) construction is quite rare, and yet people and LMs know it’s grammatical. What is the key to learning such a rare construction? @kmahowald and I answer this question in the context of LMs in our new paper:
Thanks to everyone who has engaged with our ideas over the past year to make the paper better and stronger! Glad to see the final published version out
Our paper on formal and functional competence in language models is now out in Trends in Cognitive Science! With co-lead @neuranna along with @IbanDlank, @Nancy_Kanwisher, Josh Tenenbaum and @ev_fedorenko. Paper: mahowak.github.io/assets/pdf/mah… Thread below. 1/n
The #UnImplicit workshop is on Thu, March 21, at #EACL2024! 🇲🇹 Our first fantastic keynote speaker (9:45 am) will be Alex Warstadt @a_stadt (#ETH) 🥳 Title: "What's the point? How relevance shapes language learning and inference in humans and machines” unimplicit2024.github.io/#
Uploaded the slides of today's talk (mainly about the NAACL paper) speakerdeck.com/kuribayashi4/c…
@weGotlieb @GUCompLing @complingy Congrats Ethan!! I'm so happy for you!!
Now out at #CerebralCortex - doi.org/10.1093/cercor… The same brain regions that perform high-level linguistic computations (lexical-semantics and compositional semantics and syntax)--also process sub-lexical phonological regularities.
Excited to share the first preprint from my postdoc! tinyurl.com/48z7uup5 We show that brain regions that process “high-level” meaning in language also process meaningless phoneme clusters, according to how much they respect linguistic phoneme-combinatorial constraints. 1/n
Trends for United States
You might like
