Kevin Du @kevdududu
nlp @ eth zurich Joined July 2023-
Tweets21
-
Followers70
-
Following45
-
Likes40
not me joining twitter on its deathbed to self-promote :p shoutout to my wonderful fun collaborators @ltorroba1 @niklas_stoehr @a_stadt and @ryandcotterell! and yes check out the vid :D youtu.be/SUTMeVdCuXs
not me joining twitter on its deathbed to self-promote :p shoutout to my wonderful fun collaborators @ltorroba1 @niklas_stoehr @a_stadt and @ryandcotterell! and yes check out the vid :D youtu.be/SUTMeVdCuXs
Viviana @Viviana75842443
2 Followers 161 Following
Dung Doan @dungdx34
201 Followers 5K Following
Trilok Padhi @trilokpadhi_
258 Followers 3K Following PhD student at @GeorgiaStateU | Computational Social Science | Graph Machine Learning | Knowledge Graphs | Ex-@Rakuten, @nvidia, @BoschGlobal
AI @hclilo
204 Followers 3K Following
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Abhilasha Sancheti @AbhilashaSanch2
274 Followers 484 Following PhD Candidate @umdcs | Adobe Research | IIT Guwahati
Daniel Hershcovich @daniel_hers
876 Followers 2K Following Assistant Professor @coastalcph @DIKU_Institut, University of Copenhagen. Interests: meaning, multiculturalism and promoting responsible behavior with #NLProc
Tony Yu Cao @yc6n13
109 Followers 317 Following Cloud/AI engineer, roboticist, open source, sustainable energy. prev RA @Edinburgh PhD @Southampton
Vésteinn Snæbjarnar.. @vesteinns
134 Followers 421 Following PhD fellow at @AiCentreDK @ELLISforEurope @DIKU_institut @BelongieLab • NLP & CV
Yuchen Eleanor Jiang @eleanorjiang630
3K Followers 338 Following CEO of AIWaves Inc., formerly PhD@ETH Zürich, ex-@Microsoft Research Asia, #NLProc #LLMs https://t.co/rQ0IKtSgSD
Nikhil Sharma @nikhilsksharma
232 Followers 617 Following Incoming PhD in HAI @JohnsHopkins | Information Seeking | Disinformation Agents | Copilots for Social Good | PhD @JHUCLSP @JHUMCEH #NLProc
Aaron Schein @AaronSchein
2K Followers 1K Following Asst Prof @DSI_UChicago & Stats l Previously: postdoc @DataSciColumbia, PhD @manningcics | research on ML, applied stats, social science
Jordan Gong @jordan__gong
42 Followers 2K Following
Meng Li @limengnlp
14 Followers 515 Following PhD student @unipotsdam, supervised by @davidschlangen. Working on NLP, ML and CogSci. Prev @LstSaar. Former NLP engineer.
Serhan Yilmaz @srhnylmz14
67 Followers 770 Following current junior cs undergrad @sabanciu & president/founder @kaisabanci // prev @EPFL @YapiKredi @BU_Tweets @kocuniversity // contact: dm
Vishala Mishra @vishala_mishra
272 Followers 3K Following Physician and Clinical Informaticist interested in using data for health equity.
Ashutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.
Ben (e/sqlite) @andersonbcdefg
3K Followers 3K Following 🤖 Computer scientist, next-word-prediction enjoyer 📊 Prev. research fellow @ Stanford RegLab 🛠️ bUiLdiNg sOmeThiNg nEw (https://t.co/mdYPZmjSzN - YC S23) 🏳️🌈
Zhengxuan Wu @ZhengxuanZenWu
778 Followers 539 Following goes by zen, CS Ph.D. student @stanfordnlp @StanfordAILab
Thyag Raj @bythyag
48 Followers 285 Following Avg. LLM lover, try to do research between classes, samosa is preferred, current: @iitdelhi
James Richards @jamesrichards2
267 Followers 588 Following Finding and funding exceptional people. Also, chess at @fourcornerclub.
Csordás Róbert @robert_csordas
542 Followers 356 Following Postdoc at Stanford working on systematic generalization and algorithmic reasoning. Ex IDSIA PhD, Ex @DeepMind intern.
Shootis @Shootis126055
25 Followers 425 Following
Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.
Alex Warstadt @a_stadt
1K Followers 452 Following Postdoc @ ETH Zürich | Future Asst Prof. @ UCSD | Former PhD @ NYU | computational linguistics, NLProc, CogSci, pragmatics | he/him 🏳️🌈
Nodens @NodensKoren
49 Followers 197 Following Machine Learning Researcher & Computational Astrophysicist. Aspiring Pianist. Studying gravitational waves and the universe using ML @ETH @CSatETH 😃
Andreas Opedal @OpedalAndreas
207 Followers 189 Following PhD student in NLP and Computational Linguistics at @ETH_en
Koyena Pal @kpal_koyena
159 Followers 125 Following Ph.D. Student @KhouryCollege | Interpretable AI + Data Science
Yoan Chabot @yoan_chabot
1K Followers 889 Following AI Researcher & Project Manager #KnowledgeGraphs #LLM #SemanticWeb @Orange Belfort Data&AI Division Tweets are my own.
Gavin Davis @gavinndavis
28 Followers 161 Following
Ruixiang Cui @ruixiangcui
271 Followers 454 Following final-year PhD Student at @coastalcph. ex-intern @MSFTResearch. ex-visitor @stanfordnlp. LLM eval, multilinguality, compositional generalization. he/they.
Butoi Alexandra @butoialexandra
134 Followers 209 Following PhD student at ETH Zürich focusing on NLP
Dirk Hovy @dirk_hovy
9K Followers 1K Following Prof @Unibocconi @MilaNLProc: #NLProc, compsocsci, #ML. #ERCStG INTEGRATOR Python NLProc books: https://t.co/vXm98Ns3D7 https://t.co/Ll7E6PDOKE
Josef Valvoda @ValvodaJosef
674 Followers 1K Following PhD candidate @CambridgeNLP group @Cambridge_Uni
Luca Malagutti @Malagutti_Luca
52 Followers 321 Following Provided 'as is' without warranties of any kind || CS MSc @ETH_en
Gianni Gastaldi @gian.. @gastaldi_gianni
233 Followers 593 Following Philosopher of (formal) sciences and CS/NLP researcher @ETH. President @HaPoComputing. Formerly Professor @mocontemporain, Philosophy @ENS_ULM
Duong Le @DuongLe54055716
97 Followers 146 Following Ph.D. candidate at GeorgiaTech. Working on Dialog system, Controllable text generation
Avishree Khare @Avishreekh
275 Followers 449 Following PhD Student @CIS_Penn | Prev @ProseMsft @GoogleIndia | CS'21 @BITSPilaniGoa
Piersilvio De Bartolo.. @pdebartols
249 Followers 974 Following PhD student @ETH in Computer Science.
Tiago Pimentel @tpimentelms
1K Followers 248 Following Postdoc at @ETH_en. Formerly, PhD student at @Cambridge_Uni.
Mario Giulianelli @glnmario
666 Followers 749 Following Postdoctoral Fellow @ETH_en. Previously PhD at @illc_amsterdam, @UvA_Amsterdam #Language #NLProc
Jennifer White @JenniferCWhite
370 Followers 163 Following PhD Student at the University of Cambridge working on NLP
Vésteinn Snæbjarnar.. @vesteinns
134 Followers 421 Following PhD fellow at @AiCentreDK @ELLISforEurope @DIKU_institut @BelongieLab • NLP & CV
Brigitte 🤗 @BrigitteTousi
2K Followers 2K Following Not an engineer @huggingface | Comms 🤗 | ex @Mila_Quebec | Aspiring 🍄 forager | She/Her/Elle
Csordás Róbert @robert_csordas
542 Followers 356 Following Postdoc at Stanford working on systematic generalization and algorithmic reasoning. Ex IDSIA PhD, Ex @DeepMind intern.
main @main_horse
8K Followers 477 Following AGI Believer. Haven't applied @OpenAI. Likes are not always endorsement.
Shayne Longpre @ShayneRedford
4K Followers 998 Following PhD @MIT. Prev: @Google Brain, @apple ML, @stanfordnlp. 🇨🇦 Interests: AI/ML/NLP, Data-centric AI, transparency & societal impact
Hanna Wallach (@hanna.. @hannawallach
22K Followers 944 Following Microsoft Research NYC. Fairness, accountability & transparency in AI/ML. NeurIPS & ICML board member, WiML co-founder, sloth enthusiast. She/her.
Brown NLP @Brown_NLP
3K Followers 144 Following Language Understanding and Representation Lab at Brown University. PI: Ellie Pavlick.
Koyena Pal @kpal_koyena
159 Followers 125 Following Ph.D. Student @KhouryCollege | Interpretable AI + Data Science
Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.
Been Kim @_beenkim
23K Followers 453 Following Research Scientist at Google DeepMind, PhD from MIT. Make machines empower people. @[email protected]
Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Michael Littman @mlittmancs
8K Followers 160 Following
Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
John Hewitt @johnhewtt
4K Followers 22 Following CS PhD @stanford with @stanfordnlp. Frmr. @penn, intern @deepmind, @googleai, ++. Understanding and improving neural learning from language. Co-teach CS 224n.
Gabriele Sarti @gsarti_
2K Followers 2K Following PhD Student @GroNLP 🐮, core dev of @InseqLib (https://t.co/tTjrg26ygQ). Interpretability ∩ HCI ∩ #NLProc. Prev: @AmazonScience, @Aindo_AI, @ItaliaNLP_Lab.
Xing Han Lu @xhluca
1K Followers 210 Following Tinkering with Conversational Web Agents @Mila_Quebec
Anej Svete @AnejSvete
125 Followers 85 Following PhD fellow at @ETH_en @ETH_AI_Center, supervised by @ryandcotterell and @val_boeva. Working on understanding language models through formal language theory.
Leonie Weissweiler @LAWeissweiler
790 Followers 314 Following Visiting Researcher with @adelegoldberg1 at @Princeton | prev. @cislmu @LTIatCMU @CambridgeLTL
Guy Aglionby @guyaglionby
439 Followers 941 Following NLP @ Biographica, working on sustainable agriculture | Finalising PhD @cambridgenlp
Gianni Gastaldi @gian.. @gastaldi_gianni
233 Followers 593 Following Philosopher of (formal) sciences and CS/NLP researcher @ETH. President @HaPoComputing. Formerly Professor @mocontemporain, Philosophy @ENS_ULM
Luca Malagutti @Malagutti_Luca
52 Followers 321 Following Provided 'as is' without warranties of any kind || CS MSc @ETH_en
Josef Valvoda @ValvodaJosef
674 Followers 1K Following PhD candidate @CambridgeNLP group @Cambridge_Uni
Butoi Alexandra @butoialexandra
134 Followers 209 Following PhD student at ETH Zürich focusing on NLP
David Bau @davidbau
3K Followers 241 Following Computer Science Professor at Northeastern, Ex-Googler. Believes AI should be transparent. @[email protected] @davidbau.bsky.social https://t.co/wmP5LUZRTw
Gavin Davis @gavinndavis
28 Followers 161 Following
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Alona Fyshe (she/her) @alonamarie
2K Followers 1K Following ML + language + neuroscience. Associate prof UofAlberta CS/Psych. Opinions are my own. (she/her) @[email protected] on mastadon
Alessandro Stolfo @alesstolfo
677 Followers 399 Following PhD Student @ ETH Zürich in #NLProc | Prev. @oracle Labs
Ethan Gotlieb Wilcox @weGotlieb
921 Followers 415 Following Postdoc at ETH Zurich. Formerly PhD student at Harvard Linguistics, affiliated with MIT Brain & Cog Sci. Language, Computers, Cognition.
Eleanor Chodroff @echodroff
2K Followers 997 Following @snsf_ch PRIMA assistant professor at @cl_uzh. Views my own. She/her. @[email protected]
Karolina Stanczak @karstanczak
515 Followers 446 Following NLP & ML PhD candidate @uni_copenhagen @CopeNLU
Niklas Stoehr @niklas_stoehr
799 Followers 754 Following PhD student @ETH advised by @RyanDCotterell, @Cervisiarius and @AaronSchein ⭕️ Language Model Interpretability and Application ⭕️ @GoogleAI, @TechAtBloomberg
Yonatan Belinkov @boknilev
4K Followers 1K Following Assistant professor of computer science @TechnionLive. #NLProc
Junhao Wang @wjhtomwjh
126 Followers 431 Following Bing Chat, then LLM + Embedding Search, now Diffusion
George Ho @_eigenfoo
1K Followers 740 Following Natural language processing, Bayesian modeling, open source, crosswords, donuts and coffee. Currently ML at @flatironhealth (he/him/his)
Chaya Wurman @ChayaWurman
23 Followers 123 Following
Ryan David Cotterell @ryandcotterell
9K Followers 1K FollowingCan Large Language Models Understand ‘Meaning’? youtu.be/6iO8TtCs_Cw?si… via @YouTube
LLMs can do amazing things these days—not only in their main language (English?), but also in other ones! Our paper identifies a surprising *potential* reason why: language imbalance! (see caveats in 🧵!) arxiv.org/pdf/2404.07982… + @ravfogel T. Hofmann @tpimentelms @ImanolSchlag
Did you know that most LLM’s vocabularies contain around 40% near duplicate entries? Check out our new work to learn more about how this may affect your model’s training efficiency! arxiv.org/abs/2404.06508 (details in thread) with T. Hofmann @ImanolSchlag @tpimentelms
@kevdududu @vesteinns @niklas_stoehr @JenniferCWhite @AaronSchein @ryandcotterell Yep, both RLHF (PPO) and RL free (DPO) methods can useful given good signal as preference pairs. Looking forward to your future research 🤠
@kevdududu @vesteinns @niklas_stoehr @JenniferCWhite @AaronSchein @ryandcotterell i like the math color coding you guys are doing now
The new collection is now online and at boutiques. #VersaceEyewear
New paper and library! 🫡 Intervening on internal states has emerged as a fundamental operation for analyzing and improving neural models. We release pyvene, a library for performing interventions and sharing intervened models. 👉Code & Paper: github.com/stanfordnlp/py…
🔔🌟 New Preprint Alert 🔔🌟 “An Information-Theoretic Analysis of Targeted Regressions during Reading” with @tpimentelms , @clara__meister , @ryandcotterell - Psycholinguistics 🧠 Computational Modeling 🤖 Crosslinguistic Studies 🌍 Information Theory 📡 osf.io/preprints/psya…
Massive congrats to @karstanczak for passing her PhD defence with flying colours! 🎊🥂🥳 Very proud of you 🤗🥹 Thanks to @SergeBelongie @pascalefung @licwu for serving on the committee. Karolina’s thesis on multilingual gender bias probing: di.ku.dk/english/resear… #NLProc
LLMs are now trained >1000x as much language data as a child, so what happens when you train a "BabyLM" on just 100M words? The proceedings of the BabyLM Challenge are now out along with our summary of key findings from 31 submissions: aclanthology.org/volumes/2023.c… Some highlights 🧵
Compositional generalization is a major challenge for neural networks. In a #NeurIPS2023 spotlight paper with @tserre and @Brown_NLP, we ask whether neural networks learn the types of representations that are a prerequisite for compositionality! (1/14)
I'm in Singapore, attending EMNLP, presenting BabyLM, and trying the local durian. Also, bc many have asked, I guess this is as good a time as any to announce I will be starting as an Asst. Prof at @UCSanDiego in data science @HDSIUCSD and linguistics in Jan 2025! Come say hi!
First durian in Singapore! Did I like it?......I'm still deciding.
❓Does language shape thought❓ We offer a casual take on the neo-Whorfian hypothesis, which suggests that the grammatical gender of nouns influences their perception. Check out: arxiv.org/abs/2311.18567 w/ @kevdududu @adinamwilliams @IAugenstein @ryandcotterell #NLProc
Accepted at EMNLP: LLMs often have to integrate information in context with facts learned during pretraining. Sometimes these facts disagree, so how do they handle this competition? We find that we can modulate single attention heads to control which version to use!
#LLMs are trained to predict the next word. But we found that they are overachievers! When GPT-J is busy predicting the next word, our Future Lens (future.baulab.info) sees that it's already thinking several words ahead – see "Back to the Future" below... #CoNLL2023 🧵 1/8
My student Koyena @kpal_koyena has a really fascinating paper on arXiv today. Looking at a single hidden state, her Future Lens can see what the transformer is planning, several tokens ahead. It makes reading the internal states much more intuitive! See her poster at #CoNLL2023
#LLMs are trained to predict the next word. But we found that they are overachievers! When GPT-J is busy predicting the next word, our Future Lens (future.baulab.info) sees that it's already thinking several words ahead – see "Back to the Future" below... #CoNLL2023 🧵 1/8
I had an idea for a book, wrote a proposal, negotiated with publishers, signed a contract, wrote a draft, worked with an editor, got peer reviewed, arranged for image rights, edited the index, folded in copyeditting feedback, waited a little longer, and POOF, it's real! Magic!
@kevdududu @LTorroba1 @ryandcotterell @LTorroba @niklas_stoehr @a_stadt Sure, would be happy to help. However the biggest issue is just always going to be that these semirings are just really slow on GPU. There isn't native support for max-sum matmul.
@ryandcotterell So wonderful to see more Fulbrighters working in NLP&ML (IMHO, NLP&ML are still uncommon areas among Fulbright scholars... BUT! Those whom I know are great researchers😀)!
Trends for United States
You might like
