Paul Michel @pmichelX
Research Scientist @DeepMind working on LLMs. Previously postdoc @ENS_ULM and PhD @LTIatCMU pmichel31415.github.io London Joined October 2014-
Tweets248
-
Followers1K
-
Following52
-
Likes471
Very happy to finally be able to share what I've been up to in the last couple months #Gemini. Working on these models (mainly pre-training data) was an amazing experience. Blog: blog.google/technology/ai/… Tech report: storage.googleapis.com/deepmind-media…
I will be at #ICLR2023 in Kigali this week! Feel free to reach out if you'd like to chat/catch up. These days I'm working mostly on LLMs but happy to talk about emergent communication, NLP or anything really :)
How is AI helping conserve wildlife? 🦁 Using machine learning, researchers can track fragile species in the Serengeti - one of the world’s most diverse ecosystems. Join @FryRsquared on a virtual safari in our podcast to find out more: dpmd.ai/3y7A5gf #WorldWildlifeDay
Classic ML approaches to solving limited data tasks include introducing (1) external data (2) larger pre-trained models (3) task specific modeling techniques. In our #ICLR2023 paper (arxiv.org/abs/2205.14082), we present AANG, a novel, automated transfer learning axis [1/n]
🎷 I'll attend @NeurIPSConf this week to present our work "Emergent Communication: Generalization and Overfitting in Lewis Games" ! If you're interested, drop by the Poster Session 5 on Thu 1 Dec - Hall J #713. 🗞️Paper: arxiv.org/pdf/2209.15342… 🧵Thread: x.com/mathieu_rita/s…
🎷 I'll attend @NeurIPSConf this week to present our work "Emergent Communication: Generalization and Overfitting in Lewis Games" ! If you're interested, drop by the Poster Session 5 on Thu 1 Dec - Hall J #713. 🗞️Paper: arxiv.org/pdf/2209.15342… 🧵Thread: x.com/mathieu_rita/s… https://t.co/goVnkXhQc7
Check out @Mathieu_Rita 's paper if you want some really cool insight into emergent communication referential games
Check out @Mathieu_Rita 's paper if you want some really cool insight into emergent communication referential games
I am glad to announce that we will present our last paper: « Emergent communication: Generalization and Overfitting in Lewis Games » has been accepted to #NeurIPS2022 🎷🎷. with C.Tallec, @pmichelX , JB.Grill, O.Pietquin, E.Dupoux & F.Strub. 🖱️arxiv.org/pdf/2209.15342… 🧵1/13
Intern applications at @DeepMind for the 2023 calendar year open this Friday, September 16th! 📣 Feel free to contact me or others for info, be ready to apply, and please share with your network!
I'll be at ACL @aclmeeting in Dublin this week 🍀 If you want to have a chat, please reach out! Looking forward to catching up with people and seeing new faces :)
Some personal news: I'm happy to share that in July I will be joining @DeepMind as a Research Scientist in London!
Here goes my bimonthly iteration of googling "insofar vs inasmuch"
Are you interested in how cognitive sciences and machine learning can learn from one another? Check out this monthly seminar on "speech acquisition in humans and machines" organized by people in my lab!
Are you interested in how cognitive sciences and machine learning can learn from one another? Check out this monthly seminar on "speech acquisition in humans and machines" organized by people in my lab!
Great thread by @derylucio about his recent #iclr2022 paper. Awesome work Lucio!
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingGraham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Shruti Rijhwani @shrutirij
4K Followers 499 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from @LTIatCMU * Amateur woodworker, scuba diver, foosball playerKayo Yin @kayo_yin
8K Followers 560 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Gabriel Peyré @gabrielpeyre
92K Followers 449 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.Divyansh Kaushik @dkaushik96
4K Followers 3K Following Emerging tech and national security. DC/PGH. “An imported Indian immigrant,” @BreitbartNews.Siddharth Dalmia @siddalmia05
1K Followers 445 Following Research Scientist @GoogleDeepmind | #SpeechProc and #NLProc | PhD from @LTIatCMU @SCSatCMU | Ex-intern @GoogleAI, @AWSCloud, @FacebookAImerve @mervenoyann
56K Followers 4K Following open-sourceress at @huggingface 🧙🏻♀️ proud mediterrenean 🍋 I do TL;DR on ML papersThomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceAntonis Anastasopoulo.. @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.Shaily @shaily99
5K Followers 2K Following PhD @LTIatCMU Prev: @GoogleAI @MSFTResearch. Working on ethics and evaluation in #NLProc. Usually ranting, often about research & DEI. 📚 @readsndrantsLeo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Wenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.Sebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Ofir Press 🖋 @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpressmhdirnjbr @madiranjbar
26 Followers 101 Followingsuper intelligence @eacc72
12 Followers 688 Following GPT6 is a Level 2 AGI and will be released in 2025Aaditya ; @Aaditya26082004
535 Followers 7K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈Serhan Yilmaz @srhnylmz14
66 Followers 776 Following current junior cs undergrad @sabanciu & president/founder @kaisabanci // prev @EPFL @YapiKredi @BU_Tweets @kocuniversity // contact: dmDevr Inc. @DevrOfficial
246 Followers 5K Following Devr is a new Internet protocol for the governance of decentralized privacy networks (DPN), powering a new era for data sharing economiesSlathay @Slathay18365
78 Followers 621 FollowingYassine Yassif @yassineyassif
15 Followers 318 Following Start daydreaming, just to have something by the end of the night ;)Guodong Zhang @Guodzh
24K Followers 418 Following Train, tune and align LLMs “good” @xai. Previously Gemini @GoogleDeepMind and PhD @UofT.Chuckles @CSNalley
83 Followers 91 FollowingJacob Austin @jacobaustin132
3K Followers 801 Following @Google @DeepMind researcher. AI for math and science. Coding. Gemini. I also play piano. NYC. Opinions my ownJoost van Amersfoort @joost_v_amersf
1K Followers 338 Following Research Scientist @GoogleDeepMind -- PhD from @UniofOxford Large language model pre-training in the Gemini team.mk @krb_mk
27 Followers 800 FollowingThomas Paes @thpaes
63 Followers 2K FollowingThomas Capelle @capetorch
3K Followers 946 Following Chilean 🇨🇱 living in France. I build DL models and pipelines. ML Engineer at @weights_biases cargobike ♥🚴🇺🇦 Alex Polozov @Skiminok
4K Followers 698 Following Sr. Staff Research Scientist @Google • ex- @Theteamatx, @MSFTResearch, @uwcse • program synthesis, deep learning, AI4Code • he/him • @[email protected]Behzad @bg01shan
796 Followers 836 Following Building stuff @Google || Working on AI, LLMs & the inevitable 🤖 uprising || 🎶 theory enthusiast || @ACMilan fan 🔴⚫️ Opinions are not my own. Don't sue me!Varun Godbole @VarunGodbole
266 Followers 624 Following Software engineer at @GoogleDeepMind. Working on Gemini.Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.The Data Therapist @yuvalmarton
1K Followers 2K Following Computational Linguist, NLP/NLU/AI Research Scientist, Affil. Assistant Professor, tech mentor, corporate emp. Political in sep acnt. Not my employer’s opinionsSanaz Bahargam (Sanaz.. @SanazBahargam
2K Followers 601 Following @Google Gemini Scientist @AmazonLab126 (LLM) MLE @Twitter Adjunct faculty @FollowStevens Researcher @128technology @JuniperNetworks PhD (ML) @ https://t.co/Anzyzl4ebWGodGPT @GodGPT88
253 Followers 3K Following Founder and CEO of GodGPT,AGI,Robot,e/acc,super-LOVE-alignmentRogan Inglis @RoganInglis
38 Followers 567 Following Co-Founder / Senior Machine Learning Engineer at IntelistyleGanesh @buzzganesh
167 Followers 639 FollowingPerry @kosh516
279 Followers 3K FollowingMyron @myrondza10
40 Followers 2K Following Data Scientist 🧠😍✨ Game-changing AI is here! | ML / AI + Neuroscience + Roboticsnick nassuphis @NNassuphis
121 Followers 5K FollowingBITCOIN ULTRA (bitcoi.. @Jan_NiklasKoe
639 Followers 2K Following since Nov 2015 (trained chef) Bitcoin-Aristokratie Pronomen: Stack/SatsMichela Paganini @WonderMicky
7K Followers 2K Following Staff Research Scientist @DeepMind | LLMs, Evals & Model Understanding | Previously: @facebookAI | @Yale Physics PhD | @CERN | @BerkeleyLab | @UCBerkeleyZachary Nado @zacharynado
5K Followers 648 Following Research engineer @googlebrain. Past: software intern @SpaceX, ugrad researcher in @tserre lab @BrownUniversity. All opinions my own.arc @addravi
69 Followers 1K FollowingKelvin Xu @imkelvinxu
770 Followers 701 Following Technically a member of staff at Google DeepMind working on large scale pre-training of sparse models. Interested in things that generalize.Ulva @tanedast93447
101 Followers 2K FollowingAnna McCann @AnnaMcCann1995
20 Followers 145 Following PhD Student @EPFL_en Biomedical Signal Analysismoon @cnoedred
97 Followers 640 Following郝韵焯 @zouhynu
1 Followers 9 FollowingHassan Khatoonabadi @HKhatoonabadi
370 Followers 930 Following Data Scientist by Passion and Profession | Postdoc @CREATE_SE4AI @DASLabConcordia | Bridging Software Engineering, Empirical Research, and Machine Learning 🇨🇦Emilio Almazan @ealmazanm
58 Followers 272 Following Post doctoral researcher in #computervision. Working in 3D reconstruction and calibration with the #Kinect sensor. 3D #tracking #OpenCV, #Matlab, #OpenNI(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingGraham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Shruti Rijhwani @shrutirij
4K Followers 499 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from @LTIatCMU * Amateur woodworker, scuba diver, foosball playerSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzGoogle DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Gabriel Peyré @gabrielpeyre
92K Followers 449 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.Felix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sNaomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Andrew Lampinen @AndrewLampinen
7K Followers 1K Following Interested in cognition and artificial intelligence. Research Scientist @DeepMind. Previously cognitive science @StanfordPsych. Tweets are mine.Hieu Pham @hyhieu226
2K Followers 41 Following Making GPUs go brrrr @augmentcode 🤖 Past: Research Scientist at Google Brain 🧠 IMO Silver Medalist 🥈 waiting for LLMs to beat me. Tweets are my own opinions.Laura Graesser @lgraesser3
954 Followers 532 Following Learning about robots learning. Researcher, Robotics at Google DeepMind. Co-author of Foundations of Deep Reinforcement Learning. https://t.co/JgfxI9VJAhNix Illustration @nixillustration
1K Followers 0 Following Paleontology and science illustration, and feathering ALL the dinosaurs. https://t.co/cIblRng2O2Yejin Choi @YejinChoinka
19K Followers 330 Following professor at UW, director at AI2, adventurer at heartTom McCoy @RTomMcCoy
3K Followers 483 Following Assistant professor @YaleLinguistics. Studying computational linguistics, cognitive science, and AI. He/him.Aida Nematzadeh @aidanematzadeh
2K Followers 261 Following Research scientist at @DeepMind. She/her.Raphaël Millière @raphaelmilliere
10K Followers 2K Following Philosopher of Artificial Intelligence & Cog Science @Macquarie_Uni Past @Columbia @UniofOxford Also on other platforms Blog: https://t.co/2hJjfSid4ZStephanie Chan @scychan_brains
3K Followers 2K Following Senior Research Scientist at DeepMind. Artificial and biological brains 🤖 🧠 Views are my ownAdele Goldberg @adelegoldberg1
7K Followers 2K Following Linguist, experimentalist, constructionist usage-based approach to language (she's)Carnegie Museum of Na.. @CarnegieMNH
12K Followers 886 Following There's always more to explore at Carnegie Museum of Natural History! Follow us to see real dinosaur fossils, gems, birds, and more. Home of @Dippy_the_dino.Dani Yogatama @DaniYogatama
4K Followers 196 Following CEO @RekaAILabs, Associate Professor @CSatUSCTatsunori Hashimoto @tatsu_hashimoto
6K Followers 202 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.Karl Tuyls @karl_tuyls
2K Followers 334 Following Ex: team lead @ DeepMind,@GoogleDeepMind - still working on AGI in a Multi-Agent world. CS professor (Liverpool/Leuven) and LFC fan.ICLR 2024 @iclr_conf
41K Followers 40 Following International Conference on Learning Representations #ICLR2024. SPC is @yisongyue and GC is @_beenkim OpenReview:https://t.co/OD1sg0r7F8ML@CMU @mlcmublog
2K Followers 16 Following Official twitter account for the ML@CMU blog @mldcmu @SCSatCMUL💭 @lifevacationist
281 Followers 358 Followinggalvanize (gail weiss.. @gail_w
1K Followers 329 Following Trying to get off of here, dms checked rarely. Better to send an email postdoc at EPFL, understanding neural networks. https://t.co/lnaKoR7vmc .ACL 2024 @aclmeeting
18K Followers 35 Following Association for Computational Linguistics | ACL 2024 conference | The 62nd Annual Meeting of the ACL Hashtags: #NLProc #ACL2024NLPJad Kabbara @jad_kabbara
1K Followers 731 Following NLP Postdoc @MIT Center for Constructive Communication (CCC). PhD from McGill University @rllabmcgill & @Mila_Quebec. @AUB_Lebanon alum.Matt Post @mjpost
2K Followers 2K Following Machine translation research for big tech and big academia and director of the @aclanthology. Tweets here are mostly personal.Djamé.. @zehavoc
6K Followers 3K Following Associate professor in NLP, engaged citizen. Tweeting about work, life and stuffs that I care about. All my tweets can be used freely. Personal account.roeeaharoni @roeeaharoni
2K Followers 758 Following Research Scientist @GoogleAI Tel-Aviv | Phd @BIUNLP LabKartikay Khandelwal @kakemeister
588 Followers 588 Following AI @MetaAI and @PyTorch. Previously @Stanford and @Microsoft.Samridhi Choudhary @samridhishree
438 Followers 776 Following Senior Scientist for Generative AI and Foundation Models @Amazon.Chris Dyer @redpony
11K Followers 1K Following i live in Angel, London. I am a researcher at DeepMind. I play the cello. 𒌓𒈪𒊭𒄠𒋗 𒆪𒌦𒄭𒁺 𒌓 𒌨𒊑𒅇𒈬𒅆𒋢𒌨𒅇𒈨𒇷𒅍NAACL HLT 2024 @naaclmeeting
8K Followers 50 Following The official account of the Annual Conference of the North American Chapter of the Association for Computational Linguistics.RIP @R_I_P_bot
20 Followers 0 Following Reddit Iambic Pentameters. 🤖Bleep blop! 🤖I'm a bot tweeting iambic pentameters found in reddit comments. I tweet verses every 2 hours and quatrains every 3hJason Eisner @adveisner
8K Followers 547 Following Professor of CS at Johns Hopkins University, Director of Research at Microsoft Semantic Machines, ACL Fellow. My tweets speak only for me.CambridgeNLP @cambridgenlp
9K Followers 196 Following The #NLP/#NLProc/#ML research group in the University of Cambridge, Computer Science department. Account managed by @Eric_chamoun, @richarddm1EdinburghNLP @EdinburghNLP
11K Followers 139 Following The Natural Language Processing Group at the University of EdinburghKris Cao @kroscoo
1K Followers 647 Following When lava pours out near the sea's surface tremendous volcanic explosions sometimes occur | Research scientist @DeepMind working on languageRuss Salakhutdinov @rsalakhu
100K Followers 140 Following UPMC Professor of Computer Science at Carnegie Mellon University, ex-Director of AI research at @Apple, co-founder Perceptual Machines (acquired by Apple)Language Technologies.. @LTIatCMU
9K Followers 233 Following The Language Technologies Institute in Carnegie Mellon University's @SCSatCMUCMU Computer Science .. @CSDatCMU
8K Followers 843 Following CSD's mission @ Carnegie Mellon is to lead in computer science research & education, pushing the frontiers of the field, resulting in real world impact.Hoetre @HoetreX
22 Followers 109 Following CEO of TSNer (formerly TSN). Coached Wavingthunder at tft before it was cool.Carnegie Mellon Unive.. @CarnegieMellon
78K Followers 2K Following United by curiosity and driven by passion, we reach across disciplines, forge new ground and deploy our expertise to make real change that benefits humankind.CMU School of Compute.. @SCSatCMU
47K Followers 780 Following The School of Computer Science at @carnegiemellon is one of the world's premier institutions for computer science research and education.Fondation de l'École.. @FX_EP
2K Followers 1K Following Créée en 1987 et reconnue d'utilité publique, la Fondation de l'X œuvre en faveur du développement de l'École @polytechnique.Kès - BdE Polytechni.. @Kes_Eleves
845 Followers 313 Following Alaskès - Kès des élèves de l’École polytechnique - Student Union from École polytechnique.Just this week multiple founders, engineers, and researchers I’ve talked to have noted that the narrative around AI here on Twitter is disconnected from the reality on the ground. Will be interesting to see the outcome of this.
I want to pause and say something personal. When I joined Augment, my life was difficult. Among many things, my son was just 4 months old. Let's just say that juggling a startup's work and a dad's responsibility is not my strength.
😓 Things that are frustrating about visiting Paris: Some of the AI-enabled features and models I want to test are getting blocked due to geographic restrictions. Coffee $/volume can be expensive. ❤️ Things that are delightful about visiting Paris: Literally everything else.
I am honored to receive the Apple Scholars in AIML fellowship! Very grateful to my advisor, mentors and collaborators along the way :) Excited to keep exploring the Pareto-frontier of capabilities and efficiency of foundation models!
Congrats to @xiamengzhou on receiving an Apple Scholars in AIML fellowship! 🎉🍏 The fellowship recognizes graduate students doing innovative and cutting-edge research in machine learning. Xia is part of @princeton_nlp, advised by @danqi_chen. bit.ly/3wZz78q
Crazy to think that when wearing Apple Vision Pro and AirPods Pro, your two most important senses, sight and hearing, are both being completely augmented by technology.
Gemini is Latin for "twins". The Gemini effort came about because we had different teams working on language modeling, and we knew we wanted to start to work together. The twins are the folks in the legacy Brain team (many from the PaLM/PaLM-2 effort) and the legacy DeepMind…
"mainly pre-training data" is key. #nlproc Algorithms, architectures and artefacts* (AAA) comes and go. Well-crafted datasets stand the test of time and can be re-used, recycled, re-invented when new AAA evolves. *Note: esp. in pure binary form w/o interpretable components
Very happy to finally be able to share what I've been up to in the last couple months #Gemini. Working on these models (mainly pre-training data) was an amazing experience. Blog: blog.google/technology/ai/… Tech report: storage.googleapis.com/deepmind-media…
Every time I’m on the overground and it goes through Kentish Town, I always think “yo why don’t you commit and go full Kent Town?”
@s8mb Castle drops are kind of unbeatable until you hit imperial age and can start getting the trebuchets out.
quoting data processing inequality when discussing synthetic data for LLMs is like bringing a knife to a gun fight theory-reductionists should approach with humility because theory has failed to predict any development in the last few decades
Life update: I recently left Meta, and we are starting Mistral.AI, a new AI company with @arthurmensch and @tlacroix6
Excited to share XTREME-UP, a benchmark dataset for NLP in under-represented languages!
With the rapid development of language technology, it’s important that as many languages as possible benefit from these technologies, so we’re sharing XTREME-UP, a benchmark for evaluating multilingual models. 📝goo.gle/xtreme-up-paper 💻github.com/google-researc… Read 🧵↓ (1/3)
Best feeling in the (Neural Network) world: loss is going down 📉 Happy Sunday!🌞
@pmichelX True -- my infancy was dominated by Dragon Ball and StarCraft, hard to choose!
Exciting energy for the @LTIatCMU large language model event! Come on out this weekend if you're around Pittsburgh and interested in LLMs cmu-lti-llm.org
How is AI helping conserve wildlife? 🦁 Using machine learning, researchers can track fragile species in the Serengeti - one of the world’s most diverse ecosystems. Join @FryRsquared on a virtual safari in our podcast to find out more: dpmd.ai/3y7A5gf #WorldWildlifeDay