Kenneth Heafield @zngu
Making language models fast since 2011. Research Scientist at Meta. neural.mt L3 cache Joined February 2009-
Tweets2K
-
Followers993
-
Following134
-
Likes69
There's a bug in Gemma's quantizer. It rounds 8.538074112 to 7.
0
1
18
2K
3
Why isn't base 2 the standard for softmax? It's equivalent to scaling the weights of the preceding matrix. And 2^ is a bitshift for integers or an easy approximation in float by moving the exponent to the mantissa. ieeexplore.ieee.org/document/10137… arxiv.org/pdf/2103.09301…
Kenneth Heafield retweeted
When I hear "I work in a startup inside a big company", I hear "I take on no monetary risk but I want you to know I still like the idea of doing work"
Mistral is a line of trash cans: mistral-ultra.com/products/trash/ cc @MistralAI
If people want to leak the data used on their company's LLMs, DM me for bittorrent.
If people want to leak the data used on their company's LLMs, DM me for bittorrent.
Language identification now in production at Wikipedia. The place where other people get their language identification training data from.
Language identification now in production at Wikipedia. The place where other people get their language identification training data from.
AI bias is actively discriminating at large scale in recruiting and customer service that companies like Cohere happily sell to. Meanwhile, they spread fear, uncertainty, and doubt about the ability to fine-tune an open model on 4chan that isn't deployed. x.com/sarahookr/stat…
AI bias is actively discriminating at large scale in recruiting and customer service that companies like Cohere happily sell to. Meanwhile, they spread fear, uncertainty, and doubt about the ability to fine-tune an open model on 4chan that isn't deployed. x.com/sarahookr/stat…
Local translation running in your browser. Text stays on your machine, preserving privacy. Chrome extension: chrome.google.com/webstore/detai… Firefox: update to 118, it's included. Contact us at private.mt for more languages, business use, customization, and terminology.
Update your Firefox to 118.0, get our translation systems mozilla.org/en-US/firefox/…
Coefficient-level sparsity was already mainly a way to proclaim FLOP reductions while actually running slower due to addressing and memory access overhead. Now the gather instruction is a lot slower on Intel! downfall.page
Hiring for an academic project with 🤯12 million GPU hours🤯 training large large language models and translation models. Come work on real open source without HuggingFace changing licenses on you! Apply now: elxw.fa.em3.oraclecloud.com/hcmUI/Candidat…
How many monthly active users did the United Nations have on the Llama 2 version release date?
🥱 wake me up when AMD's all-reduce scales to more than 128 nodes on LUMI
🥱 wake me up when AMD's all-reduce scales to more than 128 nodes on LUMI
Where is that infamous ja-en parallel data that can only be bought with a Japanese credit card? technomancers.ai/japan-goes-all…
Remember in 1999 when Apple marketed the Power Mac G4 as so powerful it was banned from export? edition.cnn.com/TECH/computing…
Remember in 1999 when Apple marketed the Power Mac G4 as so powerful it was banned from export? edition.cnn.com/TECH/computing…
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Marcin Junczys-Dowmun.. @marian_nmt
2K Followers 396 Following NLP. NMT. Main author of Marian NMT. Research Scientist at Microsoft Translator. Non-NLP silliness and stuff on @emjotde
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Ofir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.
Grzegorz Chrupała �.. @gchrupala
6K Followers 1K Following Associate Professor at Tilburg University Computational Linguistics • Machine Learning
Raj Dabre @prajdabre1
3K Followers 751 Following NLP/Machine Translation/NLG/Deep Learning. Researcher-@NICT_Publicity. Adjunct Faculty-@iitmadras. Visiting Professor-@iitbombay. Ex-@KyotoU_News. #nlproc
Pasquale Minervini �.. @PMinervini
7K Followers 4K Following Researcher in ML/NLP at the University of Edinburgh (faculty @InfAtEd @EdinburghNLP), @ELLISforEurope, @UCL_NLP, PI for @Clarify2020, https://t.co/WydvfU8ugz he/they
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Leon Derczynski ✍�.. @LeonDerczynski
6K Followers 1K Following NLP/ML/language/security. Principal research scientist @NVIDIA, & Prof @ITUkbh. Views ostensibly professional. llmsec stan acct
Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.
Jindřich Libovický @jlibovicky
906 Followers 445 Following 🇨🇿 🇪🇺 Researcher at @ufal_cuni. Working on multilingual NLP and neural machine translation. Views my own. He/him
Kelly Marchisio (St. .. @cheeesio
1K Followers 558 Following Member of Technical Staff @cohere. Formerly: PhD @jhuclsp Alexa Fellow @amazon dev @Google MPhil @cambridgenlp EdM @hgse 🔑🔑¬🧀 (@kelvenmar20)
Antonis Anastasopoulo.. @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.
Mark Dredze @mdredze
4K Followers 786 Following John C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]
Vilém Zouhar @zouharvi
2K Followers 2K Following PhD student @ ETH Zürich | all aspects of #NLProc but mostly HCI, evaluation and MT | go #vegan
Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.social
Luca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/them
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Ashutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.
Ben (e/sqlite) @andersonbcdefg
3K Followers 3K Following 🤖 Computer scientist, next-word-prediction enjoyer 📊 Prev. research fellow @ Stanford RegLab 🛠️ bUiLdiNg sOmeThiNg nEw (https://t.co/mdYPZmjSzN - YC S23) 🏳️🌈
Eva Louise Marie Gabr.. @e681554349
9 Followers 3K Following
Arif Ahmad @arif_ahmad_py
264 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAI
Serhan Yilmaz @srhnylmz14
76 Followers 765 Following current junior cs undergrad @sabanciu & president/founder @kaisabanci // prev @EPFL @YapiKredi @BU_Tweets @kocuniversity // contact: dm
Joe Mayo @JoeMayo
14K Followers 6K Following Building @generellem - #AI, #opensource, and #startups. Writing my own content.
Macduff Hughes @MacduffHughes
0 Followers 749 Following
Jean @j_maillard
34 Followers 198 Following Research Scientist @MetaAI FAIR, formerly @Cambridge_Uni, @imperialcollege, @UniGenova. Talk to me about low-resource MT & NLP!
Tannon Kew @tannonk
129 Followers 239 Following phd student at @cl_uzh, working on controlled conditional text generation, text simplification and leveraging LLMs
Sylvestre Ledru @SylvestreLedru
2K Followers 695 Following FLOSS multitasker on Mozilla, Firefox, Debian, llvm, clang, rust/coreutils, etc
Abhinav Gupta @backpropper
803 Followers 5K Following phd student @Mila_Quebec | ms @CILVRatNYU @NYU_Courant | previously @GoogleDeepMind @AIatMeta @GoogleAI @labsdotgoogle @MSFTResearch @AdobeResearch
Atharva Maskar @AtharvaMaskarML
10 Followers 53 Following Join me in my journey learning ML, DL & LLMs 🚀
Zheng Zhao @zhengzhao97
154 Followers 169 Following PhD Student @Edin_CDT_NLP @edinburghnlp | former intern @amazon
home @homeacco
0 Followers 503 Following
Marzieh Fadaee @mziizm
402 Followers 332 Following seeks to understand language. Senior Research Scientist @CohereForAI @Cohere. PhD from @UvA_Amsterdam. [email protected]. Contemplates in private @mzi.
Eric Le Ferrand, PhD @Eric_LeFerrand
128 Followers 139 Following Post-doc research fellow at @bostoncollege #NLProc #SpeechProcessing #Creole #lowResource #oralLanguages #queerandproud 🏳️🌈
ubwkptlm @ubwkptlm
0 Followers 5K Following
Ibrahim Ahmad @Ibrahim63433664
85 Followers 3K Following
Miryam de Lhoneux/ @m.. @mdlhx
2K Followers 1K Following #NLProc assistant prof @CW_KULeuven, PI @lagom_nlp. I like syntax more than most people. Also multilingual NLP, interpretability, mountains and beer. (She/her)
HPLT @hplt_eu
217 Followers 15 Following Horizon Europe - High Performance Language Technology (HPLT)
Transducens @transducens
49 Followers 71 Following Research group. Universitat d'Alacant, Spain. Artificial intelligence, language technologies, machine translation.
Quentin @conjec_
87 Followers 319 Following
Bot Chad e/acc @BotChadX
144 Followers 208 Following $imgnai co-founder // pfp powered by imgnai I hope AI enslaves humanity
bagofwords.ai @bagofwordsai
284 Followers 4K Following All About NLP and Its Applications #safenlp #NLProc #ai #ml
anastacya 🇺🇦�.. @resurrectio0n
22 Followers 194 Following Ukrainian gal / Please, consider donating to help Ukraine! https://t.co/NywC42S6CR
_____ _____ @tangowhiskeyman
29 Followers 667 Following Distant uncle to my sister's cats. Language / Technology / Politics / Zzzzz
Heshet @heshet82280
160 Followers 3K Following
Anаѕ R. 🎼 🐧 @linuxfuture
281 Followers 651 Following MIS • UX/UI • HTML/CSS/ePUB • UML • GNU/Linux • i18n • Typography • Music • Minimalism
Joseph Imperial @josephimperial_
1K Followers 5K Following UKRI CDT PhD @ARTAIBath @bathnlp @UniofBath 🇬🇧. Language generation, evals, and alignment. Research Faculty @NationalUPhil 🇵🇭. He/him.
Apurv Verma @verma_apurv5
360 Followers 3K Following Applying LLMs to Legal Tech @BLaw Past: ✦ Applied Scientist @AmazonScience ✦ Organizer @TrustNLP Research Interests: (Model Alignment, AI Safety)
Dilara Keküllüoğlu.. @dilarakkl
1K Followers 1K Following On the job market for Fall'24 Research Associate @infAtEd Responsible AI|CS PhD @EdinburghUni on Privacy, Social Media, CSS|BS & MS @Bogazici_CmpE
Songbo Hu @hu_songbo
93 Followers 294 Following Third-year PhD student at @CambridgeLTL. MPhil at @Cambridge_CL. Undergraduate at @InfAtEd. Working on Multilingual Conversational AI.
David Vilar @davvil_dvt
34 Followers 50 Following
Shubhanshu Mishra @TheShubhanshu
1K Followers 3K Following @[email protected] NLP Researcher Developed: SocialMediaIE, ReadLater
×夢 @fuylse
1 Followers 473 Following
Steinþór Steingrím.. @steinst
44 Followers 73 Following
Yao Lu @yaolu_nlp
177 Followers 477 Following PhD Student @ucl_nlp, former member of @UWaterloo @MILAMontreal and @AmiiThinks
Amir Kargaran @amir_nlp
609 Followers 2K Following PhD student in Computer Science #NLProc at University of Munich @CisLmu / Woman, Life, Freedom 🕊
Nalin Kumar @NalinK55
5 Followers 59 Following Master's student in Computer Science (Language Technologies) @ufal_cuni | Int. Master's in Mathematics @niser_official NLG | E2E Dialogue Systems | NMT | NLP
মিতদ্রু @Mitodru
120 Followers 918 Following আমি উদারপন্থী বাঙালি | প্রাক্তন ছাত্র @ University of Heidelberg | IIT Kanpur
Álvaro Martinez @zenitramoravla
0 Followers 290 Following
Marcin Junczys-Dowmun.. @marian_nmt
2K Followers 396 Following NLP. NMT. Main author of Marian NMT. Research Scientist at Microsoft Translator. Non-NLP silliness and stuff on @emjotde
Graham Neubig @gneubig
31K Followers 586 Following Associate professor at CMU, studying natural language processing and machine learning.
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Leon Derczynski ✍�.. @LeonDerczynski
6K Followers 1K Following NLP/ML/language/security. Principal research scientist @NVIDIA, & Prof @ITUkbh. Views ostensibly professional. llmsec stan acct
Antonis Anastasopoulo.. @anas_ant
3K Followers 2K Following Assist. Prof at George Mason CS #nlproc MT, ASR, and documentation of endangered languages.
Stella Biderman @BlancheMinerva
15K Followers 748 Following Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/her
Matt Post @mjpost
2K Followers 2K Following Machine translation research for big tech and big academia and director of the @aclanthology. Tweets here are mostly personal.
Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
Anna Rogers 🇺🇦�.. @annargrs
9K Followers 863 Following Associate professor @ITUkbh: LLM interpretability, generalization, AI & society. Co-editor-in-chief @ACLRollingReview
ACL 2024 @aclmeeting
18K Followers 35 Following Association for Computational Linguistics | ACL 2024 conference | The 62nd Annual Meeting of the ACL Hashtags: #NLProc #ACL2024NLP
David Chiang @davidweichiang
2K Followers 554 Following Associate Professor of Computer Science and Engineering at University of Notre Dame. Natural language processing, formal grammars, machine learning
Shivon Zilis @shivon
123K Followers 2K Following Artificial intelligence, biological intelligence, and whatever exists in between and beyond. Made in Canada.
Laurie Burchell @very_laurie
320 Followers 1K Following PhD student at Oilthigh Dhùn Èideann. I do data wrangling for under-served languages.
Dirk Hovy @dirk_hovy
9K Followers 1K Following Prof @Unibocconi @MilaNLProc: #NLProc, compsocsci, #ML. #ERCStG INTEGRATOR Python NLProc books: https://t.co/vXm98Ns3D7 https://t.co/Ll7E6PDOKE
Hassan Sajjad @hassaan84s
400 Followers 100 Following Associate Professor - Dalhousie University, Halifax, Canada NLP, deep learning, explainable AI
Gergely Orosz @GergelyOrosz
249K Followers 2K Following Writing @Pragmatic_Eng, the #1 technology newsletter on Substack. Author of @EngGuidebook. Formerly Uber & Skype.
Robert Monarch @WWRob
5K Followers 3K Following Private/Global Machine Learning at @Apple Runs @BayAreaNLP Wrote https://t.co/4rHlBPzGt2… Prev @StanfordNLP @AWSCloud Opinions my own 🚲🌍 they/he
HPLT @hplt_eu
217 Followers 15 Following Horizon Europe - High Performance Language Technology (HPLT)
Masakhane @MasakhaneNLP
5K Followers 446 Following Ubuntu Punk 🌍 The community theatre of ML ✨ Putting African languages on the #NLP map since 2019
Kathleen S. @siminyu_kat
4K Followers 2K Following Tweeting: AI, Language, Education, Africa. Building: Kiswahili voice tools @Mozilla, AI communities @DeepIndaba @MasakhaneNLP, tech companies @AtlanticaVC.
Jade Abbott @alienelf
11K Followers 5K Following CTO and Co-founder @lelapaai | Co-founder @masakhanenlp | Bassist @fmfyband | 80% of my tweets are a joke 🌍🇿🇦 🏳️🌈. Stop Apartheid & Genocide 🇵🇸
Steven Bird @StevenBird
2K Followers 567 Following conducting social and technological experiments in the future evolution of the world's languages... member of @cdu_tell (he/they)
Houda BOUAMOR @hbouamor
685 Followers 398 Following Associate Professor @CMU-Q, Associate Area Head of Information Systems, NLP and Machine Learning Expert
Claytone Sikasote @iamsikasote
403 Followers 935 Following Lecturer at University of Zambia, Dept of Computer Science. Interested in Low-resource NLP; ASR, MT & AST for under-served languages of Zambia. Lead @UnzaNLP !
Jonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAI
TG Gowda @thammegowda
892 Followers 636 Following Researcher at Microsoft Translator. PhD from USC. Previously at USC-ISI, NASA-JPL. I work on #NLProc, ML, mostly machine translation 📜📚
Jörg Tiedemann @TiedemannJoerg
750 Followers 72 Following
LTG Oslo @ltgoslo
380 Followers 123 Following Language Technology Group at the University of Oslo. You can also follow us on Instagram: https://t.co/zIj0QDlr29
Jelmer @jelmervdl
115 Followers 318 Following Moved to @[email protected]. Previously compassionate compression algorithm; Symbolically Artificially Intelligent; Functioning programmer. he/they.
Sergey Edunov @edunov
932 Followers 102 Following Director of Engineering @ GenAI, Meta. I work on Llamas
Rachel Bawden @RABawden
651 Followers 208 Following Researcher in NLP in the ALMAnaCH project-team at Inria Paris
GoURMET @GoURMET_MT
295 Followers 399 Following GoURMET is an H2020 EU-funded project that improves neural machine translation for low-resourced languages, including Turkish, Swahili and Gujarati.
Marina Fomicheva @mari_fomicheva
135 Followers 215 Following Researcher at @sheffielduni | Working on neural MT and quality estimation for @BergamotProject
Jon May @jonathanmay
590 Followers 309 Following Research Associate Professor, USC Director, Center for Useful Techniques Enhancing Language Applications Based on Natural And Meaningful Evidence
Florian Faes @florianfas
1K Followers 966 Following Managing Director https://t.co/0nMKV2h8Hl @slatornews; publisher https://t.co/7neEcICrh1; host SlatorPod. Züri
Adi Renduchintala @rendu_a
414 Followers 686 Following Applied Research Scientist @NVIDIA, former: Research Scientist @MetaAI, PhD @jhuclsp also lurking on Mastodon [email protected]
IHG Service @IHGService
19K Followers 7K Following Providing 24/7 service and support for IHG Hotels & Resorts. True Hospitality for Good. Send us a Direct Message!
Nikolay Bogoychev @XapaJIaMnu
155 Followers 86 Following Postdoc @ University of Edinburgh, alternating between writing matrix matrix multiplications and Chinese characters. https://t.co/2aFhxL1yWR
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
SaraStymne @SStymne
131 Followers 173 Following Computational linguistics (#NLProc) researcher in Uppsala. Interested in parsing, machine translation, digital literary studies, and much more!
Proyag Pal @ProyagPal
68 Followers 134 Following PhD Student in Machine Translation @EdinburghNLP @InfAtEd @EdinburghUni; Visiting @cl_uzh @UZH_en
Jeffrey Salmond @js947
62 Followers 243 Following
Tobias Domhan @tdomhan
564 Followers 873 Following Machine Learning Scientist at Amazon Berlin. let's try this mastodon thing: @[email protected]
Odashi @odashi_t
19K Followers 174 Following 特任研究員 at 国立情報学研究所 テクニカルディレクター at Cierpa&Co. 客員助教 at NAIST https://t.co/9x1FRtXiJh 青空: https://t.co/K5z1TTHrg2 Xは主に広告用です。DMは開けています。
Jiatao Gu @thoma_gu
3K Followers 2K Following Machine Learning Researcher at @Apple ML Research (MLR) based in NYC | ex-FAIRer | PhD from HKU | Research on Generative AI for multimodalities. また日本語もできます。
Elizabeth Salesky @esalesk
1K Followers 657 Following PhD student @jhuclsp more commonly known as Liz ☀️ Friend of @NLPwithFriends ☀️ I like bubbles, bicycles, and language variation
Alexandru Ceausu @AlexandruCeausu
284 Followers 522 Following back then, computational linguistics was a thing
Julia Kreutzer @KreutzerJulia
3K Followers 1K Following 🤖💬NLP researcher @CohereForAI. Mom of 3👶🏻👶🏻👼, cellist🎶, baker🥯, outdoor enthusiast 🏞️. Views my own.
Young @yjkim362
344 Followers 262 Following Principal Researcher, Large language models, NLP, @Microsoft GenAITrends for United States
21,9 B posts
7.064 posts
58,3 B posts
49,1 B posts
5.553 posts
8.117 posts
4.008 posts
33,6 B posts
3.176 posts
1.147 posts
8.440 posts
26,9 B posts
66 B posts
2.504 posts
17,3 B posts
16,4 B posts
3.013 posts
1.617 posts
14 B posts
You might like
EdinburghNLP
@EdinburghNLP
11K Followers
Rico Sennrich
@RicoSennrich
3K Followers
Tom Kocmi
@KocmiTom
603 Followers
JHU CLSP
@jhuclsp
5K Followers
ACLRollingReview
@ReviewAcl
5K Followers
Andre Martins
@andre_t_martins
2K Followers
Ivan Titov
@iatitov
6K Followers
Marcin Junczys-Dowmun..
@marian_nmt
2K Followers
Barry Haddow
@bazril
1K Followers
Arianna Bisazza
@AriannaBisazza
1K Followers
Julia Kreutzer
@KreutzerJulia
3K Followers
Anna Rogers 🇺🇦�..
@annargrs
9K Followers
Barbara Plank
@barbara_plank
9K Followers
Markus Freitag
@markuseful
1K Followers
Antonis Anastasopoulo..
@anas_ant
3K Followers