Emma Strubell @strubell
assistant professor @LTIatCMU & visiting scientist @allen_ai. natural language processing and efficient ML. she/her/dad (2 dogs). 🏳️🌈. hiking and food. BLM. strubell.github.io Pittsburgh, PA Joined September 2009-
Tweets1K
-
Followers4K
-
Following936
-
Likes9K
A big question looms over generative AI: what really is its impact on the environment? I spent months investigating a single campus of Microsoft data centers in the Arizona desert - designated in part for OpenAI - in an attempt to find out. Thread. theatlantic.com/technology/arc…
As part of our commitment to a truly open approach to AI, we are excited to release the next steps in the OLMo pipeline! Today we're releasing the best fine-tuned model where you know everything that went into the model from pretraining to RLHF fine-tuning: OLMo-7B-Instruct.…
New preprint! 📜 We investigate how ten “quality” and English langID filters, drawn from prior lit on LLM pretraining data curation pipelines, affect webpages linked to self-descriptions of their creators. Paper: arxiv.org/abs/2401.06408 Data: huggingface.co/datasets/allen… 🧵(1/6)
Today we joined leading AI partners to launch the pilot of @NSF’s National AI Research Resource (NAIRR), a shared research infrastructure that will democratize access to critical resources necessary to power responsible AI innovation. Read more here: blog.allenai.org/ai2-listed-as-…
Today we joined leading AI partners to launch the pilot of @NSF’s National AI Research Resource (NAIRR), a shared research infrastructure that will democratize access to critical resources necessary to power responsible AI innovation. Read more here: blog.allenai.org/ai2-listed-as-…
I knew emissions due to conference travel were high, but honestly this is higher than I thought. ACL2023 travel comparable to running 1572 A100 GPUs for a year (i.e. training an LLM)
I knew emissions due to conference travel were high, but honestly this is higher than I thought. ACL2023 travel comparable to running 1572 A100 GPUs for a year (i.e. training an LLM)
I've read ~50 SOPs (via STEM for development, my personal network, random email requests, and my recent Twitter form) over the past 2 months, and these are COMMON MISTAKES I've noticed graduate school applicants making quite often: [A thread]
Check out the amazing article by @Melissahei covering this work: technologyreview.com/2023/12/01/108… With quotes from @JesseDodge , @LynnHKaack and @vijaygadepally! 💞
TL;DR? Stuffing generative models into absolutely everything comes with a significant cost to the planet, and we should use fine-tuned models in cases when tasks are well-defined. 👩🏼💻 Alternative titles we explored include "InferNO" and "Think before you GPT" 😂
High-quality data is a key to successful pretrain/finetuning in the GPT era, but manual data curation is expensive💸 We tackle data quality challenges involving large models and datasets with ScAlable Meta leArning (SAMA) #NeurIPS2023💫 Arxiv: arxiv.org/abs/2310.05674 🧵 (1/n)
Just released v0.9.0 of the Dolma toolkit 🍇 Lots of goodies (dataset tokenization support, new taggers, data analysis, etc), but the one I'm most proud of is that we now have.... ✨ proper documentation 💫 check it out at github.com/allenai/dolma/…, or `pip install dolma` 😊
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Graham Neubig @gneubig
30K Followers 583 Following Associate professor at CMU, studying natural language processing and machine learning.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric ElephantLuca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/themKayo Yin @kayo_yin
8K Followers 555 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳William Wang @WilliamWangNLP
14K Followers 715 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Tal Linzen @tallinzen
16K Followers 895 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAIShruti Rijhwani @shrutirij
4K Followers 499 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from @LTIatCMU * Amateur woodworker, scuba diver, foosball playerMark Dredze @mdredze
4K Followers 786 Following John C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Danish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialJacob Andreas @jacobandreas
13K Followers 956 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwDivyansh Kaushik @dkaushik96
4K Followers 3K Following Vice President, Beacon Global Strategies. Prev: @scientistsorg, @acmi_lab/@CarnegieMellon. DC/PGH. “An imported Indian immigrant,” @BreitbartNews.Wenting Zhao @wzhao_nlp
805 Followers 353 Following PhD student @cornell_tech Food for life, NLP for soul!LLM360 @llm360
1K Followers 49 Following A framework for open-source LLMs to foster transparency, trust, and collaborative research.Muhammad S. Abdo 🇵.. @MuhSabrys
630 Followers 3K FollowingPensé FFun @inftyCategory
121 Followers 0 FollowingNiloofar (Fatemeh) Mi.. @niloofar_mire
4K Followers 1K Following Postdoc @uwcse-@uwnlp, Ph.D. from @ucsd_cse /Privacy, ML, NLP, @winlpworkshop chair, @MSFTResearch - Semantic MachinesYu Su @ysu_nlp
6K Followers 858 Following Dist. Assist. Prof.@OhioState, Director @osunlp, 20% Researcher@Microsoft. I like to think about intelligence, artificial or biologicalNasanbayar Ulzii-Orsh.. @nulziiorsh
175 Followers 1K Following PhD Student @umsi. Systems and inheritance. Previously CS+Philosophy @haverfordedu. He/him. https://t.co/DO6x58YvWYJoe Stacey @_joestacey_
568 Followers 1K Following PhD student at Imperial and Apple Scholar. I love running, NLP and travelling (in no particular order). Ex teacher and PwC Consultant. #NLProcYaroslav Golubev @areyde
406 Followers 1K Following Research administrator and data analyst in the ML4SE lab @JetBrains. Love empirical SE, writing papers and poetry, philosophy, and the world.robin fowler @robinfowl
465 Followers 1K Following lecturer @UM College of Engineering, Communication and Engineering Education Research. Teamwork and design communication, with a focus on equity&social justiceQasim Ali @QasimAliSidhu
171 Followers 960 Following AI First Tech Savvy Technical Customer Support Engineer #AI #GenerativeAI #GenAI #FutureAILeaders #AIFirstSeungone Kim @seungonekim
932 Followers 831 Following Incoming Ph.D. student @LTIatCMU, M.S. student @kaist_ai working on LLM Evaluation & Systems that Improve with (Human) Feedback | Prev: @yonsei_u @NAVER_AI_LabPradip Khomane @impradipk
105 Followers 3K Following Software engineer with a passion for solving complex problems and building scalable systems. Always learning and excited to work on challenging projects.Aly M. Kassem @_AKassem
32 Followers 471 Following Exploration over Exploitation. MSc student Uwindsor. Interested in Adversarial attacks, security & reliability of LLMsMaxime Peyrard @peyrardMax
213 Followers 279 Following Junior Professor @CNRS (previously @EPFL, @TUDarmstadt) -- AI Interpretability, causality, and interaction flows between LLM, humans, and toolsBerrak Sisman @berraksismann
1K Followers 895 Following Assistant Professor, Electrical and Computer Engineering, University of Texas at Dallas @ut_dallas | IEEE Speech and Language Processing Technical CommitteeTodd Davis @todddavis696
337 Followers 739 FollowingAlexander Wan @alexwan55
470 Followers 944 Following CS at Berkeley; @BerkeleyML @BerkeleyNLP; NLP research♻️ Leshem Choshen.. @LChoshen
3K Followers 550 Following 🥇 #NLProc researcher 🥈 Opinionatedly Summarizing #ML & #NLP papers 🥉 Good science #scientivism Let's pretrain together @IBMResearch & @MIT_CSAILArif Ahmad @ArifAhm92263086
197 Followers 6K Following All things AI, Computer Science and Circuits! Prev. @GoogleAIMichel Lutz @LutzAnalytics
1K Followers 1K Following @TotalEnergies chief #data officer, digital factory head of data, @limos_lab research fellow. #Datascience, #MLOps and #datamanagement for the future of #energyShubhashis Roy Dipta @iamdipta007
265 Followers 1K Following PhD @umbc || Multimodal (NLP + CV) || 🏠 https://t.co/XFDVDULgwS || 📝 https://t.co/UaVN46IIe4 || ✍️ https://t.co/PxOoQefIDdRuairi @ruairiSpain
290 Followers 2K FollowingNafiira Nurfita | A L.. @fianfitr
171 Followers 5K Following @F_Nurfitriana | Psy. | Always go with the choice that scares you the most, because that's the one that is going to help you grow. | Bismillah CHRO.Heming Xia @hemingkx
570 Followers 1K Following Ph.D. student @HongKongPolyU | Prev MEng & BSc @PKU1898 | Prev Intern @MSFTResearch (MSRA) | NLP | Language ModelingVaibhav @vaibhav_p1234
428 Followers 897 Following Unraveling AI complexities, crafting user-friendly innovations. Bridging the gap between intricate tech and practical applications.Mike Sexton @MikeESexton
1K Followers 5K Following Cat dad. Cyber/AI @ThirdWayNatSec. NextGen @FP4America. 40 under 40 @MidEastPolicy. Polyglot-ish. He/هو/הוא. mikesexton(@)infosec(.)exchange.Chhandak Bagchi @c_bagchi
50 Followers 369 Following PhD Student @manningcics. Working on Machine Learning and Computational Social Science.Fei Liu @feiliu_nlp
690 Followers 290 Following Associate professor @EmoryUniversity. Working on large language models, automatic summarization, natural language generation, and various aspects of AI.Aida Ponce Del Castil.. @APonceETUI
2K Followers 2K Following Senior researcher @ETUI_org & CIPP/E │🌐 new tech & labour │ #AIAct│ nano-bio-cogno │GDPR │ I also conduct foresight projectsAriaAI @ariaailab
50 Followers 1K Following Active seeking CS PhD position for 24fall in USA. #LLM #NLProc & #AIYiyang Nan @YiyangNan
22 Followers 247 FollowingESRC Digital Good Net.. @digitalgoodnet
2K Followers 3K Following An @esrc-funded, £4 million research network building a research community focused on what a good digital society should look like and how we get there.Flavio Calvino @FLCalv
1K Followers 2K Following Senior Economist @OECDInnovation. Firm dynamics, digitalisation, #AI, sustainable & inclusive growth. Tweets are personal views, RTs are not endorsementsBarbad @BarbadForoughi
0 Followers 1K FollowingDookie @Dookie26721249
169 Followers 3K FollowingHashHakim @hash_hakim
123 Followers 4K FollowingEric Pennington @HeadsUpPenny
500 Followers 3K Following Lead Data Architect for the Citizens and Technology Lab at @Cornell and Research Engineer based out of @MIT at @CivicMIT and @MediaLab. Prev: @SocialMachineskkyoucanfly @kkyoucanfly
62 Followers 513 Following(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzYoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCKyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Graham Neubig @gneubig
30K Followers 583 Following Associate professor at CMU, studying natural language processing and machine learning.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric ElephantLuca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/themKayo Yin @kayo_yin
8K Followers 555 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Christopher Manning @chrmanning
126K Followers 114 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋William Wang @WilliamWangNLP
14K Followers 715 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Tal Linzen @tallinzen
16K Followers 895 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAIShruti Rijhwani @shrutirij
4K Followers 499 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from @LTIatCMU * Amateur woodworker, scuba diver, foosball playerZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Nathan Schneider @complingy
4K Followers 1K Following Computational Linguist and Professional Nerd at Georgetown University he/him pronouns, ALL the prepositions @[email protected] @complingy.bsky.socialJacob Andreas @jacobandreas
13K Followers 956 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwDivyansh Kaushik @dkaushik96
4K Followers 3K Following Vice President, Beacon Global Strategies. Prev: @scientistsorg, @acmi_lab/@CarnegieMellon. DC/PGH. “An imported Indian immigrant,” @BreitbartNews.Tim Dettmers @Tim_Dettmers
28K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Stella Biderman @BlancheMinerva
15K Followers 748 Following Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/her♻️ Leshem Choshen.. @LChoshen
3K Followers 550 Following 🥇 #NLProc researcher 🥈 Opinionatedly Summarizing #ML & #NLP papers 🥉 Good science #scientivism Let's pretrain together @IBMResearch & @MIT_CSAILKyle Lo @kylelostat
2K Followers 1K Following #nlproc #hci leading data research @allen_ai, he/him, bluesky https://t.co/5Hm9cx3UrzIz Beltagy @i_beltagy
2K Followers 422 Following Cofounder @SpiffyAI, Research Lead building OLMo at @allenai_org, formerly @UTCompSci PhD.Mechanical Dirk @mechanicaldirk
552 Followers 244 Following Principal Engineer at @allen_ai. Engineering Lead of the OLMo project.Lucy Li @lucy3_li
4K Followers 2K Following @UCBerkeley PhD student + @allen_ai. Human-centered #NLProc, computational social science, AI fairness. she/her. https://t.co/rtSSUhWQnLProfess.or Profess.an.. @johnkitchin
3K Followers 2K Following Professor of Chemical Engineering, Code sourcerer, Emacs+org-mode+Python+lisp enthusiast Pronouns: he/him #pycse: https://t.co/fTNpETQTbcXuhui Zhou @nlpxuhui
681 Followers 428 Following PhD student @LTIatCMU. Previously, @GeorgiaTech, @UWNLP, and @Apple. Social Intelligence in language +X. He/Him.🐳Steven Kolawole @_stevenkolawole
2K Followers 298 Following Ẹ̀yin èèyàn mi! ❤️ Low-budget philosopher. ML Efficiency. PhD-ing @SCSatCMU. @ml_collective's poster boy. Big brother to 3 amazing sisters.Gabe Gomes @gabepgomes
6K Followers 6K Following digital molecular designer | Assistant Professor @CarnegieMellon with @gpggrp | cofounder, https://t.co/sXnQ7WfmGY | h(e/im), views my ownChan Young Park @chan_young_park
438 Followers 212 Following PhD student @LTIatCMU @uwcse, working on natural language processing and computational social science.Shuyan Zhou @shuyanzhxyc
2K Followers 592 Following Ph.D. student @LTIatCMU working on agents | she/theyThomas Kollar @tkollar
306 Followers 464 Following Research Manager @ TRI; ex-Amazon; ex Apple. CMU / MITSachita Nishal is at .. @nishalsach
509 Followers 2K Following PhDing around human-AI interaction, journalism, and sci comm @NorthwesternU prev: @MSFTResearch @bitspilaniindia she/herLeena Mathur @lmathur_
620 Followers 899 Following PhD student @SCSatCMU @LTIatCMU. I work on multimodal AI, embodied AI, & human-machine interaction w/ @lpmorency. prev @USC, @Caltech, @EPFLSireesh Gururaja @_sireesh
376 Followers 2K Following Trying to get to know my neighbors, both irl and online. PhD student @LTIatCMU, interested in NLP that lets people keep agency. Former: @kensho, @IBM, @ColumbiaAllenNLP @ai2_allennlp
14K Followers 31 Following The AllenNLP team works on language-centered AI that equitably serves humanity. We deliver high-impact research and open-source tools to accelerate progress.Bogdana Rakova (is on.. @bobirakova
3K Followers 3K Following Senior Fellow Trustworthy AI @mozilla // Computational Law & AI Contestability // Design Friction // views are my own // #solidarityAmanda Bertsch @abertsch72
1K Followers 671 Following PhD student @LTIatCMU / @SCSatCMU, researching text generation + summarization | she/her | also @ abertsch on bsky or https://t.co/L4HBUh0R9f or by email (https://t.co/bsHqwIMFPL)Jackie Kay @jackayline
1K Followers 443 Following AI Sociotechbro/woke scientist. ML PhD student @UCL, RE @Deepmind. they/them Opinions are my own and do not reflect my employer's.Mona Diab @MonaDiab77
1K Followers 687 Following Director of LTI, CMU. ACL Fellow. I am passionate about language, mind, responsible technologies, technology/society, history, politics, nutrition!Carolyn Anderson @linguistcarolyn
628 Followers 772 Following @Wellesley CS professor and computational linguist. Studies meaning with computational and experimental tools. https://t.co/0k477lFlwdRosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRVijay V. @vijaytarian
529 Followers 444 Following Grad student at CMU. I do research on NLP and human-AI interaction. he/himKate Saenko @kate_saenko_
5K Followers 164 Following AI Researcher in dataset bias, vision & language models / FAIR / Professor at Boston University / NeurIPS 2023 co-PC / she/her/hersPradeep Dasigi @pdasigi
1K Followers 460 Following Senior Research Scientist at Allen Institute for AI (AI2)Pengfei Liu @stefan_fee
2K Followers 615 Following Associate Prof. at SJTU, leading GAIR Lab (https://t.co/Nfd8KmZx3B) Co-founder of Inspired Cognition, Postdoc at @LTIatCMU, Previously FNLP, @MILAMontreal,Lindia Tjuatja @lltjuatja
807 Followers 446 Following a natural language processor and “sensible linguist”. PhD-ing @LTIatCMU, previously BS-ing @UT_linguistics + @utexasece 🤠🤖📖 she/herDr. Claire Le Goues @clegoues
3K Followers 1K Following AssocProf@SCS@CMU. Find me elsewhere. https://t.co/fcjhKkZ1RF can tell you how.David Widder - @david.. @davidthewid
2K Followers 821 Following forever trying to help computer people think more critically about computer artIG@davidthewid Postdoc@Cornell Tech. PhD from CMU, exNASA/MSR/IntelLabs.Talia Ringer 🟣 �.. @TaliaRinger
25K Followers 6K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, & justice. They/היא, ND, bi. די לכיבושRaphael Fischer @raphischer
42 Followers 74 Following Machine learning PhD student at @TU_Dortmund / @lamarrinstitute - let's make it Resource-Aware, Sustainable and Trustworthy!Justin Svegliato @justinsvegliato
1K Followers 379 Following Research Scientist @CHAI_Berkeley @UCBerkeley. PhD @UMassAmherst. Building autonomous/safe robots with planning, RL, and LLMs.Laurens van der Maate.. @lvdmaaten
658 Followers 1K Following Distinguished Research Scientist at Meta AI. t-SNE. DenseNet. Web-scale weakly supervised vision. CrypTen. Currently herding Llamas.Olivetti Group @ MIT @OlivettiGroup
246 Followers 27 Following We focus on quantifying the impact of and providing strategies for increasing the resource, economic, and environmental effectiveness of materials.Anjalie Field @anjalie_f
3K Followers 432 Following @[email protected] Faculty at Johns Hopkins @JHUCompSci @jhuclsp in NLP and computational social scienceSanket Vaibhav Mehta,.. @sanketvmehta
708 Followers 1K Following Research Scientist @GoogleAI | Ph.D. @LTIatCMU @SCSatCMU @CarnegieMellon | Past @AdobeResearch, @IITRoorkeeCohere For AI @CohereForAI
15K Followers 173 Following We are a research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.Julie A. Hochgesang, .. @jahochcam
4K Followers 3K Following Deaf Linguist Mama. 📸-er. lastname /hoʊkˌsæŋ/ 👉/she/they #ASLSignbank #GlossGesang #EmboxedDiscourse #MoLoASL #O5S5ASL #MamaBrain #NoParticularOrderMostDaysLori Levin @LoriLevinPgh
159 Followers 143 Following Research Professor @LTIatCMU working on NLP for low-resource languages, co-director of LLab, co-chair @NACLO_contestKudos to @royschwartzNLP @SashaMTL @strubell who are among the trailblazers in this area, and kindly shared their own slides. Also @JesseDodge and many many others who did amazing studies. Some day this topic will be expected in NLP textbooks, and they'll all be there! /2
🌍 Yay, the "Reflections on data science" course at @ITUkbh now includes my lecture on data science and climate! - carbon costs of DL models & challenges in measuring them - what can be done with data science to help climate - (some) approaches to making models more efficient /1
Pittsburgh you have been good to us! So much fruitful exchange with groups at @CarnegieMellon and @PittTweet, many opportunities for future research of our @LamarrInstitute. Today, onwards to St. Louis 🛬
Follow up "eval is fun" tweet: how much do scores change depending on prompt format choice? The score range for a given model is of 10 points! :D Prompt format on the x axis, all these evals look at the logprob of either "choice A/choice B..." or "A/B...".
Did you know that, if you evaluate the same model, with the same prompt formatting & the same fixed few-shot examples, only changing ♻️the order in which the few shot examples are added to the prompt ♻️ you get a difference of up to 3 points in evaluation score?
@fchollet @JeffDean @GoogleDeepMind This is honestly a baffling response. You cant be saying that benchmarking FP32 vs TF32 (just the dtype) is a "compiler optimization". Honestly, I'm lost at the face of so much evidence, how you're just still sticking to your story.
Would be great if there were AI community awards for people who are great *collaborators*, as opposed to so many focusing on who's the best *leader*. Leader focus fuels territorialism, which ultimately ends up pushing out people with tech-marginalized characteristics.
Pleased to announce that I've joined @cohere (7 months ago...) Since then we've built a great model (excellent at RAG, tooluse and multihop reasoning) that we are releasing along with the weights today!
Announcing C4AI Command R+ open weights, a state-of-the-art 104B LLM with RAG, tooling and multilingual in 10 languages. This release builds on our 35B and is a part of our commitment to make AI breakthroughs accessible to the research community. 🎉 huggingface.co/CohereForAI/c4…
Today, we’re introducing Command R+: a state-of-the-art RAG-optimized LLM designed to tackle enterprise-grade workloads and speak the languages of global business. Our R-series model family is now available on Microsoft Azure, and coming soon to additional cloud providers.
Announcing C4AI Command R+ open weights, a state-of-the-art 104B LLM with RAG, tooling and multilingual in 10 languages. This release builds on our 35B and is a part of our commitment to make AI breakthroughs accessible to the research community. 🎉 huggingface.co/CohereForAI/c4…
🎙️ Speaker Announcement🎙️ We're pleased to announce the keynote speakers to the 17th Midwest Speech & Language Days Symposium #MSLD2024, happening @UMich, April 15-16: 🌟Eric Fosler-Lussier @EricFos 🌟Hao Peng @haopeng_nlp 🌟Betsy Sneller @betsysneller 🌟Emma Strubell @strubell
pleased to report I still spend ample time writing in my hammock despite being in the big scary city
"Carnegie Mellon University graduate student David Gray Widder, from Oregon, uses his laptop from a hammock outside the Carnegie Library of Pittsburgh in Oakland on Monday, August 15, 2022. (Vanessa Abbitt/Post-Gazette)" I'm in the news! newsinteractive.post-gazette.com/photos/2022/08…
Oh great, that preprint is now a Nature report🫠 Y'all, this makes no sense. You simply can't compare the carbon emissions of people and objects. An individual’s total carbon footprint estimate can't be attributed to their profession. See my rant here: x.com/sashamtl/statu…
Man, this preprint is really the gift that keeps on giving. In case people missed my previous PSA : you can't compare the carbon emissions of people and objects. Humans are more than just the work that they do. (Also, that paper makes a lot of false assumptions in general)
⌘-R Introducing Command-R, a model focused on scalability, RAG, and Tool Use. We've also released the weights for research use, we hope they're useful to the community! txt.cohere.com/command-r/
Today, we’re excited to release Command-R, a new RAG-optimized LLM aimed at large-scale production workloads. Command-R fits into the emerging “scalable” category of models that balance high efficiency with strong accuracy, enabling companies to move beyond proof of concept, and…
We are excited to launch C4AI Command-R, a 35 billion parameter model weights release designed to make generative AI breakthroughs accessible to the research community. 🎉 huggingface.co/CohereForAI/c4…
We have some wonderful scholarship - shout out to people like @SashaMTL and @strubell - that has measured the training costs of GPT-like large language models (arxiv.org/pdf/2206.05229…) and the inference costs of open-source generative AI applications (arxiv.org/pdf/2311.16863…).
A big question looms over generative AI: what really is its impact on the environment? I spent months investigating a single campus of Microsoft data centers in the Arizona desert - designated in part for OpenAI - in an attempt to find out. Thread. theatlantic.com/technology/arc…
Arizona is suffering the worst drought it has faced in more than a millennium. Phoenix endured its hottest summer ever in 2023. The public shouldn't be relying on investigations to get access to basic info amid an accelerating global climate crisis. npr.org/2022/07/18/111…
As part of our commitment to a truly open approach to AI, we are excited to release the next steps in the OLMo pipeline! Today we're releasing the best fine-tuned model where you know everything that went into the model from pretraining to RLHF fine-tuning: OLMo-7B-Instruct.…