Stella Biderman @BlancheMinerva
Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/her stellabiderman.com Joined May 2019-
Tweets12K
-
Followers14K
-
Following749
-
Likes11K
TIL: exactly one question in ARC has five choices. The rest have four.
@tamaybes but current models don’t allocate parameters to rotary embs! this means the Chinchilla D=20*N is skewed already for the actual param counts of most models, even if it held across datasets! If we disregarded the pos. encoding params the coefficients would change
@tamaybes a super-fun arcane historical detail: Gopher (and by extension Chinchilla) use Transformer-XL style position encodings. This means they spend 20B params (Gopher) and 5B params (Chinchilla) on just rel. position encoding!
the best TTS available from 2020-2021 was done by a single unemployed guy who supported every single my little pony voice and literally nothing else the best TTS from 2022-2024 was also done by a single (different) unemployed guy w a custom-built 6x3090 rig in his basement (1/2)
#HowGPTWorks, book w/ @BlancheMinerva @drewfarris is already up to # 3 on the best sellers! We are removing all the mystery behind WTF a language model is, how they work, but in an accessible way for people without any AI/ML training. @ManningBooks manning.com/books/how-gpt-…
This seems clearly correct to me and is something I've personally experienced. Probably the easiest way to see this is true is to realize that people don't know the logical closure of their beliefs, but given time and a pencil can work many things in said logical closure out.
This seems clearly correct to me and is something I've personally experienced. Probably the easiest way to see this is true is to realize that people don't know the logical closure of their beliefs, but given time and a pencil can work many things in said logical closure out.
100%! People are really bad at understanding the logical close of their beliefs. (Proof: if they weren't, we would know if ZFC was consistent!)
100%! People are really bad at understanding the logical close of their beliefs. (Proof: if they weren't, we would know if ZFC was consistent!)
Really amazing work by the @huggingface team! Infrastructure work, including dataset work, evaluations work, and building libraries, is the single highest-leverage thing you can do in AI. This will provide dividends for the broader AI community for years to come.
Really amazing work by the @huggingface team! Infrastructure work, including dataset work, evaluations work, and building libraries, is the single highest-leverage thing you can do in AI. This will provide dividends for the broader AI community for years to come.
An essential blocker to training LLMs on public domain books is not knowing which books are in the public domain. We're working on it, but it's slow and costly... if you're interested in providing support reach out!
An essential blocker to training LLMs on public domain books is not knowing which books are in the public domain. We're working on it, but it's slow and costly... if you're interested in providing support reach out!
SSMs + long sequence analysis + malware detection with LLMs is all the buzzwords you need to decide to check our paper out, right? arxiv.org/abs/2403.17978
SSMs + long sequence analysis + malware detection with LLMs is all the buzzwords you need to decide to check our paper out, right? arxiv.org/abs/2403.17978
Training data transparency is an unambiguous win for society, but all the incentives are against companies doing it right now. We need to fix this as soon as possible.
Training data transparency is an unambiguous win for society, but all the incentives are against companies doing it right now. We need to fix this as soon as possible.
We are excited to see torchtune, a newly announced PyTorch-native finetuning library, integrate with our LM Evaluation Harness library for standardized, reproducible evaluations! Read more here: Blog: pytorch.org/blog/torchtune… Thread:
We are excited to see torchtune, a newly announced PyTorch-native finetuning library, integrate with our LM Evaluation Harness library for standardized, reproducible evaluations! Read more here: Blog: pytorch.org/blog/torchtune… Thread:
Zyphra is pleased to announce Zamba-7B: - 7B Mamba/Attention hybrid - Competitive with Mistral-7B and Gemma-7B on only 1T fully open training tokens - Outperforms Llama-2 7B and OLMo-7B - All checkpoints across training to be released (Apache 2.0) - Achieved by 7 people, on 128…
Calling all academic AI researchers! 🚨 We are conducting a survey on compute resources. We want to help the community better understand our capabilities+needs. We hope that this will help us all advocate for the resources we need! Please contribute at: forms.gle/3hEie4hj999fiS…
🚀 Introducing Pile-T5! 🔗 We (EleutherAI) are thrilled to open-source our latest T5 model trained on 2T tokens from the Pile using the Llama tokenizer. ✨ Featuring intermediate checkpoints and a significant boost in benchmark performance. Work done by @lintangsutawika, me…
I've been brain-dumping what I know about how LLMs work for several months now into an accessible general audience book! Check out the pre-release at the link.
I've been brain-dumping what I know about how LLMs work for several months now into an accessible general audience book! Check out the pre-release at the link.
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
near @nearcyan
46K Followers 882 Following https://t.co/IdaJwZJCXm partner @ https://t.co/9g1MIgjiqc dms open
SynthLabs @synth_labs
12K Followers 43 Following AI Aligned with Your Vision. We’re doing cutting edge research for transparent, auditable AI alignment.
MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric Elephant
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Sasha Luccioni, PhD �.. @SashaMTL
19K Followers 4K Following AI & Climate @HuggingFace, Board Member of @WiMLworkshop and @ClimateChangeAI. @techreview 35 Innovators under 35, @TEDTalks speaker. She/her/Dr/ 🦋
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Talia Ringer 🟣 �.. @TaliaRinger
26K Followers 6K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, & justice. They/היא, ND, bi. די לכיבוש
Rivers Have Wings @RiversHaveWings
31K Followers 225 Following AI/generative artist. Writes her own code. Absolute power is a door into dreaming.
merve @mervenoyann
56K Followers 4K Following open-sourceress at @huggingface 🧙🏻♀️ proud mediterrenean 🍋 I do TL;DR on ML papers
Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Soumith Chintala @soumithchintala
187K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Rosanne Liu @savvyRL
33K Followers 968 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDR
Jack Clark @jackclarkSF
68K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkaTu Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Tanishq Mathew Abraha.. @iScienceLuvr
54K Followers 1K Following PhD at 19 | Founder and CEO at @MedARC_AI | Research Director at @StabilityAI | @kaggle Notebooks GM | Biomed. engineer @ 14 | TEDx talk➡https://t.co/xPxwKTq6Qb
Wes George @vvxgeorge
125 Followers 538 Following Technologist, Skeptic, Human. solutions @recursal_AI. I fight for the users.
Nextt @_Nextt_
20 Followers 11 Following
Shashank Shekhar @sshkhr16
2K Followers 1K Following Scale Maximalist. Opinions my own, ofc Previously: AI Research @MetaAI @uofg @vectorinst @_NextAI @iiscbangalore
Dean Clark @DeanCla88922559
144 Followers 1K Following Disabled part-time student, registered for artificial kidney trials.
Christian Miranda @cmoryah
212 Followers 454 Following
Jen Iofinova @oohaijen
236 Followers 684 Following Once a mathematician, twice an immigrant. PhD student @ISTAustria building efficient, trustworthy ML. Formerly: software engineer @Google, teacher, wall street.
A. J. Kübler 👨�.. @ajkuebler
62 Followers 2K Following
Zhiyong Wang @Zhiyong16403503
411 Followers 2K Following Visiting Ph.D. student at Cornell University. Ph.D. candidate at CUHK. Working on bandits and reinforcement learning theory.
Syner @renchengyuan
221 Followers 3K Following
Jprwg @jprwg
499 Followers 3K Following No idea if that's true, but it is at least faintly entertaining.
Hpremium @web3nam3
787 Followers 3K Following https://t.co/Tes5ZFnfVs • https://t.co/NuhiRgwvTP https://t.co/3H4X5XEq21 •https://t.co/oOCFfDThZ2 • https://t.co/wMpswOH3Xa • https://t.co/cW7uHNvbfy • https://t.co/VYahFk94rN •https://t.co/Gik8R81APV• https://t.co/Uvx07c8pI2 • https://t.co/yp6o2BXYZH•https://t.co/0V7mofFuIl •📈
Sam Msiska @SammyHga
68 Followers 156 Following God ✝️ | Content Writer | Machine Learning | Data Scientist
TheWrist @ZeWrist
1 Followers 19 Following
Brian Solomon @brianrsolo
2 Followers 20 Following aspiring dog handler, sock collector, new age jalapeno music producer
musty23 @musty237
0 Followers 48 Following
Srihita Vatsavaya @RajuSrihita
26 Followers 536 Following
JasonZz266 @JasonZz26
4 Followers 65 Following
Rafael Vidal @rafa_vidal_rs
799 Followers 156 Following
Samuel Lee @myunggunl333
289 Followers 4K Following I was the leading figure of both the spiritual and psychological warfare for 17 years... https://t.co/cDnw82FoFs
Lu Yu @yellowyu
16 Followers 276 Following
Adam 🖖 Siemaszkiew.. @asiemaszkiewicz
46 Followers 625 Following I tweet about machine learning, earth observation & my music discoveries. 🏙️ previously an architect 👨💻️ now a machine learning eng. 🎧 always a music head
Serah Akojenu @akojenu_serah
163 Followers 395 Following Geospatial Analyst || Data Scientist || Climate Change and Environmental Sustainability Advocate || Women Techsters Fellow 2023. https://t.co/7UDJPwWtu7
Suraj Sharma @Suraj_sharma45
3 Followers 82 Following
Eddie @edwardlandesber
246 Followers 776 Following Startup founder. Deep learning, causal inference, bayesian statistics, python, system design, econ. Formerly stitch fix algos, salesforce, ibm, georgetown.
Ganeshkumar Ashokavar.. @ganeshkumar_av
161 Followers 945 Following Software Engineer @Microsoft's Azure Kubernetes Service | @ucberkeley '21 - EECS and Business | @kleinerperkins Fellow | @accel Scholar.
Javier Rando @javirandor
906 Followers 590 Following Red-Teaming LLMs | PhD Student @ETH_AI_Center | Incoming intern @Meta | Vegan 🌱
Zz’rot @Zzrott1
682 Followers 269 Following enjooyer of markets n acceleration, on an artificial intelligence generative and degenerative binge, all my homies hate safetyists, sometimes bursting into song
Tom Procopio @goofofthefuture
8 Followers 1K Following
Isobel wood @isobelwood_
324 Followers 768 Following UK diplomat, covering tech in San Francisco. Musings on tech and diplomacy. Occasional mountain content. Personal account.
Vera Wang @veraymw
19 Followers 117 Following Enthusiastic programmer. Amateur generative artist. Philosophical thinker by heart @cornell_tech
Meera @kutoberal
8 Followers 66 Following CSE PhD student at Penn State, AI (critical) researcher she/her/hers
James' dog. @WestminsterPup
3K Followers 2K Following Dog of a Westminster researcher. Wandering the labyrinthine corridors of the Blob. Owner's words in @TheSpectator, @UnHerd, @TheCriticMag, and @spikedonline.
crystalWen @JackLiuWen
29 Followers 646 Following
Shin @miyaku22
21 Followers 25 Following
Vinayak Kannan @poppy_tom_5
34 Followers 114 Following Ex-Founder, dreaming up the next big thing in the Machine Learning / FinTech!
Al Buterol @alanbuterol
17 Followers 82 Following
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Lucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
SynthLabs @synth_labs
12K Followers 43 Following AI Aligned with Your Vision. We’re doing cutting edge research for transparent, auditable AI alignment.
MMitchell @mmitchell_ai
80K Followers 1K Following Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Same content in the Sky, Threads, & the Prehistoric Elephant
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Sasha Luccioni, PhD �.. @SashaMTL
19K Followers 4K Following AI & Climate @HuggingFace, Board Member of @WiMLworkshop and @ClimateChangeAI. @techreview 35 Innovators under 35, @TEDTalks speaker. She/her/Dr/ 🦋
Horace He @cHHillee
24K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Anthropic @AnthropicAI
262K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Talia Ringer 🟣 �.. @TaliaRinger
26K Followers 6K Following Professor, @plfmse, @IllinoisCS! Proof Automation. @SigplanM & CCF Founder. Israeli-American for peace, equality, & justice. They/היא, ND, bi. די לכיבוש
Rivers Have Wings @RiversHaveWings
31K Followers 225 Following AI/generative artist. Writes her own code. Absolute power is a door into dreaming.
Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Soumith Chintala @soumithchintala
187K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Hugging Face @huggingface
345K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhate
Rosanne Liu @savvyRL
33K Followers 968 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDR
hackerfantastic.x @hackerfantastic
102K Followers 4K Following Co-Founder @myhackerhouse cyber security assurance & hacker training ~ ISBN9781119561453 ~ a book on professional hacking. Offensive Lua project.
Ian Coldwater 📦�.. @IanColdwater
106K Followers 1K Following Kubernetes SIG Security co-chair, container escape artist, goose in the mainframe. They/them. Legacy verified. Stay punk 🏴
Tom McCoy @RTomMcCoy
3K Followers 483 Following Assistant professor @YaleLinguistics. Studying computational linguistics, cognitive science, and AI. He/him.
Ruochen Zhang @ruochenz_
327 Followers 1K Following PhDing @BrownCSDept, working on multilingual NLP. Prev: Undergrad @sutdsg, she/her
Sebastian Majstorovic @storytracer
2K Followers 813 Following Digital Historian & Data Consultant | https://t.co/fev0QjCWjp | https://t.co/yqa5eIfpTu | Co-Founder @sucho_org
David @DavidSHolz
54K Followers 5K Following founder @midjourney, prev founder leap motion, nasa, max planck
Ashish Vaswani @ashVaswani
19K Followers 2K Following
Lucia Quirke @lucia_quirke
212 Followers 81 Following Neural network interpretability researcher at EleutherAI
Chris Ociepa @ChrisOciepa
27 Followers 68 Following Specialized in the design and development of scalable distributed systems with BigData & AI. Passionate about hacking and training LLMs. A huge fan of astronomy
pleias @pleiasfr
237 Followers 1 Following
BlinkDL @BlinkDL_AI
7K Followers 90 Following RWKV = 100% RNN with GPT-level performance. https://t.co/TkdxOJSFWX and https://t.co/86DzS6arA0
Kevin Klyman @kevin_klyman
3K Followers 3K Following AI policy @StanfordHAI + avoiding war with China @BelferCenter. Words in @ForeignPolicy @TechCrunch et al. Ex @UNGlobalPulse @BanKillerRobots @hrw
Logan Kilpatrick @OfficialLoganK
92K Followers 2K Following Lead product for @Google AI Studio and working on the Gemini API, helping developers build with AI, my views!
Gowthami Somepalli @gowthami_s
6K Followers 979 Following Grad student @UMDCS. Past: @AIatMeta, @AmazonScience, @IITMadras. Currently working on #Diffusion and #Multimodal understanding. GPU poor. She/her.
Ross @rpoo
25K Followers 1K Following
Aspen @aspenkhopkins
559 Followers 195 Following PhD Student advised by @aleks_madry @MIT_CSAIL interested in data and ml. On bluesky @ dataspen.bsky.soc
Dimitri von Rütte @dvruette
709 Followers 171 Following Studies @ETH_en, Machine Learning @DeepJudgeAI
Lennart Heim @ohlennart
3K Followers 823 Following huh? | AI (Compute) Governance @GovAI_ | Also @EpochAIResearch |
Conference on Languag.. @COLM_conf
2K Followers 6 Following https://t.co/GhGCMEoa4A Abstract submission: March 22, 2024
Conglong Li @conglongli
128 Followers 61 Following Senior Researcher @Microsoft DeepSpeed team, working on deep learning systems. @SCSatCMU PhD, @RiceCompSci BS+MS. Views are my own. English/Chinese/Japanese.
Dimitris Papailiopoul.. @DimitrisPapail
12K Followers 977 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez Lily
Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
Sophie @lebrechts
901 Followers 839 Following COO @allen_ai formerly AI/ML @Apple, SVP Strategy & Ops https://t.co/4Z5RuqSEkZ, PhD from @BrownUniversity, post-doc @CarnegieMellon
Iz Beltagy @i_beltagy
2K Followers 422 Following Cofounder @SpiffyAI, Research Lead building OLMo at @allenai_org, formerly @UTCompSci PhD.
Mechanical Dirk @mechanicaldirk
546 Followers 244 Following Principal Engineer at @allen_ai. Engineering Lead of the OLMo project.
Deepak Narayanan @deepakn94
1K Followers 1K Following Research Scientist at @nvidia. Interested in the intersection of Computer Systems and ML. Occasionally tweet about sports. Views are my own.
Briana Vecchione @brianavecchione
3K Followers 1K Following Researcher @datasociety • PhD @CornellCIS • AI auditing/accountability • Prev. @Meta Fellow @MicrosoftNY @spotifyresearch @Mozilla • 🏳️🌈
PicoCreator (🇸🇬.. @picocreator
2K Followers 164 Following Builds Attention-Free Transformer (https://t.co/YL7CbNYKBs) from scratch - CEO @ https://t.co/kQHiGtzJWr Also built k8s tools, uilicious & GPU.js (https://t.co/OIfnI1EPU7)
michele benetti @michelebenben
64 Followers 600 Following
Birchlabs @Birchlabs
4K Followers 173 Following ML Engineer at Anlatan (@novelaiofficial). co-author of HDiT (Hourglass Diffusion Transformers). works on diffusion models and LLMs. 日本語を勉強してる。
Aspiringspike @Aspiringspike
26K Followers 526 Following I am MTGO user and former preview card getter Aspiringspike https://t.co/pn7Z5hUMcz he/him business inquiries [email protected]
Asma Ghandeharioun @ghandeharioun
2K Followers 489 Following Research Scientist @GoogleAI working on ML interpretability & human-centered AI, PhD from @MIT
Ben Rubinstein @bipr
2K Followers 858 Following ML & Privacy Prof @cis_unimelb. Deputy Dean (Research) @engunimelb. Prev @MSFTResearch, @Berkeley_EECS. He/him. 🇦🇺
Sasho Nikolov (thesas.. @thesasho
4K Followers 432 Following Associate professor at U of T. Computer science and math research: (differentially) private data analysis, geometry, discrepancy, optimization.
Nalini Joshi @monsoon0
16K Followers 697 Following mathematician, wife, mother, Professor, addicted to math
Tom Gur @TomGur
4K Followers 281 Following Associate Professor of Theoretical Computer Science @Cambridge_Uni. My research is in Complexity Theory and Quantum Computing.
Niloofar (Fatemeh) Mi.. @niloofar_mire
4K Followers 1K Following Postdoc @uwcse-@uwnlp, Ph.D. from @ucsd_cse /Privacy, ML, NLP, @winlpworkshop chair, @MSFTResearch - Semantic Machines
Johann Rehberger @wunderwuzzi23
3K Followers 628 Following Hacking neural networks so that we don’t get stuck in the matrix. Red Team Director @ Electronic Arts. Entrepreneur. Builder and Breaker. Opinions are my own.
Sharon Goldman @sharongoldman
6K Followers 2K Following Reporter on the AI beat, @FortuneMagazine Formerly @venturebeat [email protected] | Signal: sharongoldman.43 (for news tips only, no pitches)
nathan lile @NathanThinks
2K Followers 887 Following ceo/cofounder @ https://t.co/bDd3J4Lmzf (we're hiring!) #GenerativeAI recurrent rabbit hole victim. swims in data lakes & pools. nothing great is easy.
Daniel van Strien @vanstriendaniel
3K Followers 1K Following Machine Learning Librarian @huggingface 🤗 | Championing Open Science & ML | Sharing the latest ML datasets 🌟 | Tips for mastering the HF Hub
Joseph Thacker @rez0__
49K Followers 874 Following the promptfather. christian. hacker. hobby jogger. principal ai engineer @appomnisecurity.
Laura O'Mahony @_lauraaisling
239 Followers 475 Following PhD Candidate SFI CRT in foundations of data science in UL 📚 just following the gradient of interesting 📈
Nomic AI @nomic_ai
14K Followers 50 Following Building explainable and accessible AI https://t.co/bbYqCdL8vQTrends for United States
You might like
