mei @multiply_matrix
training foundation models. AGI timeline 2027. MIT dropout. DMs are open linkedin.com/in/matrixmulti… Joined February 2021-
Tweets73
-
Followers2K
-
Following129
-
Likes355
Excited to announce that @SophontAI has raised $9.22M in combined pre-seed+seed rounds! 🚀🔥 Led by @KindredVentures, with participation from @Delphi_Ventures @upfrontvc @AICONIC_VC also @JeffDean, @LoganKilpatrick, @ClementDelangue (via Factorial Capital), @l2k & others
all the exits in ai have been acquihires🧐 one top ai researcher is worth more than an entire non-ai company with PMF revenue? 😱 windsurf --> Google character.ai -->Google deepmind --> Google scale.ai --> Meta inflection --> Microsoft adept…
all the exits in ai have been acquihires🧐 one top ai researcher is worth more than an entire non-ai company with PMF revenue? 😱 windsurf --> Google character.ai -->Google deepmind --> Google scale.ai --> Meta inflection --> Microsoft adept…
all the exits in ai have been acquihires🧐 scale.ai --> Meta character.ai --> Google deepmind --> Google inflection --> Microsoft adept --> Amazon mosaic --> Databricks
all the exits in ai have been acquihires🧐 scale.ai --> Meta character.ai --> Google deepmind --> Google inflection --> Microsoft adept --> Amazon mosaic --> Databricks
models primed with INCORRECT solutions but with RIGHT BEHAVIORS achieve identical performance to those trained on correct solutions? > optimize for behaviors & amplify with RL
models primed with INCORRECT solutions but with RIGHT BEHAVIORS achieve identical performance to those trained on correct solutions? > optimize for behaviors & amplify with RL https://t.co/KaxC1TNXp7
9/13 Our findings reveal a fundamental connection between a model's initial reasoning behaviors and its capacity for improvement through RL. Models that explore verification, backtracking, subgoals, and backward chaining are primed for success.
This is the dataset we curated for our own reasoning experiments. There is a lot of reasoning data coming out now, but we spend extra time on this to make sure all the problems are high-quality and suitable for RL training!
This is the dataset we curated for our own reasoning experiments. There is a lot of reasoning data coming out now, but we spend extra time on this to make sure all the problems are high-quality and suitable for RL training!
still climbing 📈 Big-MATH just hit 🥈 on @huggingface huggingface.co/datasets/Synth…
still climbing 📈 Big-MATH just hit 🥈 on @huggingface huggingface.co/datasets/Synth…
Superintelligence isn't about discovering new things; it's about discovering new ways to discover I think our latest work formalizes Meta Chain-of-Thought which we believe lies on the path to ASI When we train models on the problem-solving process itself—rather than the final…
Superintelligence isn't about discovering new things; it's about discovering new ways to discover I think our latest work formalizes Meta Chain-of-Thought which we believe lies on the path to ASI When we train models on the problem-solving process itself—rather than the final…
Despite all the twitter hype there still hasn't been public proof that the "reasoning" models have any emergence. I.e. is there a class of problems that are solvable with "advanced reasoning" that were not under GPT4o with search under some computational budget?
Scaling LLMs with more data is hitting its limits. To address more complex tasks, we need innovative approaches. Shifting from teaching models what to answer to how to solve problems, leveraging test-time compute and meta-RL, could be the solution. Check out Rafael's 🧵 below!
Scaling LLMs with more data is hitting its limits. To address more complex tasks, we need innovative approaches. Shifting from teaching models what to answer to how to solve problems, leveraging test-time compute and meta-RL, could be the solution. Check out Rafael's 🧵 below!
Thrilled to share our latest work on consistency models! We simplified the math behind continuous-time consistency models, stabilized their training, and scaled them up to 1.5B parameters. We are now one step closer to real-time multimodal generation!
Thrilled to share our latest work on consistency models! We simplified the math behind continuous-time consistency models, stabilized their training, and scaled them up to 1.5B parameters. We are now one step closer to real-time multimodal generation!
New follow-up work on the effects of synthetic data on model pre-training. It’s becoming increasingly clear that the model collapse issues predicted by prior works are not panning out in theory and practice. Industry labs now even have entire synthetic data pre-training teams.
New follow-up work on the effects of synthetic data on model pre-training. It’s becoming increasingly clear that the model collapse issues predicted by prior works are not panning out in theory and practice. Industry labs now even have entire synthetic data pre-training teams.
Many (including me) who believed in RL were waiting for a moment when it will start scaling in a general domain similarly to other successful paradigms. That moment finally has arrived and signifies a meaningful increase in our understanding of training neural networks
the brain finetunes on synthetic data while it sleeps biorxiv.org/content/10.110…
whichever lab wins gold in the IMO, please do it in a way that generalizes and isn't just specific to math 🙏
whichever lab wins gold in the IMO, please do it in a way that generalizes and isn't just specific to math 🙏
@cindyxywu Evolution used something less than infinite compute to arrive at intelligence. The question is, just how much can it be accelerated by applying more intelligence to the search process. Possibly the search process is fundamentally compute bound rather than intelligence bound.
@demishassabis @NoamShazeer @GoogleDeepMind @Google Timeline defining event
AGI became inevitable after Claude Shannon, Ray Solomonoff, & Andrey Kolmogorov theorized that compression = intelligence. everything else was simply a matter of time
AGI became inevitable after Claude Shannon, Ray Solomonoff, & Andrey Kolmogorov theorized that compression = intelligence. everything else was simply a matter of time
Joscha Bach @Plinz
155K Followers 787 Following FOLLOWS YOU. Artificial Intelligence, Cognitive Architectures, Computation. The goal is integrity, not conformity. https://t.co/rFUNzdYXuK
Sara Hooker @sarahookr
50K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Irwan Bello @IrwanBello
7K Followers 3K Following Supercomputers & Friends AGI research & products founding team @reflection_ai ex @OpenAI, founding team @character_ai
Michael Dempsey @mhdempsey
29K Followers 5K Following Dreaming about the future, romanticizing the past | MP @compoundvc investing & researching former science projects & crypto | we are only creativity constrained
Andres Kim @andresfrkim
260 Followers 70 Following
Kendall Capital @kendallcap_
26 Followers 986 Following
Peter Kowalczyk 🍍 @peter_kow
4K Followers 757 Following Bootstrapper +10 years. $80k MRR @aurityteam Next 👉🏻 🍍@Pineapplebuild1 - AI Website Builder for busy business owners Business Tips and Journey
Astrid @DenisLittl53991
72 Followers 3K Following
Pratibh @10Pratibh_
18 Followers 70 Following Co-founder @ TAURA | AI Researcher | Exploring something techy everyday
joshua @joshua1ara
7 Followers 2K Following
!.! @xypyth
57 Followers 5K Following
MarciaTrollpoe @9W616C0Q8COh45n
21 Followers 1K Following
Daugoom @Daugoom3813
83 Followers 3K Following
Chryseis Liu @chryseis_liu
97 Followers 168 Following
0xSoren @4lili_lili4
1K Followers 3K Following Head of Partnership @yottalabs pre BD/Venture @ dorahacks
Lounes @Lounes_9
137 Followers 2K Following ~ Random sampling my way | working on speech text models during the day and on a smartglass app the rest of the time
Deepak Bhadgaonkar @DeepakB_1
2 Followers 85 Following Co-founder at Creatorships | Front-end Developer & Visual Designer | Python Developer | Data & ETL Pipeline Builder
Sam Gao @samuel_ys92
3K Followers 1K Following Cooking @dinq_io. An AI talent engine that helps you discover, analyze, and connect people.
Jack Arenas @jackarenas
526 Followers 1K Following Principal @fcollective | Co-Founder at @ModernLifeHQ | Co-Founder @Petal | Co-Founder @GetPrismData l go bears 🐻
Evelyn @Fg2vG83X078YHDg
10 Followers 679 Following Dream big, work hard, stay focused, and surround yourself with good people.
Sean Kruzel @seankruzel
554 Followers 534 Following AI Engineer, Entrepreneur and father of 2 I'm working really hard to work smarter, not harder.
Sophont @SophontAI
2K Followers 15 Following WE'RE HIRING! (see website) Multimodal foundation models are the future of medical AI, and medical AI is the future of healthcare.
Arpan Punyani @arpanpunyani
1K Followers 5K Following Co-Founder and GP @garudavc, pre-seed/seed investor. Early @okta. Prev JD and equity analyst. Dad and Husband, Miami-born.
Ruben Dominguez Ibar @rdominguezibar
4K Followers 1K Following The VC Corner newsletter (+200k subs)
KarenConnie @hFy3216iUX7Nj7
48 Followers 2K Following
云创兽Ai @Yjosaw437033
1 Followers 107 Following 💡 smart girl with a knack for tracking market trends! eager for pro tips. Chat private equity via DM! 💡 #OptionsTrading
Salman @_sshahid_
840 Followers 3K Following Exploring AI for accelerating scientific discovery; prev cofounder @omegalabsai and AI @WOMBO 🇨🇦/🇵🇰
Arsham Zolanvari @Arsham_Zo
31 Followers 487 Following Trying to find and support the closest path to abunance. AI Ventures @PlugandPlayTC
FlorenceBridges @2zR50sZO934f9
26 Followers 2K Following
Tim Hanson @m8ta@fedi... @m8ta
148 Followers 115 Following
Hailey @Il6EL01KI1m2OT
33 Followers 1K Following
kaiser bloom @kaiser__Bloom
1 Followers 10 Following Je suis un empereur auto proclamé ici je partage les fondements de ma philosophie
George Levan @georgelevan
1 Followers 204 Following
Lauren @Honmea299
74 Followers 2K Following The most beautiful thing a woman can wear is confidence.
rickrunsroy @rickrunsroy
4 Followers 19 Following
Adi @adocados
41 Followers 242 Following Building a better way to interact with computers | weekends are ruined by 11 men kicking a ball around in mini shorts
Thomas Joshi @thomastjoshi
1K Followers 6K Following Coauthor of DSPy @stanford (most popular Stanford AI library) - AI and EE degree @columbia
Alexander Borzunov @sasha_borzunov
1K Followers 423 Following Researcher at @OpenAI. Ex-developer of https://t.co/yblRXgx0Ei
Ryan Noor @ryan_noor_
99 Followers 746 Following AI trainer @ Mercor (STEM LLMs) | https://t.co/6HnIlovT75 x https://t.co/u2r7TFRmYo powered by https://t.co/3G7PKhUOoA | Ex-chemist turned tech | https://t.co/3G7PKhUOoA | https://t.co/u2r7TFRmYo | https://t.co/6HnIlovT75
Zuza Domagala @zuza_domagala
152 Followers 2K Following 🪄 building in music tech • audio & AI • 🛠️ open-source • prev @sonymusic, @UMG, @warnerbros
Chyna Jacobson-Shield... @ChynaShiel63362
3 Followers 77 Following Not a single person whose name is worth remembering lived a life of ease.
Saber Darabi @SADarabi
305 Followers 7K Following
Joscha Bach @Plinz
155K Followers 787 Following FOLLOWS YOU. Artificial Intelligence, Cognitive Architectures, Computation. The goal is integrity, not conformity. https://t.co/rFUNzdYXuK
Sara Hooker @sarahookr
50K Followers 9K Following I lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
Irwan Bello @IrwanBello
7K Followers 3K Following Supercomputers & Friends AGI research & products founding team @reflection_ai ex @OpenAI, founding team @character_ai
Alexander Borzunov @sasha_borzunov
1K Followers 423 Following Researcher at @OpenAI. Ex-developer of https://t.co/yblRXgx0Ei
CLS @ChengleiSi
5K Followers 4K Following PhDing @stanfordnlp & Chilling @FutureHouseSF | teaching language models to do research
Yuxiang (Jimmy) Wu @YuxiangJWu
2K Followers 1K Following Co-founder & CTO @WecoAI | Building AI that builds AI | UCL PhD | LLM, NLP, ML | previously @allen_ai @MetaAI @MSFTResearch
Aakanksha Chowdhery @achowdhery
11K Followers 5K Following @Stanford @reflection_ai // Previously @GoogleDeepMind :: PaLM, Gemini // @MSFTResearch, @Princeton // views my own and subject to change
Haseeb ＞|＜ @hosseeb
126K Followers 1K Following Managing partner @dragonfly_xyz. Take a deep breath and let's think step by step.
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
Jonathan Lachman @jonlachman
4K Followers 750 Following founding head of operations at thinking machines @thinkymachines. former head of special projects @openai, obama @whitehouse national security budget director
Dar Mehta @dar_mehta
360 Followers 555 Following building @_CausalLabs; prev @cruise, @waymo, brain @GoogleAI, kiyo robotics (YCS20), @AIatMeta, @uwaterloo
Zayd Enam @zaydenam
3K Followers 826 Following "There must be chaos within you to give birth to a dancing star."
Jon Saad-Falcon @JonSaadFalcon
1K Followers 668 Following AI PhD @hazyresearch @StanfordAILab | Previously @databricks @allen_ai @GeorgiaTech
Jonathan Gootenberg @jgooten
5K Followers 2K Following Pull apart the double helix like a wishbone || Ars longa, tweeta brevis
Ludo Antonov @ludo_antonov
383 Followers 225 Following Co-Founder, SuperMe, Previously VP of Engineering @ Whatnot. Ex Lyft, Pinterest, Hulu.
Lucas Nestler @_clashluke
4K Followers 333 Following Researcher at https://t.co/ksVWnaPQ2x, TensorFork member
Aran Komatsuzaki @arankomatsuzaki
146K Followers 305 Following Looking for a cofounder. Sharing AI research. Early work on AI (GPT-J, LAION, scaling, MoE). Ex ML PhD (GT) & Google.
Nicolas Granatino🌻 @ngranati
2K Followers 771 Following AI, Defence tech and robotics; Co-founder Andurance Ventures; PhD ChemBio Oxford |
Alon Albalak @AlbalakAlon
2K Followers 584 Following Open-endedness, Data-centric AI @LilaSciences Previously: RS @synth_labs, PhD @ucsbNLP, Internships @AIatMeta @MSFTResearch All puns are my own
Nick Haber @nickhaber
897 Followers 254 Following Interactively learning AI, cognitive models, learning tools. Assistant Professor at Stanford.
James Alcorn @JamesAlcorn94
1K Followers 2K Following AI/infra at Lightspeed. Prev Zetta VC, Spectrum Equity, UCBerkeley 🇦🇺 🇺🇸
Ruiqi Gao @RuiqiGao
9K Followers 781 Following Research scientist @GoogleDeepmind | Generative models. Veo3, Veo2, CAT3D, Imagen Video, etc. | Mom of Mochi.
steve jang @stevejang
42K Followers 4K Following entrepreneur, now vc | founder & partner @kindredventures | early investor 🌱 @uber @coinbase @perplexity_ai @fal @nuro @aaloatomics @whisperaero @zora
Cheng Lou @_chenglou
21K Followers 328 Following Worked on: @reactjs, @messenger, @reasonml, @rescriptlang & @midjourney
Diyi Yang @Diyi_Yang
18K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab LLMs for Humans
Rylan Schaeffer @RylanSchaeffer
6K Followers 2K Following CS PhD Student at Stanford Trustworthy AI Research with @sanmikoyejo. Prev interned/worked @ Meta, Google, MIT, Harvard, Uber, UCL, UC Davis
Brando Miranda @BrandoHablando
1K Followers 834 Following CS Ph.D. @Stanford, researching data quality, foundation models, and ML for Theorem Proving. Prev: @MIT, @MIT_CBMM, @IllinoisCS, @IBM. Opinions are mine. 🇲🇽
Anikait Singh @Anikait_Singh_
565 Followers 813 Following PhD'ing @StanfordAILab @stanfordnlp. Previously @MSFTResearch @ToyotaResearch @GoogleDeepMind @Berkeley_AI https://t.co/Qz5IOlI3fN
Avi Singh @avisingh599
2K Followers 1K Following Gemini @GoogleDeepMind. Previously worked on robots. Ask for my strava and goodreads :)
Samarth Sinha @_sam_sinha_
4K Followers 308 Following Researching Multimodal Memes @LumaLabsAI + Proud PhD (Dropout 😶🌫️) @UofT Prev: @AIatMeta @Mila_Quebec 🇨🇦
toly 🇺🇸 @aeyakovenko
634K Followers 6K Following Co-Founder of Solana Labs. Award winning phone creator. NFA, don’t trust me, mostly technical gibberish. https://t.co/LomgbTpb6h
Jack Burlinson @jfbrly
4K Followers 445 Following
Jiayi Pan @jiayi_pirate
13K Followers 2K Following 🧑🍳 Reasoning Agents @xAI | PhD on Leave @Berkeley_AI | Views Are My Own
Barret Zoph @barret_zoph
22K Followers 1K Following CTO & Co-Founder Thinking Machines Lab (@thinkymachines) Past: - VP Research (Post-Training) @openai - Research Scientist at Google Brain
chrissy @chrissyykat
4K Followers 217 Following honest thoughts about sf and tech ⋆｡°✩ research eng & media | cs @ princeton | @jennsun 🩵
Jared Quincy Davis @jaredq_
2K Followers 820 Following Founder and CEO, Mithril (@mithrilcompute). Orchestrating Compute. Fmr Research Scientist @GoogleDeepMind, Deep Learning Team. CS PhD @Stanford ML, Systems
Soumith Chintala @soumithchintala
252K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Stella Biderman @BlancheMinerva
17K Followers 812 Following Open source LLMs and interpretability research at @AiEleuther. She/her
Hailey Schoelkopf @haileysch__
5K Followers 1K Following hillclimbing towards generality @anthropicai | prev @AiEleuther | views my own
Andreas Köpf @neurosp1ke
7K Followers 552 Following Exploring ways to algorithmically model our world.
Devendra Chaplot @dchaplot
13K Followers 441 Following Building next-gen AI at @thinkymachines. Past: Founding team @MistralAI, RS at Facebook AI Research. Ph.D. @SCSatCMU, BTech @iitbombay CS.
Kanishk Gandhi @gandhikanishk
2K Followers 914 Following Phd CS@Stanford @StanfordNLP, Computation and Cognition; w/ Noah Goodman | Prev: @MSFTResearch @LakeBrenden @NYUDataScience, @IITKanpur, @Path_AI
Chase Blagden @ChaseBlagden
161 Followers 522 Following
Hugh Zhang @hughbzhang
3K Followers 1K FollowingTrends for United States
You might like
