Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIdatabricks.com/research/mosaic P{NY=.6, SF=.2, DC=.1, BOS=.1}Joined December 2013
Nice article from the Harvard Crimson about our "CBS-NTT Program in Physics of Intelligence"! 🧠
“This is new for all of us. How do you explain intelligent behavior in equations or in physics terms?”
Nice article from the Harvard Crimson about our "CBS-NTT Program in Physics of Intelligence"! 🧠
“This is new for all of us. How do you explain intelligent behavior in equations or in physics terms?”
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…
Our team is incredibly proud to partner with @allen_ai and thrilled to see them cook! Achieving such a massive improvement in MMLU, while reducing the compute budget, is a fantastic win. And doing it fully open? Everyone wins. Congrats! Can't wait to see what's next 👀
Our team is incredibly proud to partner with @allen_ai and thrilled to see them cook! Achieving such a massive improvement in MMLU, while reducing the compute budget, is a fantastic win. And doing it fully open? Everyone wins. Congrats! Can't wait to see what's next 👀
Friday is LLM battle day.
I added DBRX to the financial metrics challenge.
Overall, very impressed with DBRX.
Main takeaways:
• correctly calculated metrics
• ranked top 4 fastest models
• competitive pricing
DBRX was +50% cheaper and +100% faster than models in its tier.…
So crazy the things that emerge at scale. It’s so satisfying releasing models I got the wild and watching people do such cool stuff with them. Makes it all worth it ❤️
So crazy the things that emerge at scale. It’s so satisfying releasing models I got the wild and watching people do such cool stuff with them. Makes it all worth it ❤️
@databricks DBRX Instruct is twice as fast as new Mixtral 8x22B. When asked to write a reverse proxy in python both produce comparable quality results.
🚨Open Source Drop🚨
Databricks is adopting MegaBlocks, and we're releasing the MegaBlocks integration into LLMFoundry. This is a critical component in our Dbrx training stack, and we're super excited to bring MoE training to the community (1/N)
186K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
33K Followers 966 FollowingCofounded & running @ml_collective.
Host of Deep Learning Classics & Trends.
Research at Google DeepMind.
DEI/DIA Chair of ICLR & NeurIPS.
Writing https://t.co/IbycyGfnDR
45K Followers 2K FollowingML / AI researcher, emphasis on theory.
Research Director and Canada CIFAR AI Chair, @VectorInst
Professor, @UofT (Statistics/CS)
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
23K Followers 2K FollowingProfessor at UMD. AI security & privacy, algorithmic bias, foundations of ML.
Follow me for commentary on state-of-the-art AI.
39K Followers 7K FollowingI lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
12K Followers 2K FollowingPrincipal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
35K Followers 3K FollowingAI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
17K Followers 419 FollowingComputer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.
25K Followers 1K FollowingSenior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.
18K Followers 1K FollowingComputer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.
573 Followers 494 FollowingRailtown AI Application General Intelligence™ Platform revolutionizes software development with real-time decision-making and automation.
🏆 Microsoft Partner
7 Followers 260 FollowingView everything through the lens of its smallest components: every detail, every moment, composed of particles. #ParticlePerspective
1K Followers 765 Followingela/dela
Dev | Estudante de Ciência da Computação | TDAH | 28 anos | 🏳🌈🏳🌈🏳🌈 | Fora Bolsonaro e defensores e antivaxx e terraplanistas
18 Followers 122 FollowingBuilding the future of AI-enabled customer support.
Need help? 🙋♂️ https://t.co/IsvoeReQMK.
Schedule a demo 📆 https://t.co/YOj7GIkMEi
186K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
33K Followers 966 FollowingCofounded & running @ml_collective.
Host of Deep Learning Classics & Trends.
Research at Google DeepMind.
DEI/DIA Chair of ICLR & NeurIPS.
Writing https://t.co/IbycyGfnDR
45K Followers 2K FollowingML / AI researcher, emphasis on theory.
Research Director and Canada CIFAR AI Chair, @VectorInst
Professor, @UofT (Statistics/CS)
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
23K Followers 2K FollowingProfessor at UMD. AI security & privacy, algorithmic bias, foundations of ML.
Follow me for commentary on state-of-the-art AI.
39K Followers 7K FollowingI lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
12K Followers 2K FollowingPrincipal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
261K Followers 26 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
17K Followers 419 FollowingComputer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.
18K Followers 1K FollowingComputer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.
40K Followers 1K FollowingSecular Bayesian.
Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey
Alum of @Twitter, Magic Pony and @Balderton
28K Followers 785 FollowingVP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.
1K Followers 210 FollowingPhD student @oatml_oxford supervised by @yaringal | previously interned at deepmind, google brain | former professional chess player
6K Followers 2K FollowingResearch @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_usc
22 Followers 91 Followingresearcher @DBRXMosaicAI - pushing foundation models to their limits. previously researcher @MSFTResearch and @Livermore_Lab. Ph.D. @PurdueECE
2K Followers 331 FollowingSVP product @databricks. I tweet about data and AI and robots and sometimes @donkey_car. If you want tweets on just donkey car, follow me there.
10K Followers 2K FollowingCo-founder of Lilac AI (@lilac_ai), now joining @databricks. Past: Co-created TensorFlow.js and Know Your Data. Google Brain // PAIR // Responsible AI
39 Followers 40 FollowingI like to talk about AI and other tech stuff. Currently making AI Products @Databricks. Product Manager for @mlflow. Prev. at @Microsoft
504K Followers 68K FollowingFollow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.
8K Followers 3K FollowingWriting AI Agenda @theinformation, texan, & horror movie aficionado // reach me at [email protected] or on Signal at 979-599-8091
288K Followers 937 FollowingHost of @WaitWait on @NPR. Author of "The Incomplete Book of Running" and "The Book of Vice"
For speaking engagements: https://t.co/YuV5fDJ3fh
30K Followers 143 FollowingChief Economist @economics_ma. Host of Inside Economics podcast https://t.co/ONmSCQ65Ib. Co-founder of https://t.co/ZAo6ME72qu. Views expressed here are my own.
874 Followers 0 FollowingETA advocates for high-quality, accessible, and forward-looking transit through internationally-inspired, technically-oriented analysis in greater New York.
326K Followers 706 FollowingCharles W. Eliot University Professor and President Emeritus at Harvard. Secretary of the Treasury for President Clinton and Director of NEC for President Obama
142K Followers 4K FollowingChief Foreign-Affairs Correspondent of The Wall Street Journal. Author. 📕Our Enemies Will Vanish📕is my latest book. Instagram/Threads @yarotrof