Sebastien Bubeck @SebastienBubeck
VP GenAI Research, Microsoft AI sbubeck.com Seattle, WA Joined January 2012-
Tweets1K
-
Followers33K
-
Following1K
-
Likes2K
Hmmm, I have a feeling this plot might need an overhaul rather soon🤣. I guess phi-2 was the lower left part of the triangle. I wonder what those guys have been up to in the last 6 months? 🤔
Hmmm, I have a feeling this plot might need an overhaul rather soon🤣. I guess phi-2 was the lower left part of the triangle. I wonder what those guys have been up to in the last 6 months? 🤔
As part of our ongoing work on AI safety and security, we've discovered a powerful, yet simple LLM jailbreak that exploits an intrinsic LLM behavior we call 'crescendo' and have demonstrated it on dozens of tasks across major LLM models and services: …ndo-the-multiturn-jailbreak.github.io
At a time where 314B parameters models are trending, come join me at #NVIDIAGTC to see what you can do with 1 or 2B parameters :-) (and coming soon, what can you do with 3B?!?)
@elonmusk and @sama may not agree on much of late, but do agree AI is built on strong math foundations, including algebra and calculus, applauding @UofCalifornia for recent clarifications on math requirements for admission. Many industry leaders signed: mathmatters.ai
Interestingly the unicorn test is much harder today than back in 2022, because there are now a lot more crappy tikz unicorns on the web ... I guess this has some broader significance ...
Interestingly the unicorn test is much harder today than back in 2022, because there are now a lot more crappy tikz unicorns on the web ... I guess this has some broader significance ...
Tune in on Tuesday for a really fun set of conversations on cutting edge AI research!
Introducing Mixtral, Phi2, Falcon, and Qwen support in #DeepSpeed-FastGen! - Up to 2.5x faster LLM inference - Optimized SplitFuse and token sampling - Exciting new features like RESTful API and more! For more details: github.com/microsoft/Deep… #DeepSpeeed #AI
🚨Princeton ML Theory Summer School🚨 Aug 6 - 15, 2024 Speakers: * F. Krzakala/L. Zdeborova @KrzakalaF @zdeborova * S. Rakhlin * B. Lourerio @_brloureiro * M. Austern * D. Krotov @DimaKrotov * J. Altschuler Details: mlschool.princeton.edu Sponsors:…
I did multiple fine tuning runs over tinyllama-3T and phi-2 using the same dataset (which I think is actually a good dataset of multiturn conversations) Results? Tinyllama can't properly follow multiturns. The model gets confused and brings up completely unrelated completions
Starting the year with a small update, phi-2 is now under MIT license, enjoy everyone! huggingface.co/microsoft/phi-2
Looking for a #postdoc and would like to work at Yale on emerging problems in the areas of foundations of AI/responsible AI? Have your CV, statement, and 3 letters emailed by Jan 15, 2023 cs.yale.edu/homes/vishnoi/… Strong math and empirical background required Please fwd/rt!
Check out this short video for a brief discussion of the phi series with @Microsoft CTO @kevin_scott , including why "textbooks" in "Textbooks Are All You Need" might not be exactly what you have in mind. youtu.be/O-DjHgZt-Uk?si…
This video of a chat between Microsoft CTO @kevin_scott and MSR AI researcher @SebastienBubeck is full of interesting insights about the phi family of large language models, and AI in general. Only 12 minutes, definitely worth watching. youtube.com/watch?v=O-DjHg…
2023 has been the most consequential year in @MSFTResearch's 33-year history. In addition to countless internal (to Microsoft, OpenAI, etc) contributions, I bet that again our labs contributed more per researcher than any others to open research. Read more microsoft.com/en-us/research…
We're so pumped to see phi-2 at the top of trending models on @huggingface ! It's sibling phi-1.5 has already half a million downloads. Can't wait to see the mechanistic interpretability works that will come out of this & their impact on all the important LLM research questions!
Phi-2 by @MicrosoftAI is now the #1 trending model on @huggingface (hf.co/models). 2024 will be the year of smoll AI models!
This is a really excellent video, including an insightful discussion of benchmarks like MMLU: youtube.com/watch?v=nPgs8T…
I'm immensely proud of the work that my colleagues in Microsoft Research showcased at this week’s NeurIPS Conference regarding foundation models of all sizes, including Phi-2, which matches or outperforms models up to 25x larger.
I'm immensely proud of the work that my colleagues in Microsoft Research showcased at this week’s NeurIPS Conference regarding foundation models of all sizes, including Phi-2, which matches or outperforms models up to 25x larger.
Clément Canonne @ccanonne_
31K Followers 925 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Gautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Peyman Milanfar @docmilanfar
67K Followers 261 Following Distinguished Scientist at Google Research. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Ben Recht @beenwrekt
26K Followers 361 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.Frank Nielsen @FrnkNlsn
23K Followers 1K Following Machine Learning & AI, Information Sciences & Information Geometry, Distances & Statistical models, HPC. "Geometry defines the architecture of spaces" @SonyCSLKevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistCsaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingBoaz Barak @boazbaraktcs
17K Followers 415 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVTom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Amin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.François Fleuret @francoisfleuret
30K Followers 475 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.Thomas G. Dietterich @tdietterich
50K Followers 500 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Sam Power @sp_monte_carlo
16K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)Liliang Ren @liliang_ren
465 Followers 213 Following CS PhD candidate at UIUC | Efficient Sequence Modeling | NLP | Current Intern @Azure | Former Intern @MSFTResearch @AmazonScienceTerisaD @TerisaDing
4 Followers 79 Followingcoffee & AI @realcoffeeAI
8 Followers 69 Following_C_onfetti @OnfettiC56224
4 Followers 816 FollowingShiladitya Biswas @shiladitya997
3 Followers 169 FollowingFred Del Vecchio @fremdelve
127 Followers 202 Following 10+ years driving product #innovation strategy, execution, and growth . Talks about: #AI, #Fintech, #SMBs , #entrepreneurship, #business #ideasBTC_Crypto @LionofCrypto2
177 Followers 1K Following Crypto Promoter |DM for promotions,Marketing & Business. Be Honest to everyone,everywhere & Always.Always take stand for right things.王毅 @Tougerwy
1 Followers 90 FollowingBen Slater @BenASlaterUK
0 Followers 97 Followingaaronwu @wutianaaron
2 Followers 55 FollowingGus Schmidt @Gus_Schmidt_21
122 Followers 1K Following I study shapes and numbers as a Math PhD candidate @BostonCollege.new one @Dalifornia0219
13 Followers 201 Followingania malinowska @anexx28
250 Followers 5K Followinglowvram @lowvram
12 Followers 64 FollowingSanid MTP @sanid_mtp
55 Followers 787 Following Building Wizad ✨at the intersection of Design 🌈 & Technology🤖 Breaking barriers for SMBs to have a meaningful digital presence. Alumni of UOW Australia & CETMuizz @muizzkhan77
25 Followers 833 FollowingAakriti @Aakriti0503
156 Followers 228 Following CS PhD student at UMD working on reinforcement learning. Past: Applied Research Intern @amazon.Illyrian Prince @IllyrianPrince
120 Followers 701 FollowingKawa @Kawa208535
6 Followers 162 FollowingHongli Zhan @HongliZhan
392 Followers 707 Following PhD Student 🤘@UTAustin | Incoming intern @IBMResearch | previously undergrad @sjtu1896 | NLP, emotions, affective computingJean Weerts | @jweert.. @JeanJWeerts
56 Followers 755 Following Technomancer 🇫🇷🇺🇸🇪🇺 Terminally curious. Interested in all things Microsoft, 3D Print/Electronics/Fabrication/MusicJHU CLSP @jhuclsp
5K Followers 661 Following Center for Language and Speech Processing at @JohnsHopkins #NLProc #MachineLearning #AI https://t.co/6IXR5OSiDY @[email protected]Wayne Painters 🌻 �.. @PaintersWayne
1K Followers 2K Following Let’s do this! Follow me in the fight against sedition, hypocrisy and anti-democracy in an already great country. Don’t give in to the magat gaslighting! 🌊T. M. @thmessini
559 Followers 1K FollowingStavros Kalapothas @s.. @Stavros_IT
446 Followers 761 Following ICT Officer, PhD research @ECE_UoP, SV2HZK, #WSN #IoT #M2MNishant Raj @Nishant95R
67 Followers 670 Following Applied Science @ Microsoft | UMass Amherst | IIT RoorkeePrashanth Pappu @prashanth_pappu
271 Followers 1K Following Entrepreneur, Innovator, Coder. Founder Vizbee. Created Stackle.Chelsea Parlett-Pelle.. @ChelseaParlett
38K Followers 919 Following 📊Statistician, 👩🏻🏫Data Science Prof, ✍️Stats Communication. #statistics #scicomm #datascience #statstiktok 👩🏻💻 she/herMattes Mollenhauer @gaussianmeasure
1 Followers 44 Following Senior Machine Learning Researcher at @MMerantix | @FU_Berlin Postdoc AlumnusYating Wu @YatingWu96
119 Followers 177 Following ECE Ph.D student @ UT Austin, advised by @jessyjli and @AlexGDimakis | テキサス大学に在籍する博士生Sheng Shen @shengs1123
1K Followers 536 Following Ph.D. student @berkeley_ai; Building 🦙@MetaAi; Former @MSFTResearch, @allen_ai, @GoogleDeepMindRohan Jha @Robro612
71 Followers 219 Following Currently MS CS @UTAustin; previously BS AI @carnegiemellon. Interested in Information Retrieval and NLPJian-tao Xiao @aabrielian
244 Followers 1K Following ⁰00000000000⁰⁰0000000000000000000000000000000000000000000⁰0000000000000000⁰⁰⁰00000000000000000000000000000000000000000000⁰00000000000000⁰000000¹0000000000¹0001Vi @AvimanyuRoy3
574 Followers 1K Following 🍎🕊/🦦☕️/😴🛌/he/him Shouting into the Void (TM) GPU poor peasantRag @Beingsissyphus1
1 Followers 63 FollowingManu Bhardwaj @ifitsmanu
89 Followers 452 Following AI aficionado by day, Python whisperer by night. Making machines smarter, one neuron at a time. Can't stop won't stop learning! 🦾AR0575 @ar057562841
1 Followers 455 FollowingChang Shi @changshi_robot
86 Followers 476 Following PhD student @UTAustin. Previously @CMU_Robotics. Robotics newbie.Sakhiwosekunqoba Dlam.. @Sakhiwosekunqo2
44 Followers 518 Following Artificial Intelligence. Looking for jobs at United States based companies. Connect on LinkedIn. Formal Scientist working in AI. WE ARE ACHIEVING AGI!Murat Seçkin Ayhan @msayhann
106 Followers 326 FollowingClément Canonne @ccanonne_
31K Followers 925 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Gautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Peyman Milanfar @docmilanfar
67K Followers 261 Following Distinguished Scientist at Google Research. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Ben Recht @beenwrekt
26K Followers 361 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.Jelani Nelson @minilek
22K Followers 184 Following Professor @Berkeley_EECS. Research Scientist (part-time) @GoogleAI. Founder @addiscoder. 🇻🇮🇺🇸🇪🇹Kevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistCsaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingBoaz Barak @boazbaraktcs
17K Followers 415 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVNeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Tom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonAmin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.François Fleuret @francoisfleuret
30K Followers 475 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.Thomas G. Dietterich @tdietterich
50K Followers 500 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityAnirudh Goyal @anirudhg9119
5K Followers 485 Following Gemini ♊ Spent time at @Berkeley_EECS, @MPI_IS, @DeepMind.MatthewBerman @MatthewBerman
16K Followers 403 Following 🇺🇸✡️ Deep in AI. YouTuber. Ex-SaaS CEO/founder (acq). Investor. Love talking about artificial intelligence and the future. Builder.DeepSpeed @MSFTDeepSpeed
3K Followers 88 Following Official account for @Microsoft DeepSpeed, a library that enables unprecedented scale and speed for deep learning training + inference. 日本語 : @MSFTDeepSpeedJPmain @main_horse
8K Followers 464 Following AGI Believer. Haven't applied @OpenAI. Likes are not always endorsement.Shimon Whiteson @shimon8282
15K Followers 404 Following Professor of Computer Science at Oxford. Head of Research at Waymo UK.Pratyusha Sharma @pratyusha_PS
2K Followers 400 Following PhD student @MIT_CSAIL. Studying 🐳 ,🤖 and language.Hyung Won Chung @hwchung27
18K Followers 229 Following Research Scientist @OpenAI. Past: @Google Brain / PhD @MITMatthew Lungren MD MP.. @mattlungrenMD
7K Followers 2K Following Chief Data Science Officer @Microsoft Health & Life Sciences + Radiologist @UCSF + Adjunct Professor @Stanford || Prev: @AWScloud @StanfordMed @DukehealthTri Dao @tri_dao
18K Followers 360 Following Incoming Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.Alex Heath @alexeheath
59K Followers 4K Following deputy editor @verge and author of Command Line, a newsletter about the tech industry’s inside conversation https://t.co/1Y9gWlFJbFSang Michael Xie @sangmichaelxie
3K Followers 708 Following PhD student @StanfordAILab @StanfordNLP @Stanford advised by Percy Liang and Tengyu Ma. Prev: visiting @GoogleAI Brain, BS, MS Stanford ‘17Harkirat Behl @BehlHarkirat
180 Followers 260 Following Phi models @MSFTResearch PhD @UniofOxford, BTech @IITKanpur #LLM #AI #MultimodalStella Biderman @BlancheMinerva
14K Followers 749 Following Open source LLMs and interpretability research at @BoozAllen and @AiEleuther. My employers disown my tweets. She/herFlowers from the futu.. @futuristflower
12K Followers 112 Following Azure whispers drift across my mind, painting a world more brilliant than I could ever find. 🕉️Frank Noe @FrankNoeBerlin
10K Followers 577 Following Scientist, #MachineLearning and #AI for the Sciences (esp. Physics/Chemistry). Scuba Diver and Traveler.Demi Guo @demi_guo_
22K Followers 694 Following Co-founder & CEO @pika_labs | ex @StanfordAILab @HarvardPika @pika_labs
116K Followers 52 Following Video on command. Website: https://t.co/G5bjmrMQsx Discord: https://t.co/bX68ThPTQH About: https://t.co/atvdcgbe9SBanghua Zhu @BanghuaZ
2K Followers 775 Following PhD @Berkeley_EECS, statistics, info theory, LLM, RL, Human-AI Interactions.lmsys.org @lmsysorg
34K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtmMicrosoft Ignite @MS_Ignite
130K Followers 46 Following Uncover tech trends, collaborate with experts, and expand your global network at #MSIgnite to enhance your organizational leadership.Anh Nguyen @NguynTu24128917
372 Followers 2K Following Applied Scientist @ Microsoft https://t.co/jncyTUFiUVChunyuan Li @ChunyuanLi
2K Followers 572 Following Microsoft Research, Redmond | PhD at Duke UniversityTeortaxes▶️ @teortaxesTex
7K Followers 1K Following Ours is the age of unaligned utilitarians. Other problems are relatively unimportant, but sometimes I tweet about them anyway. (кто/кого)Kai-Fu Lee @kaifulee
1.5M Followers 659 Following #AI Expert, CEO of @01ai_yi and Chairman of 创新工场 @sinovationvc, former President of Google China, Author of AI 2041 and NYT Bestseller AI Superpowersvince @vincelwt
2K Followers 200 Following Building an open-source SaaS: 🧑💻 @lunary_hq Prev: 📈 @astrolytics_io (sold) & https://t.co/UlUXpxrVtuState of AI @stateofaireport
6K Followers 2 Following The annual report on industry, research, geopolitics, safety and predictions in AI 🤓Chi Wang @Chi_Wang_
2K Followers 427 Following Principal Researcher @MSFTResearch. Working on intersection of AI, ML, Systems. PhD @UofIllinois. Intern @Meta. BS @Tsinghua_Uni. Creator of #AutoGen & #FLAMLDaniel Donoho, MD @ddonoho
2K Followers 634 Following Pediatric and Adult Neurosurgeon @gwsmhs @childrensnatl, cofounder @surgicaldsc, making safer surgery with computer vision and machine learning.Alex Kendall @alexgkendall
10K Followers 588 Following CEO at @wayve_ai teaching cars how to drive with machine learning. 🇳🇿Armand Joulin @armandjoulin
4K Followers 344 Following principal researcher, @googledeepmind. ex director of emea at fair @metaai. mostly work on open projects: fasttext, dino, llama, gemma.Eran Malach @EranMalach
264 Followers 177 Following Research Fellow, Kempner Institute, Harvard UniversityMicrosoft for Startup.. @msft4startups
82K Followers 192 Following Microsoft for Startups Founders Hub removes barriers to building a company with free access to tech, coaching, and support you need to hit your next milestone.Nora Belrose @norabelrose
8K Followers 124 Following Working toward a free and fair future powered by friendly AI. Head of interpretability research at @AiEleuther, but tweets are my own views, not Eleuther’s.Teknium (e/λ) @Teknium1
28K Followers 3K Following Cofounder @NousResearch, prev @StabilityAI Github: https://t.co/LZwHTUFwPq HuggingFace: https://t.co/sN2FFU8PVE Support me on Github SponsorsIya Khalil @IyaKhalil
2K Followers 402 Following VP of Data, A.I. & Genome Sciences @Merck. Physicist, AI drug hunger, On a mission to help cure disease and extend our healthy lives. Views are my own.Allie Del Giorno @allie_adg
28 Followers 23 FollowingSeth Hain @sethHain
213 Followers 429 Following Contemplations on computation, cognition, chords, and care.... Expressly individual insightsAnnouncing The LLM Litmus Test! 📊 This is the 1st AI experiments in the new Sourcegraph Labs! We believe greatly in LLM choice, but we often get the question: Which LLM is right for me? With this new tool, you can: 🔴 Compare+contrast different LLMs 🔵 Try GPT-4 Turbo vs…
As part of our ongoing work on AI safety and security, we've discovered a powerful, yet simple LLM jailbreak that exploits an intrinsic LLM behavior we call 'crescendo' and have demonstrated it on dozens of tasks across major LLM models and services: …ndo-the-multiturn-jailbreak.github.io
Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents droid-dataset.github.io A short 🧵 on the backstory
Packed room at #NVIDIAGTC24 for @SebastienBubeck's talk about #phi and small language models.
🧵Let me explain why the early ascent phenomenon occurs🔥 We must first understand that in-context learning exhibits two distinct modes. When given samples from a novel task, the model actually learns the pattern from the examples. We call this mode the "task learning" mode.
What a fun group at Stanford today. So many great questions. Thanks for inviting me!
Packed house at today’s @StanfordHAI seminar with @Azure CTO @markrussinovich. We’re diving deep into Microsoft’s AI architecture, as well as advancements and opportunities in trending AI research. You can still join via Zoom: hai.stanford.edu/events/mark-ru…
By that point I had been in grad school for 2.5 years, and for most of them I thought I’d never have a publishable result. Having these two papers was such a relief. I try to remember these things when advising students.
@elonmusk and @sama may not agree on much of late, but do agree AI is built on strong math foundations, including algebra and calculus, applauding @UofCalifornia for recent clarifications on math requirements for admission. Many industry leaders signed: mathmatters.ai
Picking this up as an example for LLM data poisoning for my class
Interestingly the unicorn test is much harder today than back in 2022, because there are now a lot more crappy tikz unicorns on the web ... I guess this has some broader significance ...
with a little more feedback, getting closer to the Mangum Opus
Can Claude 3 Opus draw the famous Tikz unicorn like the one by @SebastienBubeck et al in the Sparks paper? I want to say this is getting close to the version of GPT-4 before the public release, but not fully there. Pretty impressive still.
Can Claude 3 Opus draw the famous Tikz unicorn like the one by @SebastienBubeck et al in the Sparks paper? I want to say this is getting close to the version of GPT-4 before the public release, but not fully there. Pretty impressive still.
Frontier models capping out at ~90% on MMLU isn't a sign of AI hitting a wall. It's a sign that a lot of MMLU questions are busted. The field desperately needs better evals.
We're excited to unveil two new methods for integrating multiple LoRA models into diffusion models: LoRA Switch and LoRA Composite. I'm particularly fond of LoRA Switch, which cycles through different LoRAs with each denoising step. Imagine leveraging the unique styles and…
How hard can it be to draw a unicorn with AI, and what would it look like? 🦄@SebastienBubeck has the answers – and the screenshots! And now also in Spanish, Italian and Portuguese 😆 @SebastienBubeck, when can we expect AGI? We at @rask_ai are already prepared for it #AGI #AI
@karpathy The only problem with hard benchmarks imo, especially when they become standard, and wide reaching, is you cant train on anything very similar, which if benchmarks become wide enough, impacts the actual capabilities you can teach a model
I’m proud to announce our launch of @bioptimus_ai – with a mission to create and build the first #foundationmodel for biology. (1/3)
Honored to become a 2024 #SloanFellow. Thanks to @SloanFoundation and to all my students and collaborators for their amazing work!
We have today announced the names of the 2024 Sloan Research Fellows! Congratulations to these 126 outstanding early-career researchers: sloan.org/fellowships/20…
I'm very honored to have been selected as a #SloanFellow! Thank you @SloanFoundation and a huge thanks to all of my amazing mentors, collaborators, and students.
We have today announced the names of the 2024 Sloan Research Fellows! Congratulations to these 126 outstanding early-career researchers: sloan.org/fellowships/20…
I am excited and humbled to have been selected as a 2024 Sloan Fellow in Mathematics. Thank you @SloanFoundation for this incredible honor.
We have today announced the names of the 2024 Sloan Research Fellows! Congratulations to these 126 outstanding early-career researchers: sloan.org/fellowships/20…