MIT CSAIL @MIT_CSAIL
MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected] youtu.be/yCjEYSiVB04?fe… Cambridge, MA Joined October 2009-
Tweets6K
-
Followers297K
-
Following22K
-
Likes3K
"The strength of JavaScript is that you can do anything. The weakness is that you will." — Reg Braithwaite
🚨 #CHI24 Paper Alert! 🚨 We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy @amyxzh @turingmusician @josephcc @karger @hyeonsuukang. arxiv.org/pdf/2402.17847…
Happy bday to the late Larry Tesler, inventor of “copy-paste.” Happy bday to the late Larry Tesler, inventor of “copy-paste.” Happy bday to the late Larry Tesler, inventor of “copy-paste.” cnet.co/4b5ZGrq (Pic v/Reddit)
TO: [email protected] SUBJECT: Happy 83rd! Today would have been the 83rd birthday of Ray Tomlinson, who sent the first email more than 50 years ago while working at BBN Technologies.
This month in 1980: a Japanese computer scientist published a paper proposing the “Neocognitron,” the neural net that directly inspired CNNs. Kunihiko Fukushima’s paper: bit.ly/3dPbF0z
Marijuana was the world's first online transaction, between MIT & Stanford students on ARPANET: bit.ly/2lKLSNk
MIT CSAIL Director Daniela Rus @TEDTalks: How AI will step off the screen and into the real world. bit.ly/3U8Herv
#otd in 1965 Gordon Moore published his article on cramming more components onto integrated circuits: bit.ly/3xxwdGm
Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey: 🔹Our largest models…
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
TuringPost @TheTuringPost
62K Followers 16K Following Newsletter exploring AI & ML - Weekly trends - LLM/FM insights - Unicorn spotlights - Global dynamics - History Led by @kseniase_ Elevate your AI game 👇🏼Kosta Derpanis @CSProfKGD
48K Followers 198 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairMichael Black @Michael_J_Black
58K Followers 641 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistMichael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Pranav Rajpurkar @pranavrajpurkar
21K Followers 713 Following Professor at Harvard | Medical Artificial Intelligence | https://t.co/Z6tBGoluEGZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciBehnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Kritika Prakash @kritipraks
9K Followers 1K Following Researcher and artist. PhD in Computer Science @UChicago. Loves coffee, cats, cafes, cinnamon rolls, and chai. ENFJ-T.Caglar @caglar_ee
7K Followers 5K Following Phd in EEE, Research: Machine learning, convex optimization, Software: Python, C++, CAutonomous Vision Gro.. @AutoVisionGroup
12K Followers 371 Following Awesome Vision Group of Andreas Geiger at the University of Tübingen. We are excited about Computer Vision, Machine Learning and Robotics.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Matthew Rathbun @mattrathbun
7K Followers 2K Following Lover of life, gadgets & food | Sharer of thoughts and listener of stories | #ColdwellBankerElite EVP | I’d make a fine Jedi. | #RealEstate ✌️🤓Gaurav Sharma @GauravShar67714
0 Followers 2 Followingharsh @__harsh020__
5 Followers 35 Following building a suite of ai employees to help humans become more efficient and innovate | cognitive general assistants for task optimizationMuhammad Zahid @mzahid84688
136 Followers 2K Following☀️ Leon-Gerard Va.. @Leon_Vandenberg
4K Followers 5K Following CEO Systems Design Engineer #Solar #Blockchain #Wireless https://t.co/SsLJg98Mal @SunifiedEnergy #eSIM #SolarPunk #BioGenomics @Fuzo #IoT #ML #AI #bitSIM @UWaterloopan @pandazta
0 Followers 1 FollowingMausica @Miausica4
0 Followers 34 FollowingFinanceFrontierAI @FinFrontierAI
65 Followers 298 Following Exploring finance & AI in a podcast with Max & Sophia. Weekly dives into global finance news & in-depth analysis. #Podcast #USSamArthur @SamThur00
94 Followers 564 FollowingAlexguo @Alexguo2
54 Followers 527 FollowingNOTU @NOTU927497
2 Followers 27 FollowingRajeshKatta @RajeshKatta277
19 Followers 93 FollowingBen Future @BenFuture314
0 Followers 52 FollowingSQ Lee @sq_lee31947
2 Followers 39 FollowingShubham Rathore @Rat78254Rathore
0 Followers 74 FollowingNishant Mantripragada @nishantmantrip
4 Followers 18 Following Strategic thinker passionate about driving business growth 🚀 | Follow me for AI and business growth content | Always seeking to connect & share ideas! 🌐chonker sheep @SheepChonk18186
7 Followers 15 FollowingFloLi @wertzeue19728
69 Followers 1K FollowingAKSHAY KISHOR @AkshayKish07
0 Followers 42 FollowingClaudio NS Fonseca @claudions99
33 Followers 454 FollowingNjoroge Mike @NjorogeMike4
273 Followers 3K Following Classic man ~Brother ~a graceful soul💯 ~Baccalaureus Legum🎓 ~carpe diem ~ epicurean ~ pragmatic ~ tranquility ~ artist at work ~🦂 kid ~MCFC⚽ ~🇰🇪Neil @Neillikeu
69 Followers 134 FollowingDrakco @Dracko547Drakco
0 Followers 101 FollowingSamuel Lee @LongLeeSam
0 Followers 12 FollowingYash Shah @yashrshah14
75 Followers 2K FollowingSaiful Islam Shanto @_imsaifulislam
126 Followers 1K Followingsudhanva @sudhu_rao_k_v
0 Followers 7 FollowingBadkidsfly @0x_danf
301 Followers 3K Following Founding partner@orthogonal Labs | prev. @BinancelabsAnya @AnyaIanara
4 Followers 17 Following Tryna be a Cover singer on YouTube 👀 ✨my delulu is the solulu and I hope it will come trululu✨ (it may not be obvious, but I love Ado)Sharmila Reddy @SharmilaReddy17
6 Followers 293 Followingzzz @yongyeyy
0 Followers 156 FollowingA.I. Science Center @AIScienceCenter
0 Followers 4 FollowingSiva @SivaBruhathi
0 Followers 6 FollowingAICircle.ai @aicircle90292
0 Followers 106 Following Stay updated on the latest AI trends, news, and developments. Join us on the journey of learning and and innovation in the world of artificial intelligence. #AITianya Du @ToDoABC
0 Followers 6 FollowingJosemar Selau @josemarselau
50 Followers 466 Following As moedas fiduciárias são apenas 'notas promissórias' emitidas pelo governo para serem cambiadas por dólares. Nada mais do que isso!ChinmayMR @ChinmayM_R
0 Followers 103 FollowingStephen Muriithi @Skautosales
220 Followers 423 Following A car dealer and Enthusiast. Buying// selling used and new cars // Trade-in as well as selling on behalf at a fee. We are on Fb @s&kautosalesbryn in tech @_bpill
40 Followers 99 Following Current: Associate at Mesh Ventures Previous: Intel Gaming - Global Marketing Manager (Content/Esports/Messaging/Influencer) All opinions are my own.Enry @Enry21628485336
2 Followers 30 FollowingAlfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityDeepLearning.AI @DeepLearningAI
220K Followers 30 Following We are an education technology company with the mission to grow and connect the global AI community.Kosta Derpanis @CSProfKGD
48K Followers 198 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairSoumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.NeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Gautam Kamath @thegautamkamath
44K Followers 505 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistMatthias Niessner @MattNiessner
31K Followers 162 Following Professor for Visual Computing & Artificial Intelligence @TU_Muenchen Co-Founder @synthesiaIOSergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Daily AI Papers @papers_daily
16K Followers 2 FollowingDeepAI @DeepAI
51K Followers 2K Following DeepAI is an experimental AI Product Lab. Sharing cool research at @arxiv_daily For product support email [email protected]Richard Sutton @RichardSSutton
26K Followers 37 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen Technologies, UAlberta, Amii, RLAI, The Royal Society, RichSutton.ethZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Joe Davidson @JoeDavidsonWP
4K Followers 388 Following Washington Post columnist covering the federal government in the Federal Insider (formerly the Federal Diary). Email: joe.davidson[at]washpost[dot]comAditya Soni @adityaunraveled
424 Followers 2K Following Tech Editor @Reuters. Views expressed here are entirely my own and re-tweeting ≠endorsement.Abigail Johnson "AJ" .. @AbigailJHess
3K Followers 915 Following Multimedia Reporter covering the changing ways people learn, earn, and work. Staff editor at @FastCompany. Previously @CNBC & @RobinhoodSnacks.Angela Yang 杨安琪 @Angela_Y_Yang
4K Followers 684 Following @nbcnews internet culture reporter | bylines @wsj, @guardian, @bostonglobe, @poynter | https://t.co/mbZu51MXznAnna Gleason @anna_gle
108 Followers 335 Following @CNBCFastMoney Segment Producer, @nbcuPageProgram alum, avid ceramicist 🏺/ engagements ≠ endorsementsAston Zhang @astonzhangAZ
5K Followers 92 Following Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.Internet Nostalgia @IntNostalgia
6K Followers 0 Following Your daily dose of 80s, 90s & early 00s software, hardware & internet nostalgia 😍👍Next Big Idea Club @NextBigIdeaClub
17K Followers 1K Following The Best New Nonfiction Books Delivered to Your Door. Join the subscription book club curated by Malcolm Gladwell, Adam Grant, Susan Cain, and Daniel Pink.Aleks Phillips @AleksPhillips1
396 Followers 190 Following Senior journo for BBC News, previously Newsweek, Express, Chemist and Druggist, and others. DM for tips/storiesBoyuan Chen @BoyuanChen0
2K Followers 275 Following PhD student @MIT_CSAIL @MITEECS, Ex @GoogleDeepMind, @berkeley_ai; Doing AI & Robotics. Foundational model for decision making. World models and robotics.Radhika Rajkumar @radhikaraj_
60 Followers 377 Following editor, news & features @zdnet | she/her covering synthetic media, gen AI, health tech words in @SPICYZINE @Refinery29 @SurfaceMag [email protected]Jennifer Corbett @JenniferCorbett
9K Followers 326 Following Executive Producer & Head Writer - Star Wars: The Bad Batch ⚓ West Philadelphia, born and raised.Pratyusha Sharma @pratyusha_PS
2K Followers 400 Following PhD student @MIT_CSAIL. Studying 🐳 ,🤖 and language.dr. joy Marie Lisi ra.. @JoyMLRankin
2K Followers 644 Following Research Prof @ NYU. Author: A People's History of Computing in the US from @Harvard_Press. Feminist antiracist historian.Tiya Thomas-Alexander @teayaha
349 Followers 2K Following Journalist. Most recently @timeshighered by way of @cnplus, @columbiajourn'19, @thecaravanindiaMatt Tyson @matttyson
256 Followers 74 Following "You are here because it mattered" - Belinda DeranieriLauren Leffer @lauren_leffer
856 Followers 2K Following Former Bug Scientist / Current Science Journalist/ Contributor @sciam and @PopSci / Bylines also @NatGeo @Gizmodo @AudubonMag Also (at)laurenleffer.bsky.sBrian Bergstein @BrianBergstein
4K Followers 2K Following Ideas editor, Boston Globe: @globeideas @globeopinion. Previously @techreview, @protolifemedia, @ap, among other things. Angeleno in New England.Tom Ambrose @tomambrose89
2K Followers 5K Following Freelance journalist 📝 • I write news for @Guardian 🗞 and about theatre for @WestEndBF and @LondonTheatreR1 🎭 • Got a story? DMs open ✉️Johnny Jackson 💫 @JohnnyEdSouth
307 Followers 432 Following editor, writer | journo | CAPM | paralegal | … retweets are not endorsements, neither follows nor acknowledgments.Ruffini @EenaRuffini
27K Followers 1K Following Emmy, DuPont and Murrow award winning journalist. (No, I am not Adele.)Abby Bertics @AbbyBertics
454 Followers 236 Following phd student at ucsb @geometric_intel; Science&Tech @TheEconomist; volleyball; mit ‘19 ‘22; she/her; my views are 100% my faultFarnaz Jahanbakhsh (@.. @FarnazJ_
1K Followers 577 Following Postdoc at @StanfordHAI, Incoming assistant prof at @UMichCSE in 2024, PhD @MIT_CSAIL | HCI, Social ComputingProf Lennart Nacke, P.. @acagamic
19K Followers 151 Following I share effective strategies to write better research papers and use AI. Wrote 200+ papers with 30k+ citations in under 15 years. Tenured Full Professor.Luiza Jarovsky @LuizaJarovsky
11K Followers 66 Following CEO of https://t.co/ZEJP9oA5pN, PhD Researcher, Latina, Polyglot, Mother of 3. Subscribe to my newsletter ➡️ https://t.co/akCFzWrOduDave W Plummer @davepl1968
46K Followers 59 Following Hi! I'm Dave Plummer. You might remember me from such Windows components as Task Manager, Windows Pinball, Calc, ZIPFolders, Product Activation, etc. Cheers!Jla @3itcom
9K Followers 4K Following Passionné de l'It . Pinte Insterest Je suis personne donc je suis. 😉 .... "Tous les peuples et tous les paysages" Michel Corringe #TweetALaManoTamay Besiroglu @tamaybes
3K Followers 719 Following Thinking about economics, computing and machine learning @EpochAIResearch @MIT_CSAILLori Garver @Lori_Garver
43K Followers 496 Following Co-Founder of @OwensFellowship; board member @WorldViewSpace, @HydrosatI; advisor @SierraSpaceCo, @K2SpaceCo, Former @NASA Deputy Administrator, GM @ALPAPilotsRoss Dawson @rossdawson
119K Followers 27K Following Futurist | Board advisor | Global keynote speaker | AI startup founder | Bestselling author | Podcast host | LinkedIn Top AI Voicekevinwilliams @kevvwill
26K Followers 465 Following Just laugh. It's better that way. Stuff about Barça, pop music, culture; football nerd, writer for Barcelona Football Blog, The Athletic. Pedant, grouch.Max Lu @maxlvhao
2K Followers 2K Following Ph.D. student @ Harvard | Formerly Bloomberg & L.A. Times | UofT Alum | Views my own. like = bookmarkLeon Yin @LeonYin
4K Followers 1K Following investigative data journalist @technology | AI & algo accountability | prev: @TheMarkup | how to: https://t.co/gxcIyhEvNUYupeng Hou @yupenghou97
743 Followers 676 Following PhD student @UCSanDiego. Previously Renmin Univ. of China, Tencent, Alibaba Group, Ant Group. Research on LLMs, RecSys, etc.Anastasia HGY @haydulina
73 Followers 118 Following news journalist, filmmaker and competitive mother of two. I like flying, gardening and bullet journaling (it's a New York thing)Ainara Tiefenthäler @tiefenthaeler
4K Followers 827 Following Video journalist, Visual Investigations @nytimes @nytvideo | DM me! Español • English • Deutsch • FrançaisJonathan Chadwick @jwillchad
1K Followers 2K Following Science and technology reporter at @MailOnline. Cotswoldian in London. 🇪🇺Maggie Harrison Dupr�.. @mags_h11
872 Followers 846 Following Writer for @futurism | DM or email me: [email protected] | https://t.co/G0jDUT3FO7 ~~ https://t.co/XSFUPZVLt8C&EN (Chemical & Engi.. @cenmag
121K Followers 962 Following Sharing the world of #chemistry: News🗞 Research⚗️ Infographics #PeriodicGraphics ℹ Pictures #CENChemPics 📷 Comics #SketchChemistry 🗯 #FluorescenceFriday ❇️Derek Thompson @DKThomp
202K Followers 2K Following Writer @TheAtlantic. "Plain English" podcast host @Ringer. Mondays on NPR's @hereandnow. Co-writing a book about abundance.Bari Weiss @bariweiss
1.0M Followers 5K Following Editor of The Free Press @thefp Host of Honestly @thehonestlypod Head of @nelliebowles fan clubBloomberg Opinion @opinion
536K Followers 887 Following Opinions on business, economics, technology and more from the columnists at Bloomberg Opinion.Parmy Olson @parmy
25K Followers 2K Following Tech columnist for @Opinion covering AI, social media and tech regulation; ex-@WSJ @Forbes, author of 'We Are Anonymous.'🚨 #CHI24 Paper Alert! 🚨 We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy @amyxzh @turingmusician @josephcc @karger @hyeonsuukang. arxiv.org/pdf/2402.17847…
JetMoE technical report is out! The key to train LLaMA2-level LLM with only $0.1M cost: · 2-phase training strategy · MoA + MoE Great work supported by @myshell_ai: · Fully open-sourced · No proprietary data / code needed
🔬 Since a lot of you are asking, here it comes: We reveal the technical report of JetMoE. The key to JetMoE is: · 2-phase training strategy · MoA + MoE In the 2-phase training, you need: · Different data mixtures · Different learning rate schedules In the MoA…
A pathway towards safer and more aligned AI future!
New MIT CSAIL method automatically breaks LLAMA2-7B, GPT-3.5, Stable Diffusion, and more with curiosity-driven exploration! This type of exploration helps test LLMs & vision models by generating diverse inputs/prompts that trigger unwanted responses from a target model:…
Now in its 7th year, the AI Index Report tracks, collates, distills, and visualizes data related to AI. Sign up for the @StanfordHAI newsletter to receive the report when it’s released on April 15. #AIIndex2024 mailchi.mp/stanford.edu/a…
FeatUp A Model-Agnostic Framework for Features at Any Resolution Deep features are a cornerstone of computer vision research, capturing image semantics and enabling the community to solve downstream tasks even in the zero- or few-shot regime. However, these features
Excited and proud to share our #SingleCell dissection of #ALS and #FTLD out in #Cell this week, across 620,000 cells, 44 cell types, 73 donors, and two brain regions. Although ALS affects #movement vs. FTLD #cognition, the two are nearly identical in the cell types, genes, and…
Excited to share our #SingleCell dissection of #MotorCortex in #ALS and #FTLD biorxiv.org/content/10.110… #BetzCells #VENs #C9orf72 #TDP43 #POU3F1 #ADRD #NeuroDegen #MCx #Alzheimer with #SebastianPineda #VeroniqueBelzil #MyriamHeiman #HyeseungLee @B_Fitzwalter @Mohammadi_PhD @MTPA_US
Models often fail under distribution shifts—can pre-training on a large and diverse dataset and then fine-tuning on a task-specific dataset help? W/ @bcohenwang, @josh_vendrow we show that this depends on the specific failure mode. In particular, pre-training can help with…
Presenting a method for training models from SCRATCH using LoRA: 💡20x reduction in communication 💡3x savings in memory - Find out more: minyoungg.github.io/LTE/ - Code available to try out - Scaling to larger models ongoing - arxiv.org/pdf/2402.16828… led by Jacob Huh!
Distributed training using parallel LoRAs, infrequently synced. My fav part is the analogy to git, where lots of coders can work together on a project, coordinated by simple operators like pull, commit, merge. Potential implications toward community training of big models.
Presenting a method for training models from SCRATCH using LoRA: 💡20x reduction in communication 💡3x savings in memory - Find out more: minyoungg.github.io/LTE/ - Code available to try out - Scaling to larger models ongoing - arxiv.org/pdf/2402.16828… led by Jacob Huh!
Announcing SGI 2024! Undergrads and MS students: Apply for 6 weeks of paid summer geometry processing research. No experience needed: 1 week tutorials + 5 weeks of projects. Mentors are top researchers in this emerging branch of graphics/computing/math. sgi.mit.edu
A major challenge to constructing foundation models for decision making is data scarcity. We present a “compositional foundation model”, which addresses this by composing existing foundation models, each capturing a sub-part of decision making. …l-planning-foundation-model.github.io (1/4)
Received my first iOS + macOS kernel CVE! Fixed in XNU for iOS 17 and macOS Sonoma; a full writeup will be posted here soon.
shasum(fun thing) = edf70acbced16270bb490ec0a4fbcf5937d5ad13 Blog post coming soon(tm)
Microsoft, @gutenberg_org, and @MIT have created 5k open-access audiobooks with AI and uploaded them to the major podcast platforms. 🎧 Listen to the collection: msft.it/601499V8Y 📚Learn more about the research: msft.it/601699V8m
@MIT_CSAIL @mhamilton723 @MITEECS ✋✋✋ sign me up for foraging info please 😄
Some news! I'll be joining @BrownCSDept as an assistant professor in fall 2024 :) I'm excited to continue work on participatory, equitable & accountable ML✨
Filmmakers are modern day magicians
Collaboration (as always) is THE key! 👇 Using #AI to Protect Against AI Image Manipulation 👇 @MIT_CSAIL’s “PhotoGuard” develops new AI techniques for countering image manipulation, safeguarding authenticity in our new era of advanced #GenerativeAI models. Recently, advanced…
Happens super often: my research group has hosted several visiting researchers during the years that I've been here. You should totally do it if you're considering a PhD. And if you're in town, you can check out the public events and seminars at csail.mit.edu/events .
Other questions we’ve heard: can a non-MIT student take part in CSAIL, and if so how?
Recently proposed open-source language models have placed an emphasis upon inference speed. Such work has shown us that inference speed can be improved by up to 5X (or more) by making some changes to the decoder-only transformer architecture. Here are three examples that have…