-
Tweets9K
-
Followers14K
-
Following1K
-
Likes8K
Voyager 1, launched Sept 5, 1977, is furtherest human artifact from Earth, over 15B miles, 24B kms. Magnificent remote debugging has it back sending understandable data after 6 month outage. Flight Data Subsystem computer, 7400 series TI chips (see image), with 8K 16 bit words of…
introducing micro-musicgen, a new family of super small musicgen-based models for experimental sample creation and latent space exploration. the first entry in the series is a model trained on chopped jungle drum breaks called micro-musicgen-jungle. huggingface.co/pharoAIsanders…
Introducing Meta Llama 3: the most capable openly available LLM to date. Today we’re releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of their sizes. Today's release includes the first two Llama 3…
Algorithmic progress is faster than hardware progress. arxiv.org/abs/2403.05812
@syhw ...and we still cannot train deep models without residual connections.
To all the defeatists who think there is nothing else but scale: * 5 years between Self-Attention Is All You Need and FlashAttention * Transformers still require warmup. Researchers: get back to work! The future is bright :)
🤯📽️🏃Annoucning controllable video generation workshop at ICML2024! Super excited for speaker line up, and looking forward to seeing submissions exploring controllability in video generation. Submission deadline is 31st May AOE (but why wait till then if you can submit now?!)
🤯📽️🏃Annoucning controllable video generation workshop at ICML2024! Super excited for speaker line up, and looking forward to seeing submissions exploring controllability in video generation. Submission deadline is 31st May AOE (but why wait till then if you can submit now?!)
Strong and kind team to work with!
SWE-agent is our new system for autonomously solving issues in GitHub repos. It gets similar accuracy to Devin on SWE-bench, takes 93 seconds on avg + it's open source! We designed a new agent-computer interface to make it easy for GPT-4 to edit+run code github.com/princeton-nlp/…
Before enlightenment: add layers, train longer. After enlightenment: add layers, train longer.
The CodeGen team at FAIR *in Paris* is recruiting junior and senior research engineers! metacareers.com/jobs/417615930… Come work with us @jadecopet @b_roziere @qcar_ @FabianGloeckle @KunhaoZ et al., and folks in EMEA @jnsgehring @TacoCohen @adiyossLC @FelixKreuk et al.
With the new release of Gemma-2B, I thought I'd see how torch.compile performs. Gemma 2B for a single prompt runs at 144 tokens/s on a V100, a 4x increase over the uncompiled HF version. We're working with @huggingface to upstream these improvements too!
Come work with Sida and us!
For those of you who were wondering what I’ve been doing since I joined @Meta Reality Labs late 2022. Here is the first detailed scientific communication about our work. You can read the paper at: biorxiv.org/content/10.110…
For those of you who were wondering what I’ve been doing since I joined @Meta Reality Labs late 2022. Here is the first detailed scientific communication about our work. You can read the paper at: biorxiv.org/content/10.110…
The @BigCodeProject collaboration has been quietly gathering and processing the *largest* dataset of quality code ever and now they trained models (3B, 15B) on it which outperform existing OSS models on many benchmarks And they released all of this (data, recipes, models) in the…
Enough with the hyperbole from all sides! I'm glad to have participated in this work taking a principled approach towards assessing the societal impact of Open Foundation Models. There is a lot more work to do of course, but this is a step in the right direction.
Enough with the hyperbole from all sides! I'm glad to have participated in this work taking a principled approach towards assessing the societal impact of Open Foundation Models. There is a lot more work to do of course, but this is a step in the right direction.
“Coding” was never the source of value, and people shouldn’t get overly attached to it. Problem solving is the core skill. The discipline and precision demanded by traditional programming will remain valuable transferable attributes, but they won’t be a barrier to entry. Many…
“Coding” was never the source of value, and people shouldn’t get overly attached to it. Problem solving is the core skill. The discipline and precision demanded by traditional programming will remain valuable transferable attributes, but they won’t be a barrier to entry. Many…
We built an *action-controlled video generative model* with video data only 🤯 GenAI now officially also means generative environments! So incredibly proud of this work that I spent my first year at @GoogleDeepMind on 💙 more work to be done, watch this space!
We built an *action-controlled video generative model* with video data only 🤯 GenAI now officially also means generative environments! So incredibly proud of this work that I spent my first year at @GoogleDeepMind on 💙 more work to be done, watch this space!
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York University
Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & Graphs
Edward Grefenstette @egrefen
36K Followers 774 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
François Fleuret @francoisfleuret
31K Followers 456 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Noam Brown @polynoamial
34K Followers 611 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMU
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋
Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeV
Michal Kubizna @michalkubizna
15 Followers 19 Following
Janhavee Shinde @SJanhavee
55 Followers 2K Following
Tongzhou Wang @TongzhouWang
1K Followers 1K Following representation of type 1→2 agi @mit Ex @pytorch @MetaAI @berkeley_ai
flopsycakes @flopsycakes
84 Followers 299 Following
Hugo Laurençon @HugoLaurencon
564 Followers 182 Following ML research engineer @huggingface Les yeux rivés sur la loss
zero @Billeraa
161 Followers 221 Following
Ilaria Manco @Ilaria__Manco
2K Followers 936 Following PhD student @c4dm, working on multimodal learning for music understanding • Former intern @GoogleDeepMind @AdobeResearch @Sony • DJ
Phillip Lippe @phillip_lippe
2K Followers 426 Following PhD student at @UvA_Amsterdam (@quvalab), @GoogleDevExpert JAX/Flax | Prev.: Intern @GoogleDeepMind, @MSFTResearch
Chloe Walters @TheRobotChloe
1 Followers 9 Following
William Arnsson 🌍 .. @williamarnsson
0 Followers 322 Following All opinions are my own. RT≠endorsements
DurisTom @_DurisTom
19 Followers 77 Following Student in Computational Cognitive Neurosciences and Artificial Intelligence. Loving networks.
insop @insop_song
0 Followers 622 Following
Ahmad Al-Dahle @Ahmad_Al_Dahle
4K Followers 53 Following #Girldad of twins. Leading GenAI @ Meta (llama, imagine, meta ai and more)
Kirito (e/acc) 🏴�.. @bronzeagepapi
3K Followers 5K Following engineer scientist artist –– moloch disrespectoor // qualia connoisseur // tensor whisperer // epistemology enjoyer // kardashev mechanic // bounty hunter
Thalia Estens @ThalEstMu
16 Followers 255 Following
Abe Chide @AbeChide
0 Followers 124 Following
Richard Collins, The .. @RichardKCollin2
13 Followers 22 Following Internet policies, global issues, open sharing, open learning.
Pensé FFun @inftyCategory
113 Followers 6K Following
sam manning @sj_manning
757 Followers 2K Following Penelope, Otis, and Annie's dad. Working to improve decision making so that the economic impacts of advanced AI are positive and broadly distributed (@GovAI_)
Rahul Jauhari @_rahuljauhari
6 Followers 159 Following
Advait Patole @advait_patole
14 Followers 970 Following
Muizz @muizzkhan77
31 Followers 1K Following
Aston Zhang @astonzhangAZ
5K Followers 92 Following Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.
Charles Feinn @dynamics
200 Followers 534 Following learning & occasionally shouting thoughts into the void
Afroz Mohiuddin @afrozenator
1K Followers 5K Following Research Engineer at Google Brain. Interested in Science, Psychology, Investing, Design and generally almost everything. Good Thoughts, Good Words, Good Deeds.
Philippa Emma @whjncsrthf
18 Followers 806 Following
Dada Test @testdada59
5 Followers 33 Following
Taishi @Setuna7777_2
2K Followers 3K Following CS M1 at @tokyotech_jp advised by @rioyokota 未踏TG23 Research intern: @SakanaAILabs
parag_shah @parag_shah
587 Followers 2K Following student forever: human values, coding, arts, music... हर कण हर क्षण ... समर्पण! Tweets are personal. Retweets are not endorsements.
João Maria Janeiro @JoaoMJaneiro
10 Followers 45 Following PhD Student @ Meta AI Paris & Sorbonne University
Rational Animations @RationalAnimat1
2K Followers 3K Following YouTube channel about truth-seeking, the future of humanity, and much more. With animations and colorful doggos.
EO @EO84494235
63 Followers 1K Following
Gautham @ALongDeadStar
346 Followers 2K Following A tiny speck of star dust suspended in an infinite cosmos 💫🪐
Gabe Gordbegli @gordbegli
37 Followers 107 Following
Daniel Doyle @DanDoyle__
47 Followers 668 Following
Rohan Thakker @RoboticistRohan
170 Followers 375 Following Autonomy Lead, Project EELS (Space Snake Robot 〰️) Robotics Researcher @NASAJPL 🚀
Niðal نضال @imleslahdin
2K Followers 680 Following What is the Kolmogorov Complexity of Small Language Models?
king @nguynking
33 Followers 278 Following
⌬¯\_(ツ)_/¯�.. @doublelifeofher
58 Followers 630 Following
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York University
Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.
Jürgen Schmidhuber @SchmidhuberAI
107K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
Richard Socher @RichardSocher
101K Followers 970 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.
Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & Graphs
Edward Grefenstette @egrefen
36K Followers 774 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
François Fleuret @francoisfleuret
31K Followers 456 Following Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality.
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Noam Brown @polynoamial
34K Followers 611 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMU
Tim Dettmers @Tim_Dettmers
29K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Ryan N. @RyanNoordally
8K Followers 797 Following "Ni peur, ni haine, c'est là notre victoire !" A. C. L'État de siège
Sharon Zhou @realSharonZhou
23K Followers 1 Following Building the future of LLMs | Cofounder & CEO, @LaminiAI | Prev: CS Faculty & PhD @Stanford. Product @Google. @Harvard | @MIT 35 under 35. Angel investor.
Vertaix® @Vertaix_
2K Followers 35 Following Research lab @Princeton led by @adjiboussodieng. We work at the intersection of artificial intelligence (AI) and the natural sciences.
Matt Shumer @mattshumer_
51K Followers 1K Following CEO @HyperWriteAI, @OthersideAI - I make AIs do the impossible.
Hugo Laurençon @HugoLaurencon
564 Followers 182 Following ML research engineer @huggingface Les yeux rivés sur la loss
Phillip Lippe @phillip_lippe
2K Followers 426 Following PhD student at @UvA_Amsterdam (@quvalab), @GoogleDevExpert JAX/Flax | Prev.: Intern @GoogleDeepMind, @MSFTResearch
aaron abebe @mcaaroni
183 Followers 194 Following programmer, musician and everything in between. ex ml lead: @okio_ai ex co-founder: https://t.co/9KbYHHEvqY
Ahmad Al-Dahle @Ahmad_Al_Dahle
4K Followers 53 Following #Girldad of twins. Leading GenAI @ Meta (llama, imagine, meta ai and more)
Aston Zhang @astonzhangAZ
5K Followers 92 Following Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.
Aude Durand @aude_drn
166 Followers 65 Following
Dhruv Mahajan @dkm2110
36 Followers 36 Following Research Scientist at Meta AI. Interested in all things related to Computer Vision and Machine Learning. Father of 1. (Happily) Married
Ragavan @ragavan
949 Followers 647 Following Llama @ Meta. Prev: General Catalyst, Facebook AI, Mozilla. Increase access & opportunity for every human.
Shunyu Yao @ShunyuYao12
7K Followers 857 Following Language agents (ReAct, Reflexion, Tree of Thoughts) for digital automation (WebShop, SWE-bench, SWE-agent)
Jaime Sevilla @Jsevillamol
2K Followers 321 Following Director of @EpochAIResearch. Technological forecasting and trends in Machine Learning.
Russell Kaplan @russelljkaplan
11K Followers 653 Following Director of engineering @Scale_AI. Former startup founder, ML scientist @Tesla Autopilot, researcher @StanfordSVL.
Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻
Quentin Anthony @QuentinAnthon15
1K Followers 126 Following I make models more efficient. Google Scholar: https://t.co/kzVsAKPdrp
Bruno Levy @BrunoLevy01
9K Followers 1K Following @[email protected] Inria Research Director / Computational Physics/Cosmology / Scientific Director of Program Inria Quadrant / #riscv ambassador
Max Brodeur-Urbas @MaxBrodeurUrbas
3K Followers 230 Following Co-Founder @AgentHub_AI (YC W24) Ex-Microsoft
Clémentine Fourrier .. @clefourrier
3K Followers 301 Following Leaderboards & evals research @HuggingFace 🐍✨ "The future is already here, it’s just not very evenly distributed" (Gibson)
John Yang @jyangballin
2K Followers 447 Following CS/NLP MS student @princeton_nlp Previously @Berkeley_EECS
Dwarkesh Patel @dwarkesh_sp
54K Followers 699 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Un
Eric Steinberger @EricSteinb
7K Followers 478 Following Writing code that writes code on a mission to build safe superintelligence | CEO/cofounder @magicailabs
Brian Chau @psychosort
11K Followers 675 Following Executive Director @aftfuture. Emergent Ventures 2022, IOI Gold 2017. e/🇺🇸
AI Now Institute @AINowInstitute
56K Followers 1K Following The AI Now Institute produces diagnosis and actionable policy research on artificial intelligence.
Naveen Rao @NaveenGRao
28K Followers 785 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.
Georgi Gerganov @ggerganov
38K Followers 243 Following Not AI | 0x0e59 0x2550 24th at the Electrica puzzle challenge
Jacob Collier @jacobcollier
145K Followers 450 Following Questor of delicion and nutrition; 6-time Grammy-award-winning North Londoner
Jacob Austin @jacobaustin132
3K Followers 797 Following @Google @DeepMind researcher. AI for math and science. Coding. Gemini. I also play piano. NYC. Opinions my own
George Hotz 🌑 @realGeorgeHotz
248K Followers 174 Following President @comma_ai. Founder @__tinygrad__
the tiny corp @__tinygrad__
33K Followers 63 Following We make tinygrad. Our mission is to commoditize the petaflop.
Soham De @sohamde_
2K Followers 975 Following Research Scientist at DeepMind. Previously PhD at the University of Maryland.
Cognition @cognition_labs
123K Followers 19 Following Makers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
Neal Wu @WuNeal
15K Followers 390 Following Building @cognition_labs. Previously @tryramp, @GoogleBrain, @Harvard, competitive programming (featured in @Wired). Created https://t.co/pihw5AGvbV.
Fireworks AI @FireworksAI_HQ
5K Followers 65 Following 🎆 Generative AI Platform built for developers
Remi Cadene @RemiCadene
8K Followers 587 Following Robotics at Hugging Face Ex-Tesla Autopilot Optimus Postdoc Brown, PhD Sorbonne
Databricks Mosaic Res.. @DbrxMosaicAI
30K Followers 115 Following We remove the barriers to state-of-the-art generative AI model development and make data + AI available to all.
Abhinav Gupta @backpropper
800 Followers 5K Following phd student @Mila_Quebec | ms @CILVRatNYU @NYU_Courant | previously @GoogleDeepMind @AIatMeta @GoogleAI @labsdotgoogle @MSFTResearch @AdobeResearch
Nik Shevchenko @kodjima33
6K Followers 607 Following Thiel Fellow, Founder | SF, Looking for cofounders: https://t.co/f0wOnG9iz9 | https://t.co/G7UOPzO3tm
Alex Reibman 🖇️ @AlexReibman
23K Followers 803 Following Accelerating @agentopsai @foomvc Agents, ML, math, and data viz. Hack reporter🕶️
Aiswarya Sankar @Aiswarya_Sankar
1K Followers 554 Following Building Engineering Intelligence @ https://t.co/gD9htDkbVM Ex-Uber and https://t.co/eCKPEZcg6n ML Collective Cal bear 🐻
Anirudh Goyal @anirudhg9119
5K Followers 486 Following Gemini ♊ Spent time at @Berkeley_EECS, @MPI_IS, @DeepMind.@pmddomingos The emergency is that llama is getting so good… we know they are dangerous - I mean look at this ferocious animal terrorizing Berkeley students. @ylecun must stop this!
Le saviez vous ? C'est en observant les clients d'un bar PMU qui diffusait CNews en boucle que Platon inventa le mythe de la taverne.
@sarahookr @cohere @cohereForAI Love this, congrats Sara 💙
HELM Lite v1.2.0 is out! Datasets: NarrativeQA, NaturalQA, OpenbookQA, MMLU, MATH, GSM8K, LegalBench, MedQA, WMT14 Results (we still need to add Claude 3, which requires more prompt finagling): crfm.stanford.edu/helm/lite/v1.2…
once @ylecun told me (heavily paraphrased), it's not F=ma but \min (F-ma)^2. i didn't realize its importance, but it is perhaps the most enlightning perspective i've ever heard.
We had a small party to celebrate Llama-3 yesterday in Paris! The entire LLM OSS community joined us with @huggingface, @kyutai_labs, @GoogleDeepMind (Gemma), @cohere As someone said: better that the building remains safe, or ciao the open source for AI 😆
Predictions: >=2 orgs will get 35% on SWE-bench by Aug 1, 2024. A fully open source system will reach 35% by Nov 1, 2024. Probably based on SWE-agent + ACI improvements: debugger, better code retrieval, lang. server protocol. The LM will be finetuned on ~500 good trajectories
@syhw @PandoXiloscient @airkatakana @francoisfleuret Of course :)
Yay! Three years after @raoult_didier @Pr_Chabriere_E and @IHU_Marseille filed a complaint against me for harassment and blackmail, the Marseille Procureur tells me today they could not find any grounds for criminal prosecution.
Voyager 1, launched Sept 5, 1977, is furtherest human artifact from Earth, over 15B miles, 24B kms. Magnificent remote debugging has it back sending understandable data after 6 month outage. Flight Data Subsystem computer, 7400 series TI chips (see image), with 8K 16 bit words of…
Technical debt is bad, but intellectual debt is far worse. You can't refactor lack of understanding.
WARNING: these models WILL sound bad to a lot of people. the goal is not create pleasant sounding music, but to spark creativity by using the weird sounds of neural codecs for music production and sampling!
introducing micro-musicgen, a new family of super small musicgen-based models for experimental sample creation and latent space exploration. the first entry in the series is a model trained on chopped jungle drum breaks called micro-musicgen-jungle. huggingface.co/pharoAIsanders…
Delighted to share our new preprint! with @AlecMarantz, @davidpoeppel and @JeanRemiKing: biorxiv.org/content/10.110… "Hierarchical dynamic coding coordinates speech comprehension in the brain" Summary below 👇 1/8
@jeremyphoward @soumithchintala Absolutely! I remember this call! One of the things I learned quickly as an exec is that "getting the true story" was always very challenging as everyone wanted to manage me! One of the many reasons I love open source is it doesn't give a damn about org charts!
Another cool story about Mike and open source! Aside: Mike presenting work I did on Starcraft RL agents as a FAIR intern in his F8 2018 keynote was one of the coolest moments of my PhD.
@jeremyphoward @soumithchintala Absolutely! I remember this call! One of the things I learned quickly as an exec is that "getting the true story" was always very challenging as everyone wanted to manage me! One of the many reasons I love open source is it doesn't give a damn about org charts!
True Story! One of the many reasons I love open source is it doesn't give a damn about the org chart or "managing up." If people outside of FB/Meta didn't use or like our OSS then something was wrong with it. PyTorch succeeded because of the hyper focus on developer…
FB/Meta senior mgt has cared a lot about AI for many years. By way of example, here's a true story I haven't told before... Do you remember when Zuck was giving testimony to congress in April 2018? I was watching it live, when the phone rang. It was the CTO of Facebook.
I have to say it because @awnihannun is quick to give credit to others but doesn’t take much for himself. This performance improvement largely comes from his relentless hunting down of every kind of overhead in MLX the past weeks. Kudos!!!
MLX 0.10 → 0.11, faster generation across model sizes and machines. tokens-per-second for 4-bit models:
Trends for United States
You might like
