Nal @nalkalc
Researcher in Deep Learning @GoogleDeepMind. Angel investor. Co-creator @GoogleAI Brain Amsterdam, Ex @DeepMind, Edu at Oxford, UvA and Stanford. nal.ai Joined August 2015-
Tweets762
-
Followers35K
-
Following259
-
Likes6K
Introducing Udio, an app for music creation and sharing that allows you to generate amazing music in your favorite styles with intuitive and powerful text-prompting. 1/11
This is wild. Udio just dropped and it's like Sora for music. The music are insane quality, 100% AI. 🤯 1. "Dune the Broadway Musical"
here's an exclusive new udio AI music generation 🫡 source: anon. anon is always the source.
Works on images from your gallery too!
Not sure when this happened but Android phones now seem to offer an "ask @perplexity_ai" option with a right click on highlighted text! 🤯
Your 'moment of doom' for Mar. 24, 2024 ~ Just stop cars. "And yet, the auto industry – which is responsible for more pollution than any other sector, at least in rich countries – still lobbies to worsen emissions reduction targets..." electrek.co/2024/03/23/big…
We collaborated with the European Space Agency to open-source the largest ever earth observation dataset: Major TOM Core! About half of the entire planet is covered. That's 2,245,886 patches of 1068 x 1068 pixels. At 10m resolution, we've got 256 million square km with over 2.5…
Big news from the latest ERA5 data. For the first time in recorded history, the 180-day running mean for the global surface temperature just crossed 1.70°C above the pre-industrial 1850-1900 IPCC baseline. The climate 8-ball says, "F&%kery ahead!"
And for those keeping track, global sea surface temperatures hit a new all-time modern record high yesterday, at 21.15°C. Yep. It's all going swimmingly, as they say.
Please understand how hugely fucking serious our predicament is. Our deranged leaders are sitting back as fossil fuel use and land management for meat etc, is destabilising the conditions that make this planet habitable for us. 🚨
In today's Berardelli Bonus: Earth's sea surface temperatures are off the charts, once again breaking records. And we are seeing the consequences of Earth retaining so much excess heat due to the burning of fossil fuels. Thanks @EliotJacobson for the GFX help. 1/
Breaking News! Code UFB!!! With about six weeks of seasonal warming ahead, global sea surface temperatures are spiking. Yesterday's temperature of 21.10°C just tied the all-time record high sea surface temperature reached August 21-23, 2023.
Okay -- I just did the calculation for myself, and at present the planet is 1.38°C above the 1850-1900 baseline. This number is the forecast average temperature for the period 2014-2033. We're rising about 0.30°C per decade. This puts us over 1.5°C for good by about 2028.
How can AI be used to predict the weather more accurately? ☔
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Richard Socher @RichardSocher
101K Followers 970 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Jeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzJeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsMiles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Petar Veličković @PetarV_93
30K Followers 555 Following Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Associate @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVFelix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sRyno De Jager @RynoDeJager
18 Followers 279 Following Lover of all things tech, @dotnet, @azure, @AIQq @zwu9048
2 Followers 90 FollowingSwarup Dwivedy @swarup5662
9 Followers 43 Following匿名 @tulsida75140181
146 Followers 3K FollowingEric Chen @erico_cheny
205 Followers 657 Following hacking on ai and 3d at stealth_startup | gradient ascending towards my life's work @MIT 2025精神病狗婊子杂.. @frkglp
0 Followers 2K Following 神病狗婊子杂种邓小平,刘少奇就是整个世界的敌人,它那套歪把戏不除,世界战乱不断。Cgkl精神病狗婊子杂种习近平被凌迟处死。Cgk凌迟处死精神病狗婊子杂种中共狗屁家族邓小平,习近平,陈云,刘少奇,陈一新,张又侠,何卫东,刘振立,苗华,董军。锸s你跟踪本人的精神病狗婊子杂种全部中共空军、警察、台湾间谍FlashHacker777 @StarsMatrix777
753 Followers 2K Following I Killed @Twitter & @elonmusk Made @X I am a Video Game Streamer ⚔️🎮⚔️... @dercrazypug
60 Followers 145 Followingcoffee & AI @realcoffeeAI
42 Followers 597 FollowingAnh Nguyen @AnhNguyenWho
61 Followers 2K Following startup stalker | current @tobikodata | prev. intern @netflix, @snap, @confluentincRiccardo Mereu @rmwu36
60 Followers 647 FollowingSam Coward @samcoward
386 Followers 1K Following Father, husband, subpar musician. Platform Engineering @VMWare Tanzu. XP, Agile. Leveling up on AI and ML; accelerating.Betty @jkuo45
11 Followers 393 FollowingRoss @rossheatoncom
56 Followers 110 FollowingUmiltcaho @umiltcaho27712
14 Followers 301 Following kya dekhne aae ho. Bs itna smjh lo tumse thoda sa zyada smjhdar huHassan Kassem Niyi @hkniyi
335 Followers 308 Following Managing Partner at https://t.co/aqf80cq6ZR . A Software Engineer, #CloudEngineer | #DevOps Engineer #WebDeveloper and an innovative #entrepreneur.HoshAI.com @hoshaicom
16 Followers 84 Following Your AI-powered companion for generating text, images, audio, and video. Sign Up at https://t.co/ppEPkf6VlT today! #hoshaiHarish Saravanan @Harish_Sarav
60 Followers 1K FollowingNoah El Rimawi-Fine @NoahE162
10 Followers 37 Following MSc. Computer Science @ McGill/Mila - Interested in Flow Matching and Geometric Deep LearningMiguel Ramos @MiguelRamosPM
320 Followers 518 Following Product Manager @Google. Leading Google AI (Gemini) and Firebase SDKs🔥. Ex-Microsoft📎. Opinions are my own. From Sevilla,🇪🇸 @Seattle, 🇺🇸.Sathish Kasilingam @sathishisak
162 Followers 2K Following Interests lie in manufacturing, software, quality, CNC Machine analytics, Data analytics, product management and startupsJB @JB38076320
410 Followers 801 Following Academic staff - Research, @Stanford University @StanfordAIMI Affiliate Medical AI Building LLM's right now!ssteevens @Steevens43
151 Followers 4K Followingجناب تنبل @grothendieck79
4 Followers 93 FollowingJesse @j_neumatic
15 Followers 91 Following Co-Founder of @ai_portal_one Pushing the Boundaries of Multi-Agent Collaboration 🤖 #AI #Agents #GenAIManu Gupta @ManuGup31501641
1 Followers 125 FollowingBot person (Ki / Ken).. @botyetnotbot
31 Followers 291 Following Fultoos timepass. Jobless jumbo. Motivation seeker. Multi interest conservative heteroartificialyao xuejie @mavisyxj
38 Followers 107 FollowingMohammed Hamza @mhamza_08
58 Followers 3K FollowingYixuan Ding @YixuanD2701
2 Followers 13 FollowingKa Ho Wu @kahowuture
94 Followers 811 Following 3X exits entrepreneur | Pioneering intent computing at UtopiaOS | Pronouns: Giga/ChadMax Webster @MaxAWebster
4K Followers 4K Following ⚡️[email protected] #nostr: npub18lzls4f6h46n43revlzvg6x06z8geww7uudhncfdttdtypduqnfsagugm3 Helping entrepreneurs build the hivemind. And I rap: https://t.co/XoSkK4HLc8randomuser @mugakame
10 Followers 60 FollowingMP @_MParmar
23 Followers 374 Following If a Truth doesn't contain a Paradox, then it's not complete ~ mpsimrat hanspal @simsimsandy
80 Followers 437 Following Exploring LLMs | Data scientist with a curious engineering mindJun Kim @junkim_100
13 Followers 109 FollowingVed Patwardhan @vedpatwardhan
10 Followers 76 FollowingMohammad Reza Samsami @M_R_Samsami
267 Followers 345 Following AI Researcher at @Mila_Quebec & @ServiceNowRSRCH. Developing agents capable of reasoning in complex situations. Ex-intern at @EPFL_en.SillySabra @SillySabra
0 Followers 53 Followingpayamrajabzadeh @payamrajab67915
26 Followers 713 Following(•̀⌄•́) @ukzukz1
21 Followers 99 FollowingSoumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Jürgen Schmidhuber @SchmidhuberAI
107K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Richard Socher @RichardSocher
101K Followers 970 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Jeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistJeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)NeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceChristopher Manning @chrmanning
126K Followers 115 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVFelix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sNando de Freitas 🏳.. @NandoDF
97K Followers 658 Following I research intelligence to understand it and to harness it wisely. Path: Wits, Cambridge, Berkeley, UBC, Oxford, DarkBlueLabs, Google DeepMindTung Nguyen @tungnd_13
1K Followers 821 Following Ph.D. Student in CS at UCLA. Working on Sequence Modeling and Decision making.Keerthana Gopalakrish.. @keerthanpg
13K Followers 821 Following Building Embodied AGI. Research @DeepMind. Opinions my own.Vinod Khosla @vkhosla
632K Followers 575 Following entrepreneurship zealot, grounded technology possibilist, believer in the power of ideas, passionate about sustainability & impactPerplexity @perplexity_ai
132K Followers 29 Following Our mission is to serve the world’s curiosity. https://t.co/BBZ1kG0TVGHyung Won Chung @hwchung27
18K Followers 229 Following Research Scientist @OpenAI. Past: @Google Brain / PhD @MITJeff Donahue @jeffdonahue
868 Followers 348 Following Research Scientist @DeepMind Previously: PhD @berkeley_aishira @shiraeis
13K Followers 1K Following AI girl. Founder of a stealth AI startup. Prev: AI @MIT, @Intel, @CDCgov @uchicagoSara Rutz @saravrutz
179 Followers 148 Followingaugustus odena @gstsdn
10K Followers 1K Following cofounder at @AdeptAILabs. trying to do something at least twice as cool as the coolest thing I've already done.Aella @Aella_Girl
205K Followers 369 Following ⚜️whorelord⚜️, vexworker, survey artist, way too earnest Discord: https://t.co/S1MaMdCwyKKaja Kallas @kajakallas
277K Followers 489 Following Eesti Vabariigi peaminister, Prime Minister of Estonia 🇪🇪Hannah Rose Kirk @hannahrosekirk
3K Followers 683 Following AI researcher trying to make sense of all things cyberspace 🤖 Uni of Ox PhD (loading…) @oiioxford & @OxfordAI. Prev @turinginst & @Cambridge_Uni. Visitor @ NYUHattie Zhou @oh_that_hat
5K Followers 765 Following Finding \hat{y} Give me anonymous feedback: https://t.co/7aBNrpbad8Peter Kalmus @ClimateHuman
339K Followers 13K Following NASA climate scientist. Arrested for defending Earth. @ClimateAd, @EarthHeroOrg. Opinions mine. #EmergencyModeLisha @lishali88
16K Followers 918 Following Make games with @rosebud_ai : Prompt, Publish, Play. 🌹 https://t.co/zDq6c6v7D1 🎓 Founder. PhD AI Berkeley 👼 Angel investing https://t.co/VMlOAnTC1jIrwan Bello @IrwanBello
6K Followers 2K Following Supercomputers & Friends AGI research & products ex @OpenAI, founding team @character_aiHarm de Vries @harmdevries77
992 Followers 148 Following Lead of the LLM lab @ServiceNowRsrch, co-lead @BigCodeProjectRodney Brooks @rodneyabrooks
31K Followers 37 Following Distinguishing hype-notism from plausibility one press release at a time. I post regularly as @rodneyabrooks at https://t.co/sF7HmACXdd cofounder at https://t.co/LUTTbi3pdsMickey Friedman @mickeyxfriedman
13K Followers 2K Following Co-founder @flairAI_🔥 | AI Product Photography | AI Grant ‘22 | ex Tesla, Adobe, UChicago etc.Oscar Täckström @OscarTackstrom
123 Followers 404 Following Applying machine learning to RNA design at https://t.co/CaecGj7MjvNikita Arora @Nikita_Arora17
4K Followers 847 Following Investor @dig_ventures. But mostly, just curious. Colitis advocate. And oh, Tennis is life. @socialleverageCarolina Lucas @carolilucas
3K Followers 480 Following Assistant Professor @YaleIBIO ImmunoVirus ❤️ Alum @Virusesimmunity lab | #womeninSTEM 🇧🇷/🇺🇸Nature Communications @NatureComms
238K Followers 522 Following Nature Communications is an open access journal publishing high-quality research in all areas of the biological, physical, chemical and Earth sciences.Timothy Gowers @wtgow.. @wtgowers
44K Followers 188 Following Mathematician. Professeur titulaire de la chaire Combinatoire au Collège de France. Also fellow of Trinity College Cambridge.Igor Babuschkin @ibab
44K Followers 684 Following Maybe the real AGI was the friends we made along the way. @xAIScott Reed @scott_e_reed
16K Followers 387 Following Research Scientist at NVIDIA working on generalist embodied agent researchAlex Cohen 🤠 @anothercohen
189K Followers 1K Following Having fun on the internet. Building something new. Side project: https://t.co/XmAstakS3p. Previously led consumer product @carbonhealthFanny Yang @FannyYangETH
917 Followers 86 Following Assistant Professor @CSatETH Zurich and @ETH_AI_Center, heading the Statistical Machine Learning group. Postdoc @Stanford. PhD @Berkeley_EECS. Violinist.ETH AI Center @ETH_AI_Center
3K Followers 300 Following Welcome to the ETH AI Center! We are @ETH 's central hub leading the way towards trustworthy, accessible and inclusive #artificialintelligenceCassandra B.C. @michaeljburry
1.5M Followers 0 FollowingAnthony Goldbloom @antgoldbloom
44K Followers 922 Following Working on something new; investment partner at @aixventureshq; previously CEO of @kaggleHugging Face @huggingface
343K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhateNeal Khosla @nealkhosla
24K Followers 929 Following I judge myself on what my 8 and 80 year old selves would think. CEO of @CuraiHQ, an AI-powered virtual clinic on a mission to improve access to care at scale.Aakanksha Chowdhery @achowdhery
7K Followers 3K Following LLMs @ Google DeepMind :: PaLM, Gemini // Previously @MSFTResearch, @Stanford, @Princeton // views my own and subject to change🇺🇦 Dzmitry Bahd.. @DBahdanau
6K Followers 36 Following Research Scientist & Research Lead at ServiceNow Research Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.Mark Chen @markchen90
10K Followers 245 Following Head of Frontiers Research at OpenAI. Coach for the USA IOI Team.Jeremiah Harmsen @JeremiahHarmsen
1K Followers 488 Following Creator of #TensorFlowHub and @TensorFlow Serving. Lead in Google Brain.Russell Kaplan @russelljkaplan
11K Followers 653 Following Director of engineering @Scale_AI. Former startup founder, ML scientist @Tesla Autopilot, researcher @StanfordSVL.#TeamSeas @teamseas
57K Followers 142 Following Cleaning up 33M pounds of trash w/ @mrbeast @markrober and 1000s of your favs. Every $1 donated is one less pound of trash. Join the team at https://t.co/yT97nqfwb5At the UN Plastics Treaty negotiations today. Not the type of environment I feel comfortable in. But: it’s encouraging to have seen the plastic pollution problem grow from something most people I spoke to hadn’t heard of to now being discussed by all countries on Earth.
Mind keeps getting blown every time I see this comparison between @OpenAI GPT-4, @AnthropicAI Claude Opus and @Meta Llama 3 70B on @GroqInc in a post I'm putting together... ~17x lower input cost 🤯 ~38x lower output cost 🤯🤯 14x faster @ ~280 vs ~20 tokens per sec 🤯🤯🤯
I use @perplexity_ai so much it has a dedicated button on my mouse. #SmartActions on Logi Options+ means all I have to do is highlight text, press my button and let Perplexity do the rest.
Audentis Fortuna iuvat
talked about the roman empire the whole time @AravSrinivas
One with the iconic black leather
The Arctic permafrost region is now emitting more carbon into the atmosphere than it absorbs, causing the planet to heat even further. newscientist.com/article/242673…
The 2023 Turing award, often referred to as the Nobel prize for computing, goes to Avi Wigderson for his work on understanding how randomness can improve computer algorithms. newscientist.com/article/242591…
🛶 Een deel van het water in het centrum willen we vanaf 2025 vrijmaken voor alleen plezierboten die varen op elektriciteit, of roei- of trapboten. 🗣️ Je kunt t/m 10 juni hierover je mening geven, schriftelijk of tijdens een inloopbijeenkomst. ⤵️ amsterdam.nl/nieuws/nieuwso…
With the right political action, we can trigger a new surge of European competitiveness. At the last #EUCO, EU leaders gave us a clear mandate to turn this political will into action. So Europe remains the global beating heart of industry & innovation ↓ x.com/i/broadcasts/1…
Thing that most impresses me about Llama 3: how did they pack so much knowledge and reasoning into a dense 8b and a 70b so well, when everyone else has been scaling sparse MoEs. This still doesn’t mean having a lot of GPUs is not important. Probably even more important…
Hey @GWR, might be time to update this one :)
BREAKING: We just made our largest ever plastic catch. Interceptor 006 in the Rio Las Vacas, Guatemala, stopped 272 truckloads of trash - equal to 1.4 million kg (3.1 million lbs) - from flowing into the Caribbean Sea. All in a single evening.
Just wild to see how the trash pack densifies a few minutes into this video youtube.com/watch?v=pGY4rp…
@tsarnick AI might be the only way humans can understand their own brains better with.
@anuatluru I think changing default to no instead of yes is the biggest change one can do.
Llama3 was trained on 15 trillion tokens of public data. But where can you find such datasets and recipes?? Here comes the first release of 🍷Fineweb. A high quality large scale filtered web dataset out-performing all current datasets of its scale. We trained 200+ ablation…
We have just released 🍷 FineWeb: 15 trillion tokens of high quality web data. We filtered and deduplicated all CommonCrawl between 2013 and 2024. Models trained on FineWeb outperform RefinedWeb, C4, DolmaV1.6, The Pile and SlimPajama!
BREAKING: We just shut down a gala honoring U.S. Senator Lisa Murkowski. Murkowski is a murderer. She incinerates us to enrich her cronies. As Chevron's top lobbyist gave her an award, we stepped in and stopped the ceremony. Respect us or expect us. 🧵
@AravSrinivas Thanks Aravind .. Meta. Ai is not available in India yet.. So looks like perplexity labs will be my first taste of llama 3 here.