Erich Elsen @erich_elsen
Adept. Previously Deepmind, Google Brain, Baidu SVAIL. LLMs, exascale computing, systems research, GPU nerd. San Francisco Joined August 2013-
Tweets349
-
Followers2K
-
Following260
-
Likes439
Supercomputers should stop using the number of "cores" as a metric. It makes obscures the useful information, like how many actual GPUs are in the system. Even worse, is adding the number of GPU and CPU "cores" together and providing just one number that is entirely meaningless.
I'd be willing to pay a fuel surcharge to never fly on the #737MAX . @AlaskaAir @united
How do EAs feel about Pascal's wager? I feel like the argument for doom and existential risk is not any different. Even if there's an infinitesimal but non-zero chance, the reward is negative infinity, so the only rational thing to do is stop now. But I don't think they are, as…
So true.
Quadratic attention has been indispensable for information-dense modalities such as language... until now. Announcing Mamba: a new SSM arch. that has linear-time scaling, ultra long context, and most importantly--outperforms Transformers everywhere we've tried. With @tri_dao 1/
"Only GPT-4V and Fuyu-8B get the price right" Fuyu-8B is between 100-1000x smaller than GPT-4V!
"Only GPT-4V and Fuyu-8B get the price right" Fuyu-8B is between 100-1000x smaller than GPT-4V!
Caring about h index is mostly silly, but if you do, then this makes a great point -- you have to adjust for the baseline! Publishing a smaller number of highly impactful papers >> many marginal ones.
Caring about h index is mostly silly, but if you do, then this makes a great point -- you have to adjust for the baseline! Publishing a smaller number of highly impactful papers >> many marginal ones.
Super exciting to see people building on Experiments and figuring out useful things they can do with it. Build build build.
Super exciting to see people building on Experiments and figuring out useful things they can do with it. Build build build.
Calculus spends too much time teaching students how to analytically find F(x) for a given integral and not nearly enough time on: 1. Why it matters 2. The "Sum" i.e. what the integral sign really means. If you understand this, then doing analytic integrals is no longer a useful…
I'm happy we were able to release a model with a slightly different architecture from all other open source LLMs. Gives the community new research opportunities and ideas. Very excited to see how people take advantage of this!
I'm happy we were able to release a model with a slightly different architecture from all other open source LLMs. Gives the community new research opportunities and ideas. Very excited to see how people take advantage of this!
The best evidence that you had a good idea is when other people want to use it! Really cool (and fast!) follow up to @AdeptAILabs's Fuyu blog post with a fine-tuned model designed to take advantage of it's inherent multi-resolution capabilities.
The best evidence that you had a good idea is when other people want to use it! Really cool (and fast!) follow up to @AdeptAILabs's Fuyu blog post with a fine-tuned model designed to take advantage of it's inherent multi-resolution capabilities.
Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pLucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpressMiles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Tim Dettmers @Tim_Dettmers
29K Followers 821 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Jack Rae @drjwrae
9K Followers 354 Following Principal Scientist @ Google DeepMind Work on Gemini 💎♊ Compression is all you need LLMs (e.g. Gopher, Chinchilla, Gemini) 💼 Past: OpenAI, QuoraJonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIJeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleEthan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMindSam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.AI Pub @ai__pub
72K Followers 343 Following AI papers and AI research explained, for technical people. Get hired by the best AI companies: https://t.co/MySVjUGOQ3kipply @kipperrii
8K Followers 825 Following "drop the forest nymph act we know how much gdp you generate" - @mnovendstern | alt @kipperriiiiNaveen Rao @NaveenGRao
28K Followers 789 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.sridhar @RamaswmySridhar
26K Followers 618 Following CEO @snowflakedb; founder @neeva Ex-@GreylockVC Ex-@Google SVP of Ads Ex-@BellLabs.Srinivas Reddy (త�.. @Srini8085
126 Followers 3K Following తెలుగు, freelance full stack engineer, Python, Javascript, Typescript, Rust . freelancing since a decade when it was not in vogue . Open for freelancing , DMDanielle Perszyk @drperszyk
84 Followers 265 Following Artificial Intelligence. PhD in Cognitive Science.Alex Zhurkevich @Alex_Zhurkevich
67 Followers 348 FollowingArif Ahmad @arif_ahmad_py
275 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAIɢʀɛǟȶK̶i̶n̶g�.. @GreatKingCnut
468 Followers 2K Following But the sea came up as usual and disrespectfully drenched the king's feet and shins. I want the good ending pls, not the bad one. transhumanist, ML, RL, lmaojturow @jturow
1K Followers 3K Following Builder. Partner at Madrona Venture Group. Former Amazon AWS.Amanuel Gebregziabher @o_f_f_x_i_a_l
104 Followers 209 Following Ex-International Student, Presently Mastering the Art of Parking Lots,🤞future Material & Symbiosis engineer @TSLA.U have books u don’t need 🙏 do contact me.✌️Magzhan Nurmukhammed @nurmukhammed_m
26 Followers 58 FollowingNghia Hoang @fuwjjfn
0 Followers 724 FollowingVivek Raghunathan @vivek7ue
4K Followers 2K Following * AI + search at @snowflakedb. * Co-founder @Neeva (acquired by @snowflakedb). #NeevaAI = AI search engine with LLMs. * Ex-VP of Engineering @GoogleJeff Tatarchuk @jtatarchuk
1K Followers 2K Following Co-founder @tensorwavecloud - Pioneering the next wave of AI compute. Need GPUs? DM me.Seth Nabarro @sethnabarro
134 Followers 249 Following ML PhD student @imperialcollege. Prev. research engineer at @graphcoreaiJeremy Chen @jeremychenz
21 Followers 435 FollowingManoj R @r_manoj11
336 Followers 454 Following Founder https://t.co/Wyzls28s7O & https://t.co/Oadfe7W36S | Building AI Workforce | Ex-Zoho logging my journey here.Eva Louise Marie Gabr.. @e681554349
9 Followers 3K FollowingSeph Mard @SephMard
205 Followers 1K Following Product @weights_biases 👨🏻💻 Building developer tools for ML practitioners 🪄 Previously @DataRobot and @Ally 🤖 📈 Aspiring @DukeMBB fan 😈 and cyclist 🚴Adam Falls @AdamFalls172137
56 Followers 982 Followingyousra @aoudi21
269 Followers 3K Following Engineer, researcher, finance and founder of https://t.co/yHLNUHIWR9Shosleson @shosleson85405
138 Followers 4K Following I'm new to Twitter accounts so I tried the messaging feature and it's great to meet you.Chris Sperandio @sperand_io
4K Followers 5K Following 🔬🔭 e/lfg: ergophilia, lealty, futurity, grace. prev m&a and investing @stripe, product architecture @segmentChuanming @ChuanmingLiu
229 Followers 4K Following Ex-PhD student and alumni @sjtu1896 . Global citizen. Bootstrapping silicon-based life.Tom Runia @tomrunia
441 Followers 1K Following Senior Machine Learning Scientist at Apple in Zürich.Hadoop @Hadoop02277010
542 Followers 4K FollowingArman Suleimenov @suleimenov
3K Followers 3K Following Founder, nFactorial Group. Before: e-grocery in Colorado, consumer lending in India, apps & coders factory, @PrincetonCS, YC S12 team, ICPC World FinalsJ͓T͓ @jt_tv_xyz
459 Followers 1K Following 🤖 𝗔𝗜 𝗖𝗹𝗼𝘂𝗱 𝗖𝗼𝗺𝗽𝘂𝘁𝗲 🤖 💎 𝗦𝗲𝗿𝗶𝗮𝗹 𝗘𝗻𝘁𝗿𝗲𝗽𝗿𝗲𝗻𝗲𝘂𝗿 💎 🛠 𝗖𝗿𝗮𝗳𝘁𝗶𝗻𝗴 𝗖𝗼𝗺𝗽𝗮𝗻𝗶𝗲𝘀, 𝗕𝘆𝘁𝗲 𝗯𝘆 𝗕𝘆𝘁𝗲 🛠️Makya @Makya12345678
6 Followers 963 FollowingAaron White (Singular.. @aaronwhite
5K Followers 2K Following Techxecutive. Built and exited a few cos for 100s of millions. AI is the biggest thing I've ever seen. Now watch me wield it. CEO @ @AppyPeopleAIFatih Akkaya @Kuyudibi46
83 Followers 5K FollowingSanghyeong YU @SanghyeongY
11 Followers 97 FollowingJerry @DevJ3rry
194 Followers 861 Following Professional Nerd Made in Berlin. My opinions are my own. AI, Engineering & MusicAndersonFM @AndersonFM
2K Followers 3K Following Over 40 years of business experience financing both public and private companies with an emphasis on strategic planning, communications, and creative marketing.Block Chen @GPT327
378 Followers 3K Following @RUCerofChina. Founder&CEO of DeepWond AI. AI Research&Safety. AI game&Metaverse.Garett Gentry @garettgentry
127 Followers 273 Following Gentry Partners specializes in hiring scientists and engineers with expertise in Machine Learning, Computer Vision, Robotics, NLP/NLU and other AI domains.Catalin Tenita, MP RE.. @catalintenita
9K Followers 4K Following Romanian Member of Parliament, REPER (Renew Europe). Eisenhower Fellow. Human rights. Geek. IT Entrepreneur & civic activist. Loves 📚+🎵 . Parent. 🖖🌍 龍貓 /龙猫Jonathan Chuang @jon__chuang
167 Followers 942 FollowingSecrtAgntSquirl @SecrtAgntSquirl
585 Followers 3K Following I don’t really know what to put here. I mostly research AI/technology and spend time with my husband/pets. Pics are 7-8 yrs old, I don’t rly take selfies. Sry.Ibrahim Ahmad @Ibrahim63433664
86 Followers 3K FollowingAndrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Soumith Chintala @soumithchintala
186K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Jack Rae @drjwrae
9K Followers 354 Following Principal Scientist @ Google DeepMind Work on Gemini 💎♊ Compression is all you need LLMs (e.g. Gopher, Chinchilla, Gemini) 💼 Past: OpenAI, QuoraJeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)Oriol Vinyals @OriolVinyalsML
167K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Jack Clark @jackclarkSF
68K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkaTu Past: @openai, @business @theregister. Neural nets, distributed systems, weird futuresKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Ilya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openaiGoogle AI @GoogleAI
2.2M Followers 23 Following Google AI is focused on bringing the benefits of AI to everyone. In conducting and applying our research, we advance the state-of-the-art in many domains.Edward Grefenstette @egrefen
36K Followers 776 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.kipply @kipperrii
8K Followers 825 Following "drop the forest nymph act we know how much gdp you generate" - @mnovendstern | alt @kipperriiiiNaveen Rao @NaveenGRao
28K Followers 789 Following VP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.Richard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindDan Wuori @DanWuori
148K Followers 19K Following Dan Wuori, Ph.D. | Author, The Daycare Myth: What We Get Wrong About Early Care and Education (and What We Should Do About It) coming Sept. 2024 from @TCPressRohin Dhar @rohindhar
83K Followers 415 Following Vacation rental investor & proprietor of fine Airbnbs in Sonoma, Kauai, Taos, Mt Hood, Yosemite, Asheville. On the hunt for interesting real estate.Brad Gerstner @altcap
127K Followers 871 Following Founder - Altimeter Capital. Luck befalls the curious mind. Counting life in days and acts of kindness. Views here personal.Hao Liu @haoliuhl
4K Followers 155 Following phd student @berkeley_ai https://t.co/ZNJawlrerS machine learning, neural networks.Joseph Smarr @jsmarr
8K Followers 1K Following Chief Technology Officer at @Triller. Former Principal Engineer at @Google (NLP for Assistant, founding team for G+ and Photos). Former CTO of Plaxo.Aidan Clark @_aidan_clark_
4K Followers 211 Following Research @OpenAI. Ex: @DeepMind, @BerkeleyDAGRS Hae sententiae verbaque mihi soli suntSilent Movie GIFs @silentmoviegifs
174K Followers 673 Following I like to watch silent movies, and then make gifs from them. Created by @dmchoullKevin Kwok @kevinakwok
30K Followers 3K Followingptrblck @ptrblck_de
18K Followers 440 Following Deep learning and drums, @PyTorch engineer at @NVIDIANeel Nanda @NeelNanda5
13K Followers 89 Following Mechanistic Interpretability lead @DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!Ursula K. Le Guin bot @UrsulaBot
59K Followers 3 Following This is a bot that tweets a random quote by Ursula K. Le Guin every hour.cats being weird litt.. @weirdlilguys
2.1M Followers 25 Following wlg fan club 🐈 dm for submissions + credit! • IG: @ catsbeingweirdlittleguys • partnerships: [email protected] • MERCH 👇👇Samuel L Smith @SamuelMLSmith
2K Followers 361 Following Research Scientist at DeepMind. Optimization and Initialization. Formerly Google Brain. Ex-Physicist.augustus odena @gstsdn
10K Followers 1K Following cofounder at @AdeptAILabs. trying to do something at least twice as cool as the coolest thing I've already done.David Luan @jluan
9K Followers 1K Following led Google’s large models effort, director @googleai. former vp engineering @openai. interested in ML + society. all about type II fun.Jonathan Raiman @jonathanrraiman
1K Followers 818 Following ❤️ training deep nets :) AI research on large generative models, RL, OpenAI Five @openai and PrefixRL @Nvidia Hopper co-creatorIga Świątek @iga_swiatek
547K Followers 57 Following 🇵🇱 Professional Tennis Player | Trying to put this yellow fluffy thing between the lines. | #teamSwiatekF. Scott Fitzgerald Q.. @F_ScottFitz
64K Followers 7 Following Sharing and celebrating the works of American writer F. Scott Fitzgerald.Dr. Karen Ullrich @karen_ullrich
4K Followers 562 Following Research scientist at FAIR NY + collab w/ Vector Institute. ❤️ Machine Learning + Information Theory. Previously, PhD at UoAmsterdam, intern at DeepMind + MSRC.Amanda Askell @AmandaAskell
26K Followers 653 Following Philosopher & ethicist teaching models to be good @AnthropicAI. Personal account. All opinions come from my training data.Mike Chrzanowski @mikechrzano
347 Followers 519 FollowingLaura Graesser @lgraesser3
953 Followers 532 Following Learning about robots learning. Researcher, Robotics at Google DeepMind. Co-author of Foundations of Deep Reinforcement Learning. https://t.co/JgfxI9VJAhkeveman @keveman
723 Followers 182 Following Co-founder & CTO at Useful Sensors. Ex-Cerebras, Ex-Google Brain, Ex-NVIDIATim Green @tfgg2
2K Followers 2K Following Research Engineer @ DeepMind, working on AlphaFold. AI, physics and democracy.Pauline Luc @paulineluc_
465 Followers 501 Following Research Scientist @Deepmind - 🦩 | ex PHD at @MetaAI & @InriaAndrew Gibiansky @agibiansky
347 Followers 95 Following Working on neural speech synthesis at Facebook. Formerly founder @ Voicery, research scientist @ Baidu.Amy Unger @cdwort
1K Followers 171 Following Mistakes as a Service Provider | Compute Salesperson | @[email protected] | she/herAlexis Gay @yayalexisgay
134K Followers 995 Following Type A comedian 😎 | 🎟 Tix + email list at the link! ⬇️Andrew Trask @iamtrask
74K Followers 190 Following @openminedorg, @GoogleDeepMind ethics team, @OxfordUni phd candidate, @UN pet lab, @GovAI_, creator of #GrokkingDeepLearning, NALU, and sense2vecEva Garcia Martin @evitamonal
512 Followers 2K Following ML Engineer. Also into climbing 🧗♀️ (she/her) 🏳️🌈 @[email protected]Bert Chan @BertChakovsky
5K Followers 773 Following Artificial life researcher @GoogleDeepMind (formerly Brain). Hongkonger. Neurodiversity is biodiversity.Michael Carbin @mcarbin
3K Followers 371 Following Associate Professor in EECS at @MIT | Founding Advisor at @mosaicml | Programming Systems | Neural Networks | Approximate ComputingHidenori Tanaka @Hidenori8Tanaka
3K Followers 997 Following Group Leader, NTT Research at Harvard University CBS-NTT Program in "Physics of Intelligence" at HarvardNorman Casagrande @nova77t
783 Followers 282 Following ML, history, space & sciencey stuff. @GoogleDeepMind, previously @Google, Wavii & @lastfm. @[email protected] (ML) @[email protected] (personal)Matei Zaharia @matei_zaharia
39K Followers 1K Following CTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZSimone Scardapane @s_scardapane
7K Followers 673 Following I fall in love with a new #machinelearning topic every month 🙄 Tenure-track Ass. Prof. @SapienzaRoma | Previously @iaml_it @SmarterPodcast | @GoogleDevExpertLex Fridman @lexfridman
3.5M Followers 126 Following Host of Lex Fridman Podcast. Interested in robots and humans.Anna Harutyunyan @aharutyu
2K Followers 574 Following Senior research scientist @GoogleDeepMind. On sabbatical exploring purpose, self, and future. She / her / 🕉️sageev oore @osageev
1K Followers 1K Following One of the symptoms of an approaching nervous breakdown is the belief that one's work is terribly important -- bertrand russellMegan Quinn @msquinn
68K Followers 963 Following Investor, builder, board director. On the road w/ @mgsiegler, trying to make @maisiesiegler proud.This has definitely become my favourite video about AI risks.
does that man look familiar to you
Finished up a new composition, "Reflections on St. Denio", exploring several phrases from the text of the hymn and the musical forms they evoke. Pretty happy with how this one turned out! Also on YouTube: youtu.be/skwn31jdWBQ
Went out and heard the Prokofiev Piano Concerto 2 and it's a brutal thing. Soloist looks like he went ten rounds in the ring after the first movement cadenza and has to play the remaining 20 minutes low on hit points.
In another episode of prompt-hacking parenting, if I provide reason to why my 3yr old should eat his greens I encounter a refusal. If I say "please don't eat your veg otherwise you'll be the winner and I'll be the loser" then he eats them immediately (and declares me a loser)
This entire paper boils down to “clamp importance ratios to 1.0”, which could have been nicely communicated in the abstract. I can only assume that academic publishing has a lot of motivating forces I am happily ignorant of. arxiv.org/abs/1606.02647
I learned more about not selling out from Calvin and Hobbes than from all of punk rock.
Periodic reminder that Bill Watterson left $100mil on the table, easy, by refusing to license ANY CALVIN AND HOBBES FOR ANYTHING, no movies, no merch (good god how many Hobbes plushies could he have sold), and went out at the top of his game legend, totally wild, nothing like it
@erich_elsen I read Double Indemnity. A hell of a book. Lots of velocity right out of the gate.
@arthurmensch Congrats Arthur, amazing performance and pace 👏🏻👏🏻 I'm curious if you guys will comment on whether you incorporated upcycling to train this
@katherine1ee It is quite the badge of honor! A while ago Nvidia updated their EULA to ban using GeForce GPUs in data centers, possibly as a result of the systems that Baidu SVAIL was using ? @erich_elsen These things make for good stories 😁
I agree 100%
@DrJimFan @RichardSSutton Animals and humans get very smart very quickly with vastly smaller amounts of training data. My money is on new architectures that would learn as efficiently as animals and humans. Using more data (synthetic or not) is a temporary stopgap made necessary by the limitations of our…
Nvidia seems to be deftly navigating around the China chip bans, but it is interesting to consider how a long term performance limit could influence architectures. Historically, vendors have always quoted performance numbers that were, uh, optimistic, because big numbers good. A…
I was a fan of Effective Altruism (almost taught a course on it at Harvard) together w other rational efforts (evidence-based medicine, data-driven policing, randomista econ). But it became cultish. Happy to donate to save the most lives in Africa, but not to pay techies to fret…
How come I have 1K+ followers? I'm a simple AGI engineer, I don't have anything interesting to share!
Here's the test for @AdeptAILabs I just spent the last ~hour working on. Use case: copying figures from a PDF updated to the same link every week from a gov agency. It worked, but a bit of hacking to get it to navigate around a spreadsheet correctly.
Given the level of support shown for Altman at OpenAI over Sutskever and his coup, I’m thinking maybe most people care more about producing quality AI products that work well than trying to solve made up problems like superalignment for made up concepts like superintelligence.
All those ❤️ emojis OpenAI employees were posting last night? They were meant to signal who would leave and follow Altman and Brockman to a new company if the board coup succeeds. It’s most of OpenAI versus the board at this point, I’m told by sources. theverge.com/2023/11/18/239…
Good. Let’s be done with EA now. Nonsense philosophies just invite bad faith artists.
@DanBuk4 @sharongoldman @timnitGebru @alexhanna @emilymbender @xriskology @Kantrowitz @BigTechnology @DAIRInstitute @twimlai @karaswisher @PivotPod Effective Altruism Forum - is so funny right now 😃 "EA is not coming out well... EA might find itself in a hostile atmosphere in what used to be one of the most EA-friendly places in the world" forum.effectivealtruism.org/posts/HjgD3Q5u…
@erich_elsen Okay, this tweet (Xeet?) is the winner. 👑
No idea if the "doomer vs e/acc" framing will turn out to be what really happened, but if it is then I guess I'm on the side of... neither? I think the people rushing towards AGI are chasing a mirage, and the people trying to stop it are being frightened by shadows.
5-6 years ago I was working on music generation at DeepMind, but let me tell you, this is... something else. Incredibly excited to be able to finally share what our team has been working on!
Thrilled to share #Lyria, the world's most sophisticated AI music generation system. From just a text prompt Lyria produces compelling music & vocals. Also: building new Music AI tools for artists to amplify creativity in partnership w/YT & music industry deepmind.google/discover/blog/…
This joke gets made every 4 days but if youre in tech youre allowed like one of four hobbies (climbing, hikes, etc etc) I propose AI folks buck the trend by getting super into like, amateur dramatics. Just legions of AI researchers doing very bad improv and productions of Cats