Jürgen Schmidhuber @SchmidhuberAI
Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day. people.idsia.ch/~juergen/most-… Switzerland, KSA Joined August 2019-
Tweets64
-
Followers106K
-
Following0
-
Likes714
At ICANN 1993, I extended my 1991 unnormalised linear Transformer, introduced attention terminology for it, & published the "self-referential weight matrix." 3 decades later, they made me Chair of ICANN 2024 in Lugano. Call for papers (deadline March 25): e-nns.org/icann2024/call…
Our #GPTSwarm models Large Language Model Agents and swarms thereof as computational graphs reflecting the hierarchical nature of intelligence. Graph optimization automatically improves nodes and edges. arxiv.org/abs/2402.16823 github.com/metauto-ai/GPT… gptswarm.org
In 2016, at an AI conference in NYC, I explained artificial consciousness, world models, predictive coding, and science as data compression in less than 10 minutes. I happened to be in town, walked in without being announced, and ended up on their panel. It was great fun.…
Numbers are lining up: one tweet per year of my life; one follower per LSTM citation 👍🙂
2010 foundations of recent $NVDA stock market frenzy: our simple but deep neural net on @nvidia GPUs broke MNIST arxiv.org/abs/1003.0358. Things are changing fast. Just 7 months ago, I tweeted: compute is 100x cheaper, $NVDA 100x more valuable. Today, replace "100" by "250."…
The GOAT of tennis @DjokerNole said: "35 is the new 25.” I say: “60 is the new 35.” AI research has kept me strong and healthy. AI could work wonders for you, too!
Best paper award for "Mindstorms in Natural Language-Based Societies of Mind" at #NeurIPS2023 WS Ro-FoMo. Up to 129 foundation models collectively solve practical problems by interviewing each other in monarchical or democratic societies arxiv.org/abs/2305.17066
How 3 Turing awardees republished key methods and ideas whose creators they failed to credit. More than a dozen concrete AI priority disputes under people.idsia.ch/~juergen/ai-pr…
Q*? 2015: reinforcement learning prompt engineer in Sec. 5.3 of “Learning to Think...” arxiv.org/abs/1511.09249. A controller neural network C learns to send prompt sequences into a world model M (e.g., a foundation model) trained on, say, videos of actors. C also learns to…
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
AI boom v AI doom: since the 1970s, I have told AI doomers that in the end all will be good. E.g., 2012 TEDx talk: youtu.be/KQ35zNlyG-o: “Don’t think of us versus them: us, the humans, v these future super robots. Think of yourself, and humanity in general, as a small stepping…
Thanks @elonmusk for your generous hyperbole! Admittedly, however, I didn’t invent sliced bread, just #GenerativeAI and things like that: people.idsia.ch/~juergen/most-… And of course my team is standing on the shoulders of giants: people.idsia.ch/~juergen/deep-… Original tweet by @elonmusk:…
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
2023: 20th anniversary of the Gödel Machine, a mathematically optimal, self-referential, meta-learning, universal problem solver making provably optimal self-improvements by rewriting its own computer code people.idsia.ch/~juergen/goede…
Unlike diffusion models, Bayesian Flow Networks operate on the parameters of data distributions, rather than on noisy versions of the data itself. I think this paper by Alex Graves et al. will be influential.
Unlike diffusion models, Bayesian Flow Networks operate on the parameters of data distributions, rather than on noisy versions of the data itself. I think this paper by Alex Graves et al. will be influential.
In 2010, we used Jensen Huang's @nvidia GPUs to show that deep feedforward nets can be trained by plain backprop without any unsupervised pretraining. In 2011, our DanNet was the first superhuman CNN. Today, compute is 100+ times cheaper, and NVIDIA 100+ times more valuable.…
Interview with Jürgen Schmidhuber, ‘Father Of Modern AI’, who says his life’s work won’t lead to dystopia. He goes quite in depth into his views about the future of AI and AGI. A refreshing view of things, compared to other ‘influential leaders’ in AI. reddit.com/r/MachineLearn…
Instead of trying to defend his paper on OpenReview (where he posted it), @ylecun made misleading statements about me in popular science venues. I am debunking his recent allegations in the new Addendum III of my critique people.idsia.ch/~juergen/lecun…
Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversitySoumith Chintala @soumithchintala
186K Followers 876 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Lucas Beyer (bl16) @giffmana
56K Followers 442 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected](((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingKosta Derpanis @CSProfKGD
48K Followers 198 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairKevin Patrick Murphy @sirbayes
42K Followers 333 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVDavid Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Dmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 591 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Horace He @cHHillee
23K Followers 448 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Rosanne Liu @savvyRL
33K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRFerenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Petar Veličković @PetarV_93
30K Followers 555 Following Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Associate @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Ethan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMindZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Mehwish pathani 🌺�.. @mehwish_Pathani
6 Followers 0 Following follow me and get follow back in same timeFuture @Future90232925
42 Followers 121 Following Passionate believer in the power of technology to empower and enrich livesTrunkboy PeeZ @P10895Peez
0 Followers 204 FollowingRahul @rahulgupta765
35 Followers 2K Followingwayjayblue @gemeng
158 Followers 3K Following Soon will be the break of day. Sitting here in Blue Jay Way.Jaba @Jaba96438469
240 Followers 2K Following AI, LLMs, FMs. Ex-mature student of Biophysics @YorkUPhysics. Sometimes I build stuff: https://t.co/XdFZRIu9lS…tejas nagendra @tejasnagendra
4 Followers 148 FollowingFer @otferdam
4 Followers 421 Following 29 | Lingüista computacional | UBA-Puán💚 | Fantasía épica+weird fiction 📚🎮🎭🏳️🌈EthanJo @EthanJo20
0 Followers 7 FollowingAndCri @andcristea
941 Followers 4K FollowingJean Blin @BlinDesdoitsJ
2 Followers 30 FollowingMithilesh Thakkar @Mithilesh_1609
139 Followers 988 Following AI | Psychology | Finance | Start-Up | Creating next-gen paper learning at https://t.co/GfK8c0Mkja匿名 @tulsida75140181
132 Followers 3K FollowingAnarki @BasedAnarki
446 Followers 419 Following multigoatal agi ceo yolo artist. Kardashev spectrum scaler of e/acc shenanigans, rank #1 world MTG, founder follow to watch me yeet cracked AI devs way up🪄⏩Raj Contractor @RajContrac26606
0 Followers 33 FollowingShane Brooks @TAO_Joe_Wanders
127 Followers 242 Following Former owner of Clandestine Vapes in Pullman Washington. Born & Raised Texan. I don't know when or where I am. I don't know where home is anymore. Life's crazy.Kundan @kumarkundan
25 Followers 153 FollowingChristian Harder @ChristianHcol
0 Followers 3 FollowingRu7 |JDI Group @Ru7Longcrypto
6K Followers 2K Following HOLDer|DYOR |ex-Intern @ACCapital1|VP of Partnerships @Global_JDI|All in DePINZHUO YANG @ZHUOYANG419612
10 Followers 55 FollowingAlexander Fröhlich @AlexanderFr0e
51 Followers 53 Followingselman maltaş @selmanmaltas
2K Followers 261 FollowingJasonZz266 @JasonZz26
1 Followers 65 FollowingDanil Zvyagintsev @danzvyagintsev
121 Followers 943 Following 💻 Top Rated Power BI Developer @Upwork | I write about Data, Design and Analytics | 19K+ on LinkedIn, follow me (link in bio)Kevin Groot Lipman @LipmanKevin
27 Followers 80 FollowingFrederik Bull-Larsen @SirFrederik88
8 Followers 86 FollowingMarioGpt @Mario_Gpt
2K Followers 2K Followingjatlantic @jatlantic1004
1 Followers 40 FollowingJ @nYrtVbfT2qcklCH
0 Followers 55 FollowingDavid Mckay @DavidMckay68995
7 Followers 656 Following I am a member and board member of the Business Council of Canada, and serve on the advisory board of Catalyst Canada. I am a Canadian bank executive.Jason @nth_tad
16 Followers 27 FollowingRon Rocket @RonnyRumble
50 Followers 528 Following 🌍 Energy innovator |🌱Renewable energies | 🤖 AI & blockchain visionary | Shaper of the future #Sustainability #TechTrendsXeniaIvan @eiS96Bg96TctS1
24 Followers 821 FollowingMarkovianProcess.eth .. @apsinthion__
75 Followers 564 Following Physicist/Mathematician 🌌 Tinkering and Learning ⌨Phillip Lanos @philliplanos
465 Followers 516 Following Podcast host of Grit Daily's Startup Show. Always reading a book 📚 in between on emerging tech.Michael Zolotov @mzolotov_alt
5 Followers 83 Following@ylecun My understanding is Schmidhuber already solved that 10 years ago. Just no-one knows it yet
@SchmidhuberAI The 90s was the best time 😉
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
Schmidhuber was already an e/acc back in the 1990s 😏
AI boom v AI doom: since the 1970s, I have told AI doomers that in the end all will be good. E.g., 2012 TEDx talk: youtu.be/KQ35zNlyG-o: “Don’t think of us versus them: us, the humans, v these future super robots. Think of yourself, and humanity in general, as a small stepping…
This is funniest 😂 talk I have ever heard a scientist give. 10/10 @SchmidhuberAI . Impeccable comedic timing.
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
@McaleerStephen Schmidhuber invented everything
Generative AI startups have become mainstream when their boardroom drama becomes national news.
It might be interesting to revisit these ideas with pre-trained LLMs.
@SchmidhuberAI Who said that 'AI' should follow the method of learning derived from human behavior and psychology?
“I’ve no doubt that there’ll be all kinds of AI arms races, but AI doesn’t introduce a new quality of existential threat. The threat from AI weapons pale in comparison to much older threats. We should be much more afraid of H-bomb rockets.” @SchmidhuberAI redd.it/13q6k4a
Ask 10 people, and you’ll hear 10 opinions about what is ‘good’. The problem is that governments ALSO have different opinions about what’s good for them and for others. Great Power A will say, if we don’t do it, Great Power B will, perhaps secretly, and gain an advantage over us.
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
@pretendsmarts @SchmidhuberAI Humans have different visions of the future - and you can't please all the people - so issues arise regarding whether you please the luddites or the technophiles, the capitalists or the communists, and so on - i.e. whose views do you give weight to? - 2008.
@SchmidhuberAI Thankfully, another voice of reason!
Correct. Infeasible
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Another based founding Father of AI joins the fight on the side of e/acc
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Agree 👍
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Worth take on AI
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
@SchmidhuberAI a story about regulations is mostly a story how to keep dominance :(