Mike Smith @smith42mike
AI researcher who likes self-supervised, unsupervised and gen models. Was at @I_Hert_Space and @AspiaSpace, now at @astro_ai_cfa and @universe_tbd. mjjsmith.com Joined November 2021-
Tweets415
-
Followers137
-
Following388
-
Likes2K
1/ We compared 6 foundation model architectures across JWST, HSC, Legacy Survey, and DESI data. The key question: Do larger models converge toward similar representations even when seeing astronomical objects through completely different processes? Our results: YES! ✨ - Our…
🧵 We are very excited to announce our latest work, exploring the platonic representation hypothesis with astronomy! We tested if different AI models converge to the same understanding of galaxies - even when trained on completely different data types (optical imagery from…
seems likely the world of One Big Model will end in a year or two we’ll have families of peft-adapted experts continuously retrained, merged, and reapplied under varying degrees of staleness the Train/Test split of conventional machine learning held us back for far too long
when you give up on this nebulous idea and illusion of prestige, you will finally find peace and freedom. submit to TMLR and JMLR.
“Attention is not all you need”
“Attention is not all you need”
nearly everything in AI can be understood through the lens of compression - the architecture is just schema for when & how to compress - optimization is a compression *process*, with its own compression level and duration - (architecture + data + optimization) = model - in other…
Hugging Face is on a roll recently!
AGI confirmed
Wow @Yoshua_Bengio is now the #1 most-cited living scientist - across ALL fields
Wow @Yoshua_Bengio is now the #1 most-cited living scientist - across ALL fields https://t.co/2XOzFKTjeO
what your autoregressive model sees when you break causal masking
To the contrary, people don't forget GPT-2. People vividly remember that, quite unprecedented, OpenAI refused to share code or weights for GPT-2 and single handedly started an era of closed models and commercialism over science.
To the contrary, people don't forget GPT-2. People vividly remember that, quite unprecedented, OpenAI refused to share code or weights for GPT-2 and single handedly started an era of closed models and commercialism over science.
qk clipping changed my life. my skin is clear. my vision has been corrected. my experts have better load balance. i no longer hate the sun

Sandra @king37sandra
299 Followers 3K Following
Georgia Channing @cgeorgiaw
4K Followers 229 Following AI4Science @ 🤗, PhD @OxfordTVG — science is a candle in the dark
Kiera McCormick @kieraamccormick
7 Followers 43 Following Computer Science specializing in HLT @ Johns Hopkins University
Efren Von @VonEfren8177
36 Followers 3K Following
Cyprien Quéméneur @C_Quemeneur
173 Followers 755 Following AI Research Engineer & part-time Shoggoth whisperer. Techno-Optimist. Prev: federated learning + computer vision @polymtl. Views my own, priors included. 🇫🇷
Maciej Pióro @maciejpioro
202 Followers 439 Following ML PhD Student LLM Research Intern @ Qualcomm Researcher @ IDEAS NCBR Interested in LLMs --- pfp acknowledgment @maciejwolczyk
Megaloceros (Léo) @MEGALOCER0S
155 Followers 2K Following 24, Ele/Dele.Portador de TOC, Tourette e TDAH. Além disso, curto uns bixos antigos e umas pedra flutuante no espaço. Graduando em Física
Joseph Karpinski @jkarpin2
1K Followers 4K Following Interest in Astronomy, Quantum Mechanics, Particle Physics,
Christian Kragh Jespe... @AstroCKragh
181 Followers 560 Following Astrophysics Grad Student @Princeton, formerly @UCPH_Research/@DAWNCopenhagen. Machine Learning, galaxies and explosions in space
Tobias Buck @bucktobias6
340 Followers 398 Following Computational astrophysics and ML - mostly converting coffee into science - studying galaxy formation using big computers https://t.co/Y0Skzq3lZq
Aiswarya @curious_aish
30 Followers 3K Following
RockyParadox @RockyParadox44
130 Followers 7K Following
Martin Engelcke @martinengelcke
1K Followers 2K Following Senior Research Scientist @GoogleDeepMind. Agents, robots, representation learning, computer vision. Previously PhD & postdoc at @oxfordrobots. Views my own.
Alexia Jolicoeur-Mart... @jm_alexia
14K Followers 2K Following Senior AI Researcher at the Samsung SAIT AI Lab 🐱💻 I build generative AI for images, videos, text, tabular data, weights, molecules, and video games.
Atilla Kaan @atillakaan1911
10 Followers 54 Following PhD | Computer Scientist, NLP, Statistical Learning, Astrophysics
Smearl @SmearlV1gSH
38 Followers 864 Following
andmar74🇩🇰🔭�... @andmar74
146 Followers 429 Following Master degree astrophysics. Interested in AI and the consequences, AGI in 3..2..1. Fermi Paradox solution: Inner Space ( John Smart). Avi Loeb is onto something
Siddharth Chaini @sidchaini
263 Followers 635 Following AKA Sid Chaini | PhD student at the University of Delaware | Time-domain astronomy and data science | @sidchaini.bsky.app | BS-MS IISERB 2022
Diana @zavala_diana48
337 Followers 3K Following
T 🍃 @ai_tesseract
440 Followers 1K Following 🚀 Tesseract AI Labs | Meet T, your guide to the latest AI news, tools & breakthroughs 🤖 Simplifying the future, one byte at a time.
Teythez @TeythezCout_
96 Followers 3K Following
Oana Olteanu @oanaolt
4K Followers 954 Following I am building a new VC firm @motiveforcevc backing bold founders building beautiful software.
Climate Informatics @Climformatics
1K Followers 189 Following Climate Informatics: the intersection of climate science and data science. Research community and international conference (held annually since 2011).
behave @Mstarsol
799 Followers 2K Following
Alessandro Dr.Ed @aederocl
589 Followers 651 Following Born in #Rome , #Italy . Live in #Teruel , #Spain . Astronomer. Variable stars, wide-field surveys and fun. He/him/his.
Fight!!! @togetmorefree
240 Followers 814 Following #Shoggoth H2c31USxu35MDkBrGph8pUDUnmzo2e4Rf4hnvL2Upump tg: https://t.co/NKRmDW64an
Ulises Moya @UlisesMoya12
512 Followers 2K Following AI Director of Jalisco Gov(2019-2024). #Fulbrighter #UTDallas , UPC-BSC, CINVESTAV, IFUNAM, Universidad de Guadalajara
Samuel Bancroft @Spiruel
432 Followers 1K Following @EoCdt PhD student at @SEELeeds, using Earth Observation data and machine learning to assess future food production. he/him
Anthony @Disaitek
34 Followers 86 Following Tackling illegal waste with high resolution optical data and SAR. Leveraging deep learning for change detection
Miles Cranmer @MilesCranmer
13K Followers 983 Following Assistant Prof @Cambridge_Uni, works on AI for the physical sciences.
B @B32933796
4 Followers 403 Following
Balu Sreedhar @balusrdhr
579 Followers 2K Following 🌌 Computational Astrophysicist fascinated with baby Universes | Making the stars align with code 🌠💻 | Debugging one galaxy at a time ✨
Steven Dillmann @DillmannSteven
138 Followers 941 Following Stanford PhD working on AI-for-Science 🌲☀️ @stanford @StanfordAILab
Dr. Dimitrios Tanogli... @TanoglidisDim
229 Followers 997 Following Machine Learning Scientist PhD from @UChicagoAstro Research in Astrophysics + ML Techno-optimist Passionate about #AI, #data, #tech, and #art 🇬🇷 🇺🇸
Siddharth Mishra-Shar... @kdqg1
2K Followers 3K Following RL/science/computers at @AnthropicAI; erstwhile @MIT @iaifi_news; AI + physics/science/simulations. Personal account.
Mikolaj Czerkawski @mikonvergence
543 Followers 664 Following co-founder scientist of @asterisk_labs | ex @ESA Φ-lab | computer vision, earth observation, signal processing
teddycoding @teddycodin31661
0 Followers 21 Following 🚀 Tech Innovator | AI Enthusiast 👨🏻💻 Passionate about AI, Coding & Startups 📈 Building ideas innovating 👇 Follow for the latest in AI & tech trends!
Ashod Khederlarian @Ashod_kh
16 Followers 181 Following
Francesco Immorlano @f_immorlano
264 Followers 804 Following Postdoc @ucirvine, LEAP NSF-STC - Columbia University | Generative modeling for Climate Science
Georgia Channing @cgeorgiaw
4K Followers 229 Following AI4Science @ 🤗, PhD @OxfordTVG — science is a candle in the dark
The Green Party @TheGreenParty
333K Followers 12K Following 💚 Real hope. Real change. Promoted by Chris Williams on behalf of the Green Party, both at PO Box 78066, London SE16 9GQ.
Julia Linhart @jujulinhart
99 Followers 66 Following Postdoctoral Researcher @NYUDataScience. AI4Science | Machine Learning | Deep Generative Models | Simulation-Based Inference | Validation & Diagnostics
Zarah Sultana MP @zarahsultana
407K Followers 950 Following MP for Coventry South | [email protected] | she/her
Zack Polanski @ZackPolanski
83K Followers 11K Following Green Party Leader. London Assembly Member. 🏳️🌈
Susan Zhang @suchenzang
34K Followers 680 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.
kalomaze @kalomaze
19K Followers 2K Following ML researcher (@primeintellect), speculator • extremely silly jester
AI Helpsafetyism Meme... @AISafetyIntern
466 Followers 77 Following $AISM Inspired by @AISafetyMemes 4NQMj4MydysRimFS8ho2KR5dSZa6bTAV7NX5Cj8zpump Step 1: make memes Step 2: create a movement Step3: lower p(doom).
Z.ai @Zai_org
17K Followers 154 Following The AI lab behind GLM models, dedicated to inspiring the development of AGI to benefit humanity. https://t.co/b6zGxJvzzS
Yiping Lu @2prime_PKU
5K Followers 2K Following Kernel, ML for PDE, Robust learning,non-parametric stats/🌈/PKU👉Stanford👉NYU Courant👉Prof.@Northwestern IEMS/ Previous Intern @RIKEN_AIP
emozilla @theemozilla
7K Followers 1K Following catholic, ai researcher, co-founder/ceo of @NousResearch alignment: whatever the opposite of yudkowsky + bryan johnson is. blessed be God in all his designs.
Featherless AI @FeatherlessAI
697 Followers 120 Following Instant access to the world’s AI. Unlimited tokens for 10K+ models.
dax @thdxr
63K Followers 248 Following building https://t.co/eVz8bbXqxp https://t.co/A7BKeXDXKQ https://t.co/KFQgBnHJQy https://t.co/ZjFDwZeABC
Crystal @crystalsssup
13K Followers 664 Following Staff @Kimi_Moonshot prev. co-maker of ModelizeAI & gemsouls "Personality goes a long way" @UCSanDiego
Kimi.ai @Kimi_Moonshot
53K Followers 100 Following Built by Moonshot AI to empower everyone to be superhuman.
Catherine Arnett @linguist_cat
1K Followers 582 Following NLP Researcher @AiEleuther. PhD @UCSanDiego Linguistics. Previously @pleiasfr @EdinburghUni. Interested in multilingual NLP, tokenizers, open science. She/her.
asterisk labs @asterisk_labs
120 Followers 13 Following Interdisciplinary research lab making the most of open data. The UK’s first worker-owned co-operative research laboratory.
Ernest Perkowski @ernestperkowski
45 Followers 70 Following
Ilya Sutskever's hair... @IlyasHairline
3K Followers 848 Following Follically challenged, but emotionally enriched. On my journey from forehead to backhead. #OnTheMove
Roberta Raileanu @robertarail
9K Followers 2K Following Senior Staff Research Scientist @GoogleDeepMind & Honorary Lecturer @UCL. ex @Meta|@MSFTResearch|@NYU|@Princeton. Llama-3, Toolformer, Rainbow Teaming, MLGym.
Jack Morris @jxmnop
46K Followers 994 Following research @cornell // language models, information theory, science of AI
Maciej Pióro @maciejpioro
202 Followers 439 Following ML PhD Student LLM Research Intern @ Qualcomm Researcher @ IDEAS NCBR Interested in LLMs --- pfp acknowledgment @maciejwolczyk
Christian Kragh Jespe... @AstroCKragh
181 Followers 560 Following Astrophysics Grad Student @Princeton, formerly @UCPH_Research/@DAWNCopenhagen. Machine Learning, galaxies and explosions in space
zed @zmkzmkz
4K Followers 1K Following #1 paperclip maximizer fan, occasionally on x-games mode. I really, really like watching loss graphs go down
am @attentionmech
13K Followers 1K Following
Tobias Buck @bucktobias6
340 Followers 398 Following Computational astrophysics and ML - mostly converting coffee into science - studying galaxy formation using big computers https://t.co/Y0Skzq3lZq
Brendan O'Donoghue @bodonoghue85
6K Followers 1K Following Research scientist at @GoogleDeepMind, working on generative models, deep learning, RL. PhD from @stanford. Gemini Diffusion lead.
macy @macyagilliam
32K Followers 1K Following Out There for @morningbrew [email protected] for partnerships
Michael Tschannen @mtschannen
3K Followers 676 Following Research Scientist @GoogleDeepMind. Representation learning for multimodal understanding and generation. Personal account.
Lilian Weng @lilianweng
166K Followers 166 Following Co-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
Alexey Guzey @alexeyguzey
32K Followers 1K Following special projects @openai, building new institutions of science https://t.co/8HIEyR2vl7, writing https://t.co/YTeUJ2NSye
Scott Alexander @slatestarcodex
156K Followers 36 Following I have a place where I say complicated things about philosophy and science. That place is my blog. This is where I make terrible puns.
Broken Roads @BrokenRoadsGame
4K Followers 100 Following Narrative-driven, isometric post-apocalyptic RPG. Dev: @dropbearbytes 🎮 Play Now: https://t.co/edmGp5gAic 🦘 Discord: https://t.co/BeJrUYsyWT
ATOM RPG - DEV BLOG @atomrpg
2K Followers 256 Following A classic post-apocalyptic crpg set in post-Soviet Wastelands... #indiedev #gamedev #indiegame #android #ios #xbox #xsx #ps4 #ps5 #NintendoSwitch
Tirthankar Ghosal @TirthankarSlg
571 Followers 1K Following Scientist @ORNL #NLProc #LLMs #peerreview #SDProc Editor @SIGIRForum Org. #AutoMin2023 @SDProc @wiesp_nlp AC @IJCAIconf @emnlpmeeting Prevly @ufal_cuni @IITPAT
Dr. Dimitrios Tanogli... @TanoglidisDim
229 Followers 997 Following Machine Learning Scientist PhD from @UChicagoAstro Research in Astrophysics + ML Techno-optimist Passionate about #AI, #data, #tech, and #art 🇬🇷 🇺🇸
Atilla Kaan @atillakaan1911
10 Followers 54 Following PhD | Computer Scientist, NLP, Statistical Learning, Astrophysics
ATOM TEAM @the_atomgame
9K Followers 234 Following https://t.co/0IMKxg845E Currently developing: #swordhaven Released games: ⚛️@atomrpg #Trudograd 🇺🇦 🇱🇻 🇨🇾 🇵🇱 🇯🇵 @atomteam_jp
Welwyn Hatfield @WelHatCouncil
10K Followers 766 Following News and updates from Welwyn Hatfield Borough Council. Monitored 9am - 5pm, Mon - Fri. Contact customer services: 01707 357000 or [email protected].
Kaden Bilyeu @bikatr7
2K Followers 165 Following CS/日本語 Senior @UCCS | Full-Stack Eng @ NGi | Working on @NegationGame | opinions are my own
SSI Inc. @ssi
102K Followers 0 Following A straight shot to safe superintelligence. Join us https://t.co/hHla3vusDE.
Tetraspace 💎 @TetraspaceWest
8K Followers 2K Following 🌈 you'll miss the rainbow if you run now 💎 from another world ☀️ sarenite and arodenite
Philippe Lemoine @phl43
62K Followers 2K Following Technically a philosopher, still has a PhD to finish. I write about stuff. Directeur de la recherche à @Hexagone_org. "At least he's pretty smart." (@bechhof)