Jaisidh Singh @jaisidhsingh
machine teacher • i like to learn things. jaisidhsingh.bearblog.dev Joined August 2020-
Tweets543
-
Followers163
-
Following632
-
Likes5K
Thinky: we developed theory NVIDIA and everyone else: we just did it
"A problem just means something needs your attention. That's a good thing. All we have is time and attention. Give your attention, you'll be fine." ~ Jimmy Carr
DeepSpeed ZeRO - crisp and clear. jaisidhsingh.bearblog.dev/the-ultra-scal…
[paper release!] Did you know that you can - speed up any LLM by 4x - and reduce its memory footprint by 2x - and improve its results - without modifying the model at all How??? Here is how we do it 🧵
[paper release!] Did you know that you can - speed up any LLM by 4x - and reduce its memory footprint by 2x - and improve its results - without modifying the model at all How??? Here is how we do it 🧵 https://t.co/wFppbRcoe2
It’s hard to find conviction, but you deserve nothing less.
A very insightful paper, made me see attention differently. If you pre-mix tokens and treat (V·Wo) as an FFN expert, attention-MoE and FFN-MoE collapse into one design with shared experts. Sparse where it counts, lower PPL, similar compute. Elegant unification.
We beat Nvidia’s cuBLAS kernels on B200s in 170 LOC. Using zero CUDA. Just pure Mojo. Here’s exactly how we went from 1% to 106% of Nvidia benchmark perf from scratch (with code) 👇🧵
Took me 4 days to read this blog, but totally worth it. A great detailed guide to post training. Why aren't many people talking about it. Kudos to @Han_Fang_ @karthikabinav for sharing their thoughts. tokens-for-thoughts.notion.site/post-training-…
Procrastination is SO dangerous: one basically trades alpha in the future for comfort in the present. This is worse if you desire to be high output. Procrastinated once today and the coming 2 days will now have significantly more todos. Ugh.
1/ Introducing Isaac 0.1 — our first perceptive-language model. 2B params, open weights. Matches or beats models significantly larger on core perception. We are pushing the efficient frontier for physical AI. perceptron.inc/blog/introduci…
Just got the greenlight to share some work we did at Google DeepMind from over a year ago: We fine-tuned Gemini on thousands of the most toxic discussions on 4chan...and it just talked to us like a completely normal and nice language model. How? Our method, Generative Data…
Wild to see, I derived it on paper from scratch, and later realized it’s exactly Theorem 3.3 (p.5) in @elon_lit’s paper (arxiv.org/abs/2508.08369). Always amazing when independent thoughts converge :)
Wild to see, I derived it on paper from scratch, and later realized it’s exactly Theorem 3.3 (p.5) in @elon_lit’s paper (arxiv.org/abs/2508.08369). Always amazing when independent thoughts converge :) https://t.co/P3vgvbgbdZ
One of my most exciting results lately! We identify experts in MoE models for properties like safety and faithfulness, and steer them to improve/hurt model faithfulness and safety. Most shockingly, with stearMoE, we can jailbreak 100% safety guardrails for open models. Details 👇
One of my most exciting results lately! We identify experts in MoE models for properties like safety and faithfulness, and steer them to improve/hurt model faithfulness and safety. Most shockingly, with stearMoE, we can jailbreak 100% safety guardrails for open models. Details 👇
Repetitive negative thinking is associated with cognitive decline. Stay positive.
Best extension ever lmao
Sovereign model update 1: PT work [███████░░░] SFT work [█████░░░░░░] RL work [█░░░░░░░░░░░░] Ablations [███████░░░] Infra/code [█████████░]
conor brennan-burke @conor_ai
4K Followers 3K Following founder @hyperspell (YC F25) | context + memory for AI agents | living @mission__ctrl | @JoinODF | creator tizz/rizz matrix | investing @weekendfund @aforevc
GenevieveMary @w04PBx4DK5a8LJ
23 Followers 574 Following
RoxanneGeordie @LK4D4HE2h3JC403
23 Followers 577 Following
Philippa @Cwo7k21dRynQAQn
0 Followers 372 Following
CathyMarcus @J313G62B7r56f1
16 Followers 472 Following
Susanne @n9cT02TJ0exZO2s
15 Followers 650 Following
Mayank Bhaskar @cataluna84
3K Followers 4K Following Machine Learning Consultant 🧑🏽💻 | @twimlai & @Cohere_Labs Community Lead 👥 | @AILucknow ⌨ | #engineer 🛠 🧮 | #datavisualization 📊 | #sports ⚽ 🏓 🏋🏽 🎮
Mukesh @0xMukesh
464 Followers 289 Following 18 // loves tinkering around with computers and math // building: @cleopetrafun // built: @candypayfun, @havendotfan
Robert Scoble @Scobleizer
543K Followers 23K Following The best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
PremSai @Frog_ninja14
30 Followers 307 Following 18 | walking through the shadow to see where the light must be built...
Jan Hendrik Metzen @jan_metzen
186 Followers 609 Following Senior AI Researcher at IPAI Aleph Alpha Research @Aleph__Alpha.
Siddhant Gupta @SidYaeger
124 Followers 444 Following ML Intern https://t.co/XY8rSwE5L5 | NLP Lead @cohere_labs | Intern @mit_csail | Final Year @ IIT Roorkee |
Praneeth @PraRa2005
61 Followers 355 Following building in web3 & ai | not a good student @iitjodhpur
Octavia @LynnChampl80782
91 Followers 3K Following
Boris Knyazev @BorisAKnyazev
1K Followers 340 Following Research Scientist at Samsung - SAIT AI Lab (SAIL). PhD @uoguelph_mlrg.
Lea @Israwibeaj678
36 Followers 2K Following The question isn’t who’s going to let me; it’s who’s going to stop me.
DigitalEvaluation @OnScreenMarking
1 Followers 3 Following
Mark Pettyjohn @m_pettyjohn
209 Followers 603 Following
Khoa Tuan Nguyen @Khoa_NguyenTuan
782 Followers 7K Following Enjoy learning new things. PhD student at Ghent University Global Campus in Korea.
Delilah @ElissaTown95576
58 Followers 3K Following
Ojufid @Ojufid9354980
104 Followers 3K Following
Clara Smith @Nurulemylia8
118 Followers 5K Following Guiding @Elonmusk’s vision for a better future through SpaceX, Tesla, Neuralink and more 🚀 I teach enthusiasts, dream chaser and innovation advocate 🌟
Anne @Piogi7540
30 Followers 2K Following If you’re going to be two-faced, at least make one of them pretty.
Nehdiii @TNehdi
3 Followers 216 Following MSc student @ETS Montréal and researcher at LIVIA Lab. working in Computer Vision, Efficient Deep Learning.
Suyash @suyashthegreat
103 Followers 594 Following Coding , Cricket , F1 aur masti .. IIIT Hyderabad 2026
Adriana @YNTvN26SrbVon
17 Followers 1K Following Not a morning person 💤 | Afternoon tea enthusiast 🍵
RD🪩 @rohitdashora
881 Followers 766 Following Twitter basic | tweets are personal | sometimes posts a picture or two | full stack desi | May help you with GenAI
kanishk @kanishk9Ai
10 Followers 65 Following 20| Mumbai | Data Science Student| Data engineering, ML and Deep learning | {Cooking Hard}
Benita @sW072511VRRL2
16 Followers 855 Following
Aritro Shome @thearitroshome
9 Followers 46 Following programmer & developer building AI/ML models and server-side applications. Loves math. Information technology major, B. Tech from 2024-2028
Saide Hossain @nemocyberworld
103 Followers 1K Following Offensive Security | Exploit Dev | Malware Dev
maya @mayyayayaa
9K Followers 354 Following 19• cs student• learning ai ml• crochet • artstudio💗🧚♀️
Rakshith Sajjan @RakshithSajjan
197 Followers 290 Following purist. bits and atoms arc. god's chosen generalist
Adhit @5_4dh1t
42 Followers 658 Following I spend half of my time in reading buggy research code, while the other half in contemplating my life decisions.
AJ @ClearwaterCoder
1K Followers 998 Following 25 | SWE | Technical Writer | Math Wizard | Building Medtech B2B SaaS Startup | Exploring AI & ML | Rust Community Discord: https://t.co/LUBbclBTHz
Manas @Menace_thakur
461 Followers 369 Following 19 | AI Engineer | Building @paradize_space | Trying to understand myself before attempting to understand intelligence beyond me.
Yuvraj Singh @YuvrajS9886
2K Followers 578 Following Ex - @turboml, @puch_ai | @iitmadras (left), @iiserkol, @UofMaryland, AIISC | YESIST '24 Finalist | LLM x RL | Building SmolHub, NeatRL |
anandmaj @Almondgodd
2K Followers 386 Following path of childhood's end | gap @penn | prev ai @tesla_optimus @dynarobotics
Yuchen Jin @Yuchenj_UW
57K Followers 565 Following Co-founder & CTO @hyperbolic_labs cooking fun AI systems. Prev: OctoAI (acquired by @nvidia) building Apache TVM, PhD @ University of Washington.
אגי-e/acc @murage_kibicho
3K Followers 5K Following Statistics @Yale | @LeetArxiv - Leetcode for implementing Arxiv papers
Pramod Goyal @goyal__pramod
10K Followers 331 Following Trying to change the world one line at a time
Emil Ryd @emilaryd
148 Followers 212 Following physics @ oxford mostly doing ml/ai research currently have an unclear fusion of interests in ai & global development
mem0 @mem0ai
12K Followers 13 Following The Memory Layer for your AI apps. Backed by @ycombinator. Open source: https://t.co/HqLHhUMmAf
Songlin Yang @SonglinYang4
14K Followers 3K Following research @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
anshuman @athleticKoder
14K Followers 823 Following machine learning engineer; prev: ai consultant @google, mle @ https://t.co/7tFP7MHyLH, gsoc @tensorflow
shyamal @shyamalanadkat
19K Followers 1K Following applied AI @openai. I work with the world's leading startups and developers to bring the benefits of safe AI to every human. views my own 🇮🇳 @dukeu
Shivalika Singh @singhshiviii
2K Followers 773 Following Research Engineer @Cohere_Labs @cohere | @huggingface fellow 🤗 | “Research means that you don't know, but are willing to find out” ✨
Eric Zhang @ekzhang1
16K Followers 503 Following Computer systems person, interaction designer. founding eng @modal → dreams of: a simpler, more honest, more human sort of software (people are good, be kind!)
Shiwei Liu @Shiwei_Liu66
1K Followers 523 Following Hi, I am a PI at ELLIS Institute Tübingen and MPI-IS. Was RS NIF @UniofOxford, JRF @SomervilleOx, postdoc @UTAustin, and PhD @Data_AI_TUe.
Arjun Khemani @arjunkhemani
30K Followers 69 Following memetic warlord at @zcash | prev @getairchat with @naval | podcast: https://t.co/Ti3neVEQ4V
Alessio Devoto @devoto_alessio
968 Followers 603 Following Researching Efficient AI ☘️ | Applied Agent Research intern @NVIDIA | PhD Data Science w/ @s_scardapane | visit @EdinburghNLP | https://t.co/wcDDNFdyW9 |
Oğuzhan Fatih Kar @oguzhanthefatih
939 Followers 544 Following Machine Learning Researcher at @Apple. CS PhD @EPFL_en on multimodal foundation models. Previously @Google, @METU_ODTU, @aselsan.
Modal @modal
19K Followers 125 Following AI infrastructure that developers love 💚 Bring your own code and run CPU, GPU, and data intensive compute at scale.
Siddhant Gupta @SidYaeger
124 Followers 444 Following ML Intern https://t.co/XY8rSwE5L5 | NLP Lead @cohere_labs | Intern @mit_csail | Final Year @ IIT Roorkee |
Shawn Lewis @shawnup
3K Followers 771 Following Founder & CTO @weights_biases. Building tools for AI. Building even more @CoreWeave.
Dividend Hero @HeroDividend
213K Followers 849 Following Dividend growth investor | Tweet about dividends + getting off the grid
Aleph Alpha @Aleph__Alpha
9K Followers 1 Following Our mission is a European generalizable AI. We're hiring: https://t.co/k7MxJK1XU1 #AGI, #artificialintelligence, #writtenbyahuman,#writtenbyanAI
Jan Hendrik Metzen @jan_metzen
186 Followers 609 Following Senior AI Researcher at IPAI Aleph Alpha Research @Aleph__Alpha.
Essential AI @essential_ai
4K Followers 20 Following At Essential AI, we're building an open platform to democratize frontier AI capabilities and accelerate breakthroughs globally through collaborative science.
yuwen lu @yuwen_lu_
3K Followers 3K Following phd candidate @nd_cse, human-ai interfaces, creativity, design | x @apple, @google, @midjourney
Kai Arulkumaran @CoRL... @kaixhin
8K Followers 5K Following Researcher, programmer, DJ, transhumanist. @SakanaAILabs @ArayaGlobal; formerly @imperialcollege @MSFTResearch Twitter @AIatMeta @GoogleDeepMind @nnaisense
India in Details @IndiainDetails
9K Followers 7 Following YouTube Channel: India In Details Please support us: https://t.co/8BkE9ZWusk
Ryo Lu @ryolu_
57K Followers 2K Following Head of Design @Cursor_ai. Early @NotionHQ, @Stripe, built startups. I make a world where anyone can make software. Aspiring k-pop idol.
gabriel @GabrielPeterss4
38K Followers 499 Following research sora at @OpenAI, previously at midjourney, swedish high school dropout
Omar @oelmenoufy
31 Followers 53 Following 📍SF | Building Alfi | Ex-Product Ops @Apple & Solutions Engineering @Okta
simran sachdeva @simranrambles
15K Followers 791 Following engg @microsoft + contemplating life (occasionally)
Jay @jayendra_ram
2K Followers 922 Following founder @hud_evals, prev cs+physics @columbia, @ycombinator
Tri Dao @tri_dao
33K Followers 632 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
heiner @HeinrichKuttler
19K Followers 1K Following Pretraining @xAI. Previously: @InflectionAI, @AIatMeta, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
Michael Poli @MichaelPoli6
3K Followers 235 Following AI, numerics and systems. Co-founder @RadicalNumerics.
JingyuanLiu @JingyuanLiu123
3K Followers 427 Following https://t.co/D7zLeTZRMh is all you need | Opinions are my own
Tia (is on a hiatus) @siliconvo
102 Followers 86 Following Ranked 4th nationally in math | Computational Neuroscience • ML • Robotics
Alex Havrilla @Dahoas1
2K Followers 546 Following Research Scientist @GoogleDeepMind. Interested in interestingness
Abhishek Sinha @a7b2_3
803 Followers 713 Following Multi-modal Gemini @GoogleDeepMind | Previously Perception @Waymo | MSCS @Stanford Deep learning enthusiast..ardent arsenal fanTrends for United States
You might like
