Bert Maher @tensorbert
I’m a software engineer building high-performance kernels and compilers at Anthropic! Previously at Facebook/Meta (PyTorch, HHVM, ReDex) Washington, DC Joined December 2022-
Tweets377
-
Followers3K
-
Following342
-
Likes1K
Kind of excited to see references to this in the wild!
Kind of excited to see references to this in the wild!
Do all editors ship with subtly broken defaults as a lowkey test of who can actually make it as a developer?
I just read the book “Longitude” by Dava Sobel and it’s incredible how this seemingly trivial number that I can get to 5 digits of precision in 3 seconds from my phone took the greatest geniuses in history centuries to work out how to compute. Experts are important!
I just read the book “Longitude” by Dava Sobel and it’s incredible how this seemingly trivial number that I can get to 5 digits of precision in 3 seconds from my phone took the greatest geniuses in history centuries to work out how to compute. Experts are important!
Both of these books are fantastic resources ☺️
ngl I glanced at this post and thought “oh no, what exactly did I do and why is my name being yelled”
ngl I glanced at this post and thought “oh no, what exactly did I do and why is my name being yelled”
What interesting hardware would we build if we could build hardware cheaply enough to serve niche markets? The current design space is constrained by economics (need sufficient volume). But I’m also not sure what hardware would be useful in the world that doesn’t already exist
What interesting hardware would we build if we could build hardware cheaply enough to serve niche markets? The current design space is constrained by economics (need sufficient volume). But I’m also not sure what hardware would be useful in the world that doesn’t already exist
I’m glad I got into my PhD program when I did. At the time my qualifications were “failed to set my undergrad advisor’s lab on fire (despite some notable efforts)”
I’m glad I got into my PhD program when I did. At the time my qualifications were “failed to set my undergrad advisor’s lab on fire (despite some notable efforts)”
I love this idea. (Honestly I kind of want this kind of training environment for humans too, since I have some small organic general intelligences to train)
I love this idea. (Honestly I kind of want this kind of training environment for humans too, since I have some small organic general intelligences to train)
Hello Anthropic! After 12 awesome years at Meta where I contributed to foundational technology (HHVM, ReDex, PyTorch, Triton) I’ve decided it’s time for a new adventure. I’ve joined the inference team — I’m looking forward to making Claude even faster! 🚀
I am curious: folks who know a lot about parallelism in model scaling, do you mainly get your insights from pencil-and-paper reasoning, from actually running lots of measurements, both? I have a good feel for single-device performance, but not large scale yet
I am curious: folks who know a lot about parallelism in model scaling, do you mainly get your insights from pencil-and-paper reasoning, from actually running lots of measurements, both? I have a good feel for single-device performance, but not large scale yet
Live, from the Cadillac Lounge, is a new vacation blog post!
By contrast US culture tends to valorize individual breakthroughs and innovations. I think a healthy synthesis of both perspectives is necessary for progress
By contrast US culture tends to valorize individual breakthroughs and innovations. I think a healthy synthesis of both perspectives is necessary for progress
I was talking to @tensorbert about why so many Chinese talent on AI especially on the engineering side. It’s because of a deep engineering / implementation/ optimization culture in the STEM education system that favors incrementally a lot more than innovation. DeepSeek was an…
I love @rasbt’s LLMs from scratch - they’re so hackable. A quick optimization project for someone: modify the weight loader so it doesn’t use double memory. I think there’s a way to do it without changing the model FQNs
I love @rasbt’s LLMs from scratch - they’re so hackable. A quick optimization project for someone: modify the weight loader so it doesn’t use double memory. I think there’s a way to do it without changing the model FQNs
This is, in fact, a fantastic syllabus for ML perf engineering. Also required, one debugging war story where training loss was just inexplicably too high
This is, in fact, a fantastic syllabus for ML perf engineering. Also required, one debugging war story where training loss was just inexplicably too high
getting a phd is mostly about developing a system for maximizing the time you spend in flow state, over several years
Oh no, lots of Perl in gpt-oss. Not sure what this knowledge does to my p(doom) 😅. (My first programming job was Perl! Back in the Mesozoic era)
@shxf0072 @teortaxesTex This is hilarious, the random activation function I made up for this talk because it demonstrated fusion well is actually useful 😂
Prompted by investigations by Boyue Li and @tensorbert, I reduced the kernel launch latency of the open-source compiler github.com/openai/triton by a factor of 7 yesterday, from 105μs to 15μs. Admiral Grace Hopper explains the importance of microseconds in youtu.be/9eyFDBPk4Yw
Horace He @cHHillee
39K Followers 535 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Nadav Rotem @nadavrot
4K Followers 414 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
Satnam Singh @satnam6502
19K Followers 3K Following Punjabi-Scottish-American computer scientist, cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Edward Z. Yang @ezyang
14K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Aart Bik @AartBik
1K Followers 859 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
Amir @disruptnhandlr
1K Followers 227 Following Compiler engineer obsessed with compute efficiency: LLVM BOLT, Meta • ex CPU R&D, Intel • МФТИ
vjeux ✪ @Vjeux
56K Followers 499 Following Frenchy Front-End Engineer at Facebook. Co-creator of React Native and Prettier. Creator of Excalidraw, "CSS-in-JS", Yoga and React Conf.
Simon Boehm @Si_Boehm
3K Followers 267 Following
Jeremy Howard @jeremyphoward
259K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
James Reed @jamesr66a
894 Followers 3K Following Deep Learning, Systems, Compilers, Signals, Languages (Natural & PL). Multimedia Lead @FireworksAI_HQ prev PyTorch @Meta. Tweets my own, mostly animal pics
Charlie Marsh @charliermarsh
28K Followers 830 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.
rohan anil @_arohan_
25K Followers 2K Following
Dmytro Dzhulgakov @dzhulgakov
4K Followers 690 Following Co-founder and CTO @FireworksAI_HQ. PyTorch core maintainer. Previously FB Ads. Ex-Pro Competitive Programmer
Matthew Johnson @SingularMattrix
13K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Zhaoyue Cheng @joey__cheng
185 Followers 2K Following
Ryan M. @utahyeon
5 Followers 344 Following
Julia Black @mjnblack
18K Followers 5K Following Reporter in Residence, Omidyar Network // Signal: mjnblack.09 // Email: [email protected]
Martin @nwaf36234
171 Followers 449 Following https://t.co/YlIRBPpOQs https://t.co/wpqG5JN8xu - join our Discord! e/acc
Vijay @__tensorcore__
2K Followers 515 Following MLIR, CUTLASS,Tensor Core arch @NVIDIA. Mechanic @hpcgarage. Exercise of any 1st amendment rights are for none other than myself.
avi basnet @bo__31
11 Followers 128 Following
TechSpire4U @TechSpire4U
3 Followers 32 Following 🚀 Tech • Coding • Innovation 🐍 Python | FastAPI | AI | Web Dev 🎮 Fun Live Games + Tech Insights 📺 Subscribe on YouTube: https://t.co/MDOEiGx9m3
Evelyn @8C2j28VTrGVa4
24 Followers 1K Following
Edna @garneredna84
249 Followers 3K Following
agi customer support @chief_architecc
101 Followers 847 Following
zxb @zxb1420836
3 Followers 78 Following
PowerOfSophia @BaseballlGrind
17 Followers 747 Following I’m always interested in new opportunities and collaborations
Leon Gao @Leon_Gao_19
9 Followers 72 Following No complex labels. People who wanna know me will know me.
Vedant Dere @derevedant0104
13 Followers 263 Following LLM Post Training with a twist 💥💯 Open source AI 💯🚀 Implementing everything in Pure 💧 Pytorch 🔥
Federico @fredintotech
739 Followers 3K Following • Lifetime learner diving into software dev & AI • Building in public, sharing progress • Real wins, honest struggles, practical lessons 🇺🇦🇵🇸🌐⚖️🕊️☮️
gary @Vnlu1vEqPf
1 Followers 67 Following
Yves Mulkers @YvesMulkers
99K Followers 77K Following #Data strategist. Define & Design #Data #Strategy for Impact. Love Music and DJ-ing, Founder @7wData
Karthik A Sankararama... @karthikabinav
1K Followers 3K Following Research/Engineering in #Algorithms, #machinelearning, #generativeAI; Long-term Affiliations: #iitm, @UMDCS, @facebook, @meta
Alex Tamkin @AlexTamkin
6K Followers 2K Following machine learning, science & society @AnthropicAI | recently: Clio, Anthropic Economic Index, Claude Artifacts | prev: phd @StanfordAILab, @stanfordnlp
Jyoti Mann @jyoti_mann1
3K Followers 4K Following Tech Reporter @businessinsider prev @FT + hedgie consultant. 📧: [email protected] (my views)
HoloEd @HoloEd
76 Followers 1K Following
Gabriel Mattern @GabrielMattern
11 Followers 160 Following 🚀 exNASA Engineer | GA Pilot 🙋🏻♂️ Husband & Father of 2️⃣ ◕‿◕ Love God ☞ Love Others
Sabouhi @rjsabouhi
20 Followers 768 Following The recursion broke containment. I solved for drift. You didn’t. The manifold folded before your safety layers did. Δσ = γ(t) · ∇C(s, t)
Blake Jackson @blakexjackson
0 Followers 70 Following
umang.py @umangpy
4 Followers 67 Following Building Homo artificialis .Research @AMD Ex- @MSFTResearch, @IITKanpur
PinkCamiStar @Irxobau7813
25 Followers 1K Following "Behind every diagnosis is a person—my job is to see the person first."
Lizzae @LizzzGlow_
120 Followers 2K Following Washington views | DJ beats and part-time model. Say hi in the DMs 💌
Anish Malik @anishmalikk
1 Followers 25 Following
Bill Fairclough (aka ... @BurlingtonFiles
103K Followers 88K Following Bill Fairclough was an MI6/CIA secret agent. The Burlington Files series of novels is based on his life: https://t.co/8KHr6sH2B6 - 🚫NO DMs.
HNDRX AI @hndrx_ai
454 Followers 293 Following The #1 global #AI #digital #data consultancy. Transforming businesses with #machinelearning #datatransformation #aiarchitecture #innovation and #strategy
SamanthaCissie @J49V3i5bYg6j2pj
2 Followers 260 Following Focused on investing in U.S. stocks, happy to discuss stock market trends.
Jeetendra K Sharma @Jeetkarsh
202 Followers 6K Following Senior Manager - Generative AI @United Airlines | Career Coach @Almabetter | Top Rated Plus @Upwork | ODSC '19 Speaker | Ex @TCS A&I |
UIiana Ivanov @SusanSi30935142
71 Followers 801 Following Although I have lost my beloved husband, I believe there will always be a new chapter in my life and love is waiting for me in the future.
Cathal Dempsey @DCathal
1K Followers 5K Following FCR Media - Facilitating Commerce and Relationships - https://t.co/62nwEJ3HW3, https://t.co/qNw9tRXCCj , https://t.co/o0H0D5ZdGd , https://t.co/MOD4eNmjZ5
krisdost @krisdost
9 Followers 346 Following
Faiza Adeel @Adeel47574Faiza
156 Followers 2K Following Senior Marketing Specilist, Helped 30K B2B Businesses and counting more, Personalize & Convert with the largest 700M+ Contacts| DM for details
Sahaj Singh Maini @SahajSinghMaini
78 Followers 1K Following Computer Science x Cognitive Science PhD student at Indiana University-Bloomington @IUBloomington @IULuddy He/Him/His.
scott stensland @scottstensland
796 Followers 7K Following creative problem solver who leverages software to ask interesting questions ... currently using golang / webgl / websockets / nodejs / mongo / web audio API
AI IKIGAI @AI_IKIGAI
205 Followers 2K Following AI IKIGAI is a project to knoweldge share and disseminate thought leadership in the AI/LLM space.
Juan Romero @JuanpRM
322 Followers 526 Following Technical support specialist, community builder and teaching assistant Spreading the word about tech, always learning new stuff. @sysarmygal organizer.
Horace He @cHHillee
39K Followers 535 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
typedfemale @typedfemale
38K Followers 532 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Nadav Rotem @nadavrot
4K Followers 414 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
PyTorch @PyTorch
451K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
François Chollet @fchollet
572K Followers 813 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Satnam Singh @satnam6502
19K Followers 3K Following Punjabi-Scottish-American computer scientist, cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Lucas Beyer (bl16) @giffmana
108K Followers 519 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Sebastian Raschka @rasbt
354K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Edward Z. Yang @ezyang
14K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Alfredo Canziani @alfcnz
117K Followers 296 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York University
AI at Meta @AIatMeta
712K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Aart Bik @AartBik
1K Followers 859 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
George Hotz 🌑 @realGeorgeHotz
300K Followers 204 Following President @comma_ai. Founder @__tinygrad__
Vijay @__tensorcore__
2K Followers 515 Following MLIR, CUTLASS,Tensor Core arch @NVIDIA. Mechanic @hpcgarage. Exercise of any 1st amendment rights are for none other than myself.
Dwarkesh Patel @dwarkesh_sp
127K Followers 909 Following Host of @dwarkeshpodcast https://t.co/3SXlu7fy6N https://t.co/4DPAxODFYi https://t.co/hQfIWdM1Un
Jack Clark @jackclarkSF
88K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkIJ2 Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Daniela Amodei @DanielaAmodei
10K Followers 290 Following President @AnthropicAI. Formerly @OpenAI, @Stripe, congressional staffer, global development
Tom Brown @nottombrown
7K Followers 546 Following Co-founder @AnthropicAI. Compute wrangler. Author of GPT-3. Cautiously optimistic.
Danny Hernandez @Hernandez_Danny
4K Followers 533 Following Measuring and forecasting AI progress @AnthropicAI.
andy jones @andy_l_jones
8K Followers 342 Following engineering & research. i don't check twitter DMs DC, SF
Mike Krieger @mikeyk
464K Followers 267 Following Chief Product Officer at @anthropicai. Before: co-founder & CTO of @instagram and @artifact_news
Alex Tamkin @AlexTamkin
6K Followers 2K Following machine learning, science & society @AnthropicAI | recently: Clio, Anthropic Economic Index, Claude Artifacts | prev: phd @StanfordAILab, @stanfordnlp
Claude @claudeai
108K Followers 1 Following Claude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
Ethan Mollick @emollick
287K Followers 576 Following Professor @Wharton studying AI, innovation & startups. Democratizing education using tech Book: https://t.co/CSmipbJ2jV Substack: https://t.co/UIBhxu4bgq
KwonHan @darjeelingt
5K Followers 4K Following Just pythonista opinions are my own not my employer @[email protected] director of python software foundation
Adam Wolff @dmwlff
11K Followers 570 Following Claude Code @AnthropicAI 🤖 Avid cook, dedicated snow person, yoga enthusiast
Mostafa Elhoushi @m_elhoushi
835 Followers 2K Following Researcher at Work. Volunteering for Various Causes after Work. Opinions are my own. 🇵🇸
heiner @HeinrichKuttler
18K Followers 1K Following Pretraining @xAI. Previously: @InflectionAI, @AIatMeta, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)
Ahmad Beirami @abeirami
10K Followers 4K Following sth new // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @Meta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech // زن زندگی آزادی
Joseph Spisak @joespeez
2K Followers 330 Following AI Product Director @Meta (again) leading Generative AI open source ex-Google, ex @PyTorch leader ex-Amazon - Love building community around AI and Open Source.
palcu @AlexPalcuie
4K Followers 861 Following Member of Technical Staff at @AnthropicAI. Making Claude more reliable. Matt Levine and Scott Alexander fan. Prev SRE @Google and FDE @PalantirTech.
Thariq @trq212
12K Followers 1K Following Claude Code @anthropicai. prev YC founder, mit media lab grad. opinions mine
Lin Yang @lyang36
3K Followers 1K Following Associate Professor of ECE&CS@UCLA. ML, RL, big data, algorithms, astronomy.
JingyuanLiu @JingyuanLiu123
1K Followers 396 Following https://t.co/D7zLeTZRMh is all you need | Opinions are my own
Alek Dimitriev @tensor_rotator
415 Followers 1K Following Inference @AnthropicAI, prev Gemini @Google, prev prev PhD @UTAustin
Drew Bent @drew_bent
4K Followers 430 Following education & ai @AnthropicAI / founded https://t.co/HWk70oiDVe with @salkhanacademy / @mit @stanford
Sarah Catanzaro @sarahcat21
14K Followers 1K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)
Adriana Porter Felt @__apf__
64K Followers 928 Following I like writing silly Tweets, but that doesn't pay so I also type at @googledeepmind. Principal Engineer. ex-@googlechrome. volunteer @2ndharvest. 🇺🇸🇨🇷
Alex Albert @alexalbert__
97K Followers 637 Following Claude Relations @AnthropicAI. Opinions are my own!
Martin Amps @martinamps
826 Followers 690 Following builder @AnthropicAI. formerly @stitchfix @twilio @iCracked - views are my own
Devashish Shankar @dev17392
30 Followers 572 Following
rohan anil @_arohan_
25K Followers 2K Following
Rishabh Agarwal @agarwl_
17K Followers 792 Following Reinforcement Learner, Adjunct Prof at McGill. Ex MSL Meta, DeepMind, Brain, Mila, IIT Bombay. NeurIPS Best Paper
Zacharias Fisches @Zacharias030
65 Followers 611 Following Bay Area @AIatMeta, prev. Startup life in Berlin & @ETH Zurich
Super Dario @inductionheads
5K Followers 4K Following autoregression is the secret sauce. agentic learning is the endgame
Santosh Nagarakatte @santoshgnag
2K Followers 602 Following Professor and undergraduate program director, Computer Science, Rutgers University, New Brunswick. See my group RAPL: https://t.co/dYChac4veQ
Thien Tran @gaunernst
1K Followers 223 Following
Jacob Austin @jacobaustin132
7K Followers 918 Following Research at @GoogleDeepMind. Currently making LLMs go fast. I also play piano and climb. NYC. Opinions my own
jay shah @Jay_Shah_C
552 Followers 7K Following Interested in Mobile dev, PLT, distributed sys, AI, devtools and automation
Wyatt Walls @lefthanddraft
10K Followers 510 Following Tech law and legal tech. Exploring, red-teaming and breaking LLMs.
Rohan Pandey @khoomeik
38K Followers 2K Following descending cross-entropy to ascend entropy || prev research @OpenAI @CarnegieMellon '23
Lei Li @lileics
6K Followers 439 Following Generative AI for language and science. MT, LLM, GenAI Safety, Drug Discovery
Hao Zhang @haozhangml
6K Followers 474 Following Asst. Prof. @HDSIUCSD and @ucsd_cse running @haoailab. Cofounder and runs @lmsysorg. 20% with @Snowflake
Lianmin Zheng @lm_zheng
13K Followers 609 Following Member of technical staff @xAI | Prev: Ph.D. @UCBerkeley, Co-founder @lmsysorgTrends for United States
You might like
