Bert Maher @tensorbert
I’m a software engineer building high-performance kernels and compilers at Anthropic! Previously at Facebook/Meta (PyTorch, HHVM, ReDex) Washington, DC Joined December 2022-
Tweets418
-
Followers3K
-
Following375
-
Likes1K
Introducing Claude Sonnet 4.5—the best coding model in the world. It's the strongest model for building complex agents. It's the best model at using computers. And it shows substantial gains on tests of reasoning and math.
Good list! Simon’s and Pranjal’s matmul blogs were foundational to my understanding of GPU performance
Good list! Simon’s and Pranjal’s matmul blogs were foundational to my understanding of GPU performance
lol, there is quite the explosion of kernel DSLs lately (triton, tilelang, gluon, TLX, cuteDSL, cuTile, …) And honestly as much as I love TLX and want it to succeed, I think the next big kernel programming language might be… natural, human language
lol, there is quite the explosion of kernel DSLs lately (triton, tilelang, gluon, TLX, cuteDSL, cuTile, …) And honestly as much as I love TLX and want it to succeed, I think the next big kernel programming language might be… natural, human language
A great example of how subtle numerical issues can bite you. Fusing multiply-add into FMA strictly improves precision of that operation (the mul is computed in infinite precision). But it breaks the larger expression if other parts are not computed with the same high precision!
A great example of how subtle numerical issues can bite you. Fusing multiply-add into FMA strictly improves precision of that operation (the mul is computed in infinite precision). But it breaks the larger expression if other parts are not computed with the same high precision!
Debugging subtle numerical issues in ML systems - especially in the compiler! - is really freaking hard. Very impressed by the debugging that went into discovering these
Debugging subtle numerical issues in ML systems - especially in the compiler! - is really freaking hard. Very impressed by the debugging that went into discovering these
I found myself wondering if we might benefit from a resurgence of Halide- (or TVM) -like ideas, where you have some math to optimize, and a library of optimizations through which the machine can search to find the best outcome
I found myself wondering if we might benefit from a resurgence of Halide- (or TVM) -like ideas, where you have some math to optimize, and a library of optimizations through which the machine can search to find the best outcome
What if instead of a paperclip maximizer we built and hoodie-and-bag maximizer, and what if it turns out we’re already living in its world?? 😱
What if instead of a paperclip maximizer we built and hoodie-and-bag maximizer, and what if it turns out we’re already living in its world?? 😱
I’ve seen this “FAANG vibe code” post a few times and tbh this workflow sounds… tedious. “Write a design doc, align stakeholders, iterate on design review, etc” How about: have an awesome idea and build it
TIL, RIP Triton, killed by inability to have good Blackwell performance
This is cool work on kernel generation. A challenge I’d like to see solved: given a brand new architecture doc, generate an updated kernel. (Possibly leveraging the kernels for the old platform, if it helps)
This is cool work on kernel generation. A challenge I’d like to see solved: given a brand new architecture doc, generate an updated kernel. (Possibly leveraging the kernels for the old platform, if it helps)
Also there’s a pytorch/ directory. It does not contain pytorch
Also there’s a pytorch/ directory. It does not contain pytorch
The most important skill for a researcher is not technical ability. It's taste. The ability to identify interesting and tractable problems, and recognize important ideas when they show up. This can't be taught directly. It's cultivated through curiosity and broad reading.
I like python but weird stuff happens with imports. We had a bug with Triton-related imports in FB’s stack that no one could explain or repro outside of prod. We “fixed” it by generally cleaning up some imports but I would have much preferred a definitive explanation
I like python but weird stuff happens with imports. We had a bug with Triton-related imports in FB’s stack that no one could explain or repro outside of prod. We “fixed” it by generally cleaning up some imports but I would have much preferred a definitive explanation
Read this to the end — the last section is mind-blowing
Read this to the end — the last section is mind-blowing
Horace He @cHHillee
42K Followers 537 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Soumith Chintala @soumithchintala
252K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Nadav Rotem @nadavrot
4K Followers 414 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
Satnam Singh @satnam6502
20K Followers 3K Following Punjabi-Scottish-American computer scientist, cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Edward Z. Yang @ezyang
14K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Aart Bik @AartBik
1K Followers 860 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
Amir @disruptnhandlr
1K Followers 196 Following Eternally junior compiler engineer, baby architect, mediocre programmer
vjeux ✪ @Vjeux
56K Followers 505 Following Frenchy Front-End Engineer at Facebook. Co-creator of React Native and Prettier. Creator of Excalidraw, "CSS-in-JS", Yoga and React Conf.
Simon Boehm @Si_Boehm
3K Followers 266 Following
Jeremy Howard @jeremyphoward
261K Followers 6K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Prev: professor @ UQ; Stanford fellow; @kaggle president; @fastmail/@enlitic/etc founder https://t.co/16UBFTX7mo
James Reed @jamesr66a
895 Followers 3K Following Deep Learning, Systems, Compilers, Signals, Languages (Natural & PL). Multimedia Lead @FireworksAI_HQ prev PyTorch @Meta. Tweets my own, mostly animal pics
Charlie Marsh @charliermarsh
28K Followers 827 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.
Dmytro Dzhulgakov @dzhulgakov
4K Followers 697 Following Co-founder and CTO @FireworksAI_HQ. PyTorch core maintainer. Previously FB Ads. Ex-Pro Competitive Programmer
Matthew Johnson @SingularMattrix
13K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Robin @robinwritescode
470 Followers 4K Following Leading Product for CoreML Group @yelp Prev: ML Researcher @McMasterU, ML EM @etsy | Investing and Building at the Frontier @frontier_fund
Lisa @TerriHenni86798
3 Followers 169 Following Life has no rehearsals; every day is a live broadcast.
Michael @MlbnvaAI
1K Followers 4K Following Technologist. Backgrounds in AI, OS, networking, multimedia & business. Common Sense.
dvorkin /// @the_dvorkin
3K Followers 2K Following Rethinking inference infrastructure for a better tomorrow. Product at https://t.co/NIXXDAbBJA
servescale.ai @servescale_ai
4 Followers 64 Following your model. your infra. your data. we do the rest.
Bill @Hackerbill05279
225 Followers 4K Following Cybersecurity Expert, Scam Tracker, Hacker, Programmer & Asset Recovery Specialist | Your Digital Guardian 😎💻🥷
Andrea Moleri @moleriandrea
43 Followers 738 Following Machine Learning at @Honda Research Institute EU, MSc Student at @UNIMIB
Dong He @dongheuw
164 Followers 286 Following Scaling Llama Pre-Training and Post-Training @meta Superintelligence. PhD @uwcse.
Y @mng524353696432
3 Followers 493 Following
Ted Zadouri @tedzadouri
601 Followers 279 Following PhD Student @PrincetonCS @togethercompute | Previously: @cohere @UCLA
Aurora @2yz5u08nA41RG
9 Followers 680 Following The strongest actions for a woman is to love herself, be herself, and shine amongst those who never believed she could.
Dheeraj Mekala @MekalaDheeraj
1K Followers 409 Following Agents & Reasoning at MSL. Ph.D. from @UCSanDiego. @iitkanpur alum
Jan Szczepaniec @JanSzczepaniec
53 Followers 438 Following Engineer at @Meta AI Previously: @TheSanctuaryAI @awscloud @wayve_ai
Raynor @naixgnehz
250 Followers 2K Following
Hongtao Yu @htyu00
1 Followers 1 Following
The Krazi Speculator @LocoSpeculator
78 Followers 896 Following NOT FINANCIAL/INVESTMENT ADVICE! A fan of science and engineering. Speculating on the future of technologies. Stocks and options. No DMs. Do your own research.
Crypsonad @crypsonad
19 Followers 2K Following
Frypan @Fryingpan26
1 Followers 31 Following
Mike @fpgamike
21 Followers 222 Following Parallel programming models and languages, FPGAs, compilers. Opinions are my own
GosuTek @TekGosu
4 Followers 115 Following project: sparse-MHSA pipeline from scratch currently: trying to outperform cuSparse on SpMM
Harishkumar Pillai @harishpillai30
30 Followers 306 Following Software Engineer | Golang | Python | Kubernetes | DNS Security. Working on AI Agents, RAG and Building custom LLMs for various sector.
ramsay @rsims3k
36 Followers 564 Following
Arun Rajagopalan @ArunRajaga
36 Followers 716 Following
Deeptendu @DSantra92
181 Followers 1K Following evaluating Agents | prev @useiterate @letsunifyai • GSOC @JuliaLanguage • @mitacscanada GRI fellow
Sai Ramana @__sairamanar
31 Followers 610 Following “It is possible to invent a single machine which can be used to compute any computable sequence.”
Nikhil Patel @XXXPateltacion
68 Followers 403 Following a poet trapped inside the body of a finance guy
tistung @tistung
8K Followers 1K Following AI Scientist. Curious about the human condition and the natural world. Occasional writer. Nepali. साधक।
Anop @anopska
106 Followers 1K Following
prassanna @prassannaindia
427 Followers 1K Following
harmon @_harm0n
141 Followers 658 Following exploring mlsys/compiler optimization | research @securebio/@mit | prev @WisconsinCS
Nimit Kanani @KananiNimit
127 Followers 570 Following MS CS student @nyuniversity, Alumni @bitspilaniindia, Long distance runner, Badminton Player.
masan tako @MasanTako
1 Followers 224 Following
Franz Srambical (not ... @lemergenz
224 Followers 426 Following slowly, then suddenly. agi @prob_doom
AG @observerNorth99
44 Followers 5K Following
Deepak Sandhu @ideepaksandhu
0 Followers 729 Following
filip @fskrtfskrt
27 Followers 244 Following Remote Thought Execution | Inference @ Huawei Research | prev @IBM Research | @ETH @ChalmersUniv @NTUsg
TonyStock @TonyStock966952
158 Followers 2K Following
alexi @alexhsieh428
4 Followers 390 Following sci-fi / fantasy / horror genres, games (Horizon ZD/FW & Control)
Horace He @cHHillee
42K Followers 537 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Soumith Chintala @soumithchintala
252K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Yann LeCun @ylecun
955K Followers 765 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
typedfemale @typedfemale
39K Followers 537 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Nadav Rotem @nadavrot
4K Followers 414 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
PyTorch @PyTorch
453K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
François Chollet @fchollet
576K Followers 817 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Satnam Singh @satnam6502
20K Followers 3K Following Punjabi-Scottish-American computer scientist, cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Lucas Beyer (bl16) @giffmana
110K Followers 523 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Sebastian Raschka @rasbt
358K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Edward Z. Yang @ezyang
14K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Alfredo Canziani @alfcnz
119K Followers 296 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York University
AI at Meta @AIatMeta
717K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Aart Bik @AartBik
1K Followers 860 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
George Hotz 🌑 @realGeorgeHotz
300K Followers 204 Following President @comma_ai. Founder @__tinygrad__
Hongtao Yu @htyu00
1 Followers 1 Following
Jan Szczepaniec @JanSzczepaniec
52 Followers 438 Following Engineer at @Meta AI Previously: @TheSanctuaryAI @awscloud @wayve_ai
SzymonOzog @SzymonOzog_
2K Followers 169 Following Maximizing throughput at @Aleph__Alpha Educating people about GPUs at https://t.co/81rRJ4KWK1
levent @__alpoge__
291 Followers 26 Following the idiot. cuda kid; h val; morgan prize; blabla; sof @harvard as mathematician (eff. mordell, H10/# fields, x^3+y^3=n,…)+agi @anthropicai as computer scientist
Laurens van der Maate... @lvdmaaten
4K Followers 2K Following Member of Technical Staff at Anthropic. Ex-Meta. t-SNE. Llama 3. DenseNet. Web-scale weakly supervised vision. CrypTen.
Theo - t3.gg @theo
247K Followers 4K Following Full time CEO @t3dotchat. Part time YouTuber, investor, and developer
archie @archie_4rch13
707 Followers 312 Following mts @ anthropic | pytorch alum | thoughts are my own :-)
Gaurav @gauravisnotme
2K Followers 548 Following Good model @xAI | prev. d-matrix, Google. Opinions are my own - always and forever
You Jiacheng @YouJiacheng
9K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉
Zihao Ye @ye_combinator
2K Followers 552 Following Proud to be an engineer. I'm building flashinfer (https://t.co/PabCM3ksjN) Opinions are my own.
ARC Prize @arcprize
28K Followers 173 Following A North Star for open AGI. Co-founders: @fchollet @mikeknoop. President: @gregkamradt. Help support the mission - make a donation today.
Anne Ouyang @anneouyang
7K Followers 927 Following Building @Standard_Kernel, CS PhD student @Stanford | prev: cuDNN @Nvidia, M.Eng, B.S. in CS @MIT | efficient scalable self-improving AI systems | 🌽KernelBench
Byron Hsu @hsu_byron
4K Followers 2K Following ML system @xAI | @lmsysorg @liger_kernel @flyteorg @theASF
Steve Yegge @Steve_Yegge
15K Followers 11 Following I've been in the industry for O(40) years and have written O(1M) LOC. I don't think I'll ever write O(another) line again, but I'll be launching more than ever.
Kaiming Cheng @KaimingCheng
601 Followers 837 Following Research Scientist @meta superintelligence lab - @pytorch. Prev: PhD from @uwcse. Opinions are my own.
Dinghuai Zhang 张鼎... @zdhnarsil
4K Followers 2K Following Researcher at @MSFTResearch. Prev: PhD at @Mila_Quebec, intern at @Apple MLR and FAIR Labs @MetaAI, math undergraduate at @PKU1898.
Jeremy Bernstein @jxbz
7K Followers 615 Following 🧪 @thinkymachines ✍️ anon feedback @ https://t.co/RIhBhjMRdD
Lilian Weng @lilianweng
166K Followers 166 Following Co-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
Charles 🎉 Frye @charles_irl
15K Followers 3K Following gpu enjoyer at @modal. he/him. ex @full_stack_dl, @weights_biases (acq. @CoreWeave), phd Berkeley @Redwood_Neuro. try https://t.co/SYWVMCazZ3
Vijay @__tensorcore__
2K Followers 525 Following MLIR, CUTLASS,Tensor Core arch @NVIDIA. Mechanic @hpcgarage. Exercise of any 1st amendment rights are for none other than myself.
Dwarkesh Patel @dwarkesh_sp
130K Followers 919 Following Host of @dwarkeshpodcast https://t.co/3SXlu7fy6N https://t.co/4DPAxODFYi https://t.co/hQfIWdM1Un
Jack Clark @jackclarkSF
89K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkIJ2 Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Daniela Amodei @DanielaAmodei
10K Followers 290 Following President @AnthropicAI. Formerly @OpenAI, @Stripe, congressional staffer, global development
Tom Brown @nottombrown
8K Followers 544 Following Co-founder @AnthropicAI. Compute wrangler. Author of GPT-3. Cautiously optimistic.
Danny Hernandez @Hernandez_Danny
4K Followers 533 Following Measuring and forecasting AI progress @AnthropicAI.
andy jones @andy_l_jones
8K Followers 342 Following engineering & research. i don't check twitter DMs DC, SF
Mike Krieger @mikeyk
463K Followers 267 Following Chief Product Officer at @anthropicai. Before: co-founder & CTO of @instagram and @artifact_news
Alex Tamkin @AlexTamkin
6K Followers 2K Following machine learning, science & society @AnthropicAI | recently: Clio, Anthropic Economic Index, Claude Artifacts | prev: phd @StanfordAILab, @stanfordnlp
Claude @claudeai
136K Followers 1 Following Claude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
Ethan Mollick @emollick
290K Followers 578 Following Professor @Wharton studying AI, innovation & startups. Democratizing education using tech Book: https://t.co/CSmipbJ2jV Substack: https://t.co/UIBhxu4bgq
KwonHan @darjeelingt
5K Followers 4K Following Just pythonista opinions are my own not my employer @[email protected] director of python software foundation
Trends for United States
You might like
