Harmya @racerfunction
gpu enjoyer @tensarahq and prev @modal_labs, i like math, ml and guitar harmya.me cache Joined September 2019-
Tweets137
-
Followers158
-
Following177
-
Likes349
Harmya retweeted
We reverse-engineered Flash Attention 4.
20
70
692
97K
430
Download Image
just @msarthak29 cooking hard
shoutout from vllm <3
godbolt and chill to make modal.com/gpu-glossary/p…
godbolt and chill to make modal.com/gpu-glossary/p…
something I worked on @modal job description: materialize @charles_irl’s ideas Do check it out!!
something I worked on @modal job description: materialize @charles_irl’s ideas Do check it out!!
just put the fries in the bag bro
just put the fries in the bag bro
Harmya retweeted
What does @modal do? How does it work? What's different about AI infra? Why did we throw out Kubernetes and Docker built our own infra stack from scratch? @AmplifyPartners wrote this article about a lot of the gory details under the hood of Modal – link in 🧵
locked in on a hike
share your favorite kernels
Harmya retweeted
Make GPUs go brr right from your browser 🏃♂️⚡️ Arbitrary CUDA code execution is now on Tensara!
Harmya retweeted
OpenAI has released its first open weights language model since GPT-2 over five years ago. gpt-oss has - efficient mxfp4 MoEs - native tool-calling & reasoning - attention sinks for long context This looks like a great model for self-hosted agents. Try it on Modal!
Harmya retweeted
We just launched GPU memory snapshotting on @modal_labs in alpha. Speed up cold boots by up to 12x 😇 If you're deploying AI models, a huge amount of cold boot time comes from loading model weights into GPU memory. This makes it difficult to scale GPU resources up and down…
that one thread issuing a tcgen 05 mma instruction for the CTA on a b200
Harmya retweeted
ICYMI, open models for transcription are very good now. In just the last few months, we've gotten @nvidia Parakeet and Canary, @kyutai_labs STT, and @MistralAI Voxtral. Running your own transcription at scale is now 100x faster and 100x cheaper than using a proprietary API.
this might be late stage capitalism @sama
Harmya retweeted
My talk for @aiDotEngineer on what I think every person working with language models needs to know about GPUs is now available! - Latency lags bandwidth. - GPUs embrace bandwidth. - Don't be scared of N squared. - Use the Tensor Cores, Luke! youtube.com/watch?v=y-UGrY…
Mohammad Taha Fakhari... @TheSTraveller
532 Followers 4K Following Phd Student @OISTedu. I enjoy to work on the intersection of machine learning, neuroscience, computer science and mathematics. I love football, music and Iran!
Emma @Yvwiorbor68080
29 Followers 2K Following I’m not a backup plan, and definitely not your second choice.
🥁🎉 @BereniceFr37301
1 Followers 233 Following
Arjun @uhrjun
0 Followers 152 Following
Vartan Polodyan @VarPol
194 Followers 6K Following
deba.ch @derangineer
38 Followers 522 Following ML Research Engineer. Research fellow JHU, BEng MComp ANU. Resource efficient architecture and ML Systems, multi-modal retrieval and generation
Alex Zhang @a1zhang
13K Followers 598 Following phd student @MIT_CSAIL, ugrad @Princeton, 🫵🏻 go participate in the @GPU_MODE kernel competitions!
Saurav Maheshkar ☕�... @MaheshkarSaurav
515 Followers 2K Following evals @dottxtai | @GoogleDevExpert in JAX/Flax | Undergrad @csmcr ‘25 | Former @weights_biases @Recourseai @lightlyai
Yash Malik @_yash_malik_
100 Followers 1K Following ML @AmazonScience Scaling RL for LLMs Prev @Google, SC
Rathul Anand @vendablechart
129 Followers 861 Following cs & math @ucla | gpus, optimization, and vlms! | prev research intern @semgrep
Moein Shariatnia @MoeinShariatnia
1K Followers 2K Following ML Dev & Researcher | 🩺 Med Student at TUMS | CV and NLP | Writer @YuanCommunity and @Medium | Freelancer AI dev
emily han @emilyhanyf
919 Followers 484 Following 19 yo, ai/systems + design @stanford, co-director @hackwithtrees, llm inference @modal
Eitan Turok @ICML 202... @EitanTurok
925 Followers 2K Following AI researcher sorting in exponential time. Ex @DbrxMosaicAI @Columbia.
rushikesh @1999Yadwade
153 Followers 752 Following pinkdroid/paulismatrix Excited about databases and distributed systems! Undercutting life 🏎️ Engg @gojektech (views are my own)
Sourik @Sourik24
286 Followers 2K Following Making GPUs and CPUs go Brrrrr @ https://t.co/CXXbtt3IPU , GPU tinkerer, Compiler Fanatic, Code Slinger, Harry Potter and Star Trek Nerd, Full-Time LEGO Connoisseur
Jonathon Belotti @jonobelotti_IO
900 Followers 185 Following Peeling back the layers @modal. Previously ML platform @canva. dms open.
Michael @michael_chomsky
3K Followers 1K Following head of devrel @ https://t.co/Qaze3nO18q cal '24 1M visits/mo on https://t.co/EgcQIkwwiG prev KX
zhong zhang @zhongzh0221
41 Followers 1K Following
kabir @KabirGoel
2K Followers 1K Following taking down production @cartesia_ai • wasted your tax dollars @cal
Mikail Khan @fiiissshh
92 Followers 156 Following Moving fast and making things @ CMU S3D, Purdue CS '24
alana goyal @alanaagoyal
14K Followers 4K Following one woman vc partner to @ashbyhq @astral_sh @braintrustdata @basetenco @browserbasehq @maticrobots @paper @resend @supabase @vercel @windsurf + more
Oolaupsee @Oolaupsee9503
41 Followers 476 Following
Sébastien Darses @DarsesSebastien
3K Followers 3K Following Math. Assoc. Prof. (on leave) 👨🎓Teaching project https://t.co/ptSyDYukee
Snehil Saluja @mesnhl
2K Followers 3K Following co-founder and Chief Sales Rep at @OverlayyAI: the AI for Humans In Sales • 🎓 @IITKanpur @CMSJaiJagat
Rohin Manvi @rohin_manvi
518 Followers 360 Following phding @berkeley_ai, research @liquidai_, prev @stanford @stanfordailab, @meta
Oglouedauq @Oglouedauq2218
57 Followers 531 Following
Ryan Rong @RyanNeverWrong
305 Followers 391 Following AI + Math @Stanford | Student Researcher @StanfordAILab | @Uber, @Google
Ireaoojsu @Ireaoojsu79235
47 Followers 2K Following
Saurav Maheshkar ☕�... @MaheshkarSaurav
515 Followers 2K Following evals @dottxtai | @GoogleDevExpert in JAX/Flax | Undergrad @csmcr ‘25 | Former @weights_biases @Recourseai @lightlyai
Rathul Anand @vendablechart
129 Followers 861 Following cs & math @ucla | gpus, optimization, and vlms! | prev research intern @semgrep
emily han @emilyhanyf
919 Followers 484 Following 19 yo, ai/systems + design @stanford, co-director @hackwithtrees, llm inference @modal
alana goyal @alanaagoyal
14K Followers 4K Following one woman vc partner to @ashbyhq @astral_sh @braintrustdata @basetenco @browserbasehq @maticrobots @paper @resend @supabase @vercel @windsurf + more
kabir @KabirGoel
2K Followers 1K Following taking down production @cartesia_ai • wasted your tax dollars @cal
Alexandr Wang @alexandr_wang
333K Followers 838 Following chief ai officer @meta, founder @scale_ai. rational in the fullness of time
Rohin Manvi @rohin_manvi
518 Followers 360 Following phding @berkeley_ai, research @liquidai_, prev @stanford @stanfordailab, @meta
Michael Goin @mgoin_
1K Followers 388 Following inference optimization @RedHat_AI building @vllm_project | you can call me misha
Ryan Rong @RyanNeverWrong
305 Followers 391 Following AI + Math @Stanford | Student Researcher @StanfordAILab | @Uber, @Google
Nikhil Buduma @nkbuduma
2K Followers 587 Following co-founder & chief scientist @ ambience healthcare, author of o'reilly fundamentals of deep learning, mit cs + creative writing
Samir Walji @samir_walji
457 Followers 2K Following co-founder https://t.co/pt5ardf9m0 (acq. by @usnews), cs @ rice
Shivali @shivaligoyal27
473 Followers 631 Following Building @trupeerai | ex-@pillowfund, @bcg, @iitdelhi
Charlie Marsh @charliermarsh
28K Followers 827 Following Building @astral_sh: Ruff, uv, and other high-performance Python tools. Prev: Staff engineer @SpringDiscovery, @KhanAcademy, BSE @PrincetonCS.
Chris Olah @ch402
123K Followers 182 Following Reverse engineering neural networks at @AnthropicAI. Previously @distillpub, OpenAI Clarity Team, Google Brain. Personal account.
shreya rajpal @ShreyaR
8K Followers 950 Following ML, systems, and everything in between. Building @guardrails_ai. Previously founding eng @predibase, @Apple SPG, @driveai_, @IllinoisCS, @iitdelhi.
"Leigh Marie" Braswel... @LM_Braswell
19K Followers 5K Following partner @kleinerperkins; previously investing @foundersfund, first pm & early eng @scale_ai; if you like infra, ML, or poker let's chat
Conrad Wichmann @conradwichmann
1K Followers 476 Following @zfellows | quantum @fermilab @uchicago @harvard
Sibesh Kar @sibeshkar
690 Followers 386 Following fixing bugs @mayalabsio. tweets are notes to self.
TBPN @tbpn
106K Followers 959 Following Technology's daily show. Hosted by @johncoogan & @jordihays. Streaming live 11a-2p PT every weekday and available on Apple, Spotify, & YouTube.
Rich @Im_Rich_Zou
3K Followers 2K Following 20yo / growth @withdelphi Finance @northeastern / prev top 30 @leagueoflegends @parable_vc (intern)
sathvik @vikvang1
4K Followers 1K Following something new @gthackerhouse, scout @aforevc | prev @perplexity_ai @startupxchange @georgiatech
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
Karan Goel @krandiash
8K Followers 966 Following founder ceo @cartesia_ai, phd @stanfordailab, @mldcmu @iitdelhi alum
Peyton Walters @peywalt
391 Followers 301 Following longboarding down the information superhighway @modal
Ashvin @ashverm4
184 Followers 318 Following EECS/physics @UCBerkeley, previously ml compilers @AMDRyzen, fpga @armoryshield, @exunclan
Madhav @sharmadhav03
96 Followers 503 Following always interested in algorithms, systems and learning new things. @umich math cs and @simberobotics
Alex Zhang @a1zhang
13K Followers 598 Following phd student @MIT_CSAIL, ugrad @Princeton, 🫵🏻 go participate in the @GPU_MODE kernel competitions!
Patrick Chase @patrickachase
2K Followers 942 Following Managing Director @Redpoint investing in Infrastructure, SaaS, & AITrends for United States
26,5 B posts
276 B posts
44,8 B posts
142 B posts
53,2 B posts
31,5 B posts
1.201 posts
16,9 B posts
1.219 posts
6.149 posts
449 B posts
10,8 B posts
53,2 B posts
5.301 posts
142 B posts
13,7 B posts
68,9 B posts
27,2 B posts
You might like
Rachit Modi
@RachitModi17
42 Followers
Souradeep Banerjee
@Sou_ra_binn
75 Followers
Abhimanyu kundu
@kunnduu
32 Followers
Aniket Nayak
@anithenayak
678 Followers
Nitish
@nitishyaar
705 Followers
Ansh Shah
@Anshshah2202
9 Followers
Keano
@Keano_facts
2K Followers
Ratul
@RatulDas_
280 Followers
neongreen kaftan
@manikarnejaf
111 Followers