Andrew Hinh @ajhinh
Full-Stack ML Engineer | CS Undergraduate ajhinh.com San Francisco Joined June 2022-
Tweets29
-
Followers35
-
Following174
-
Likes144
insane to me that 800 is divisible by 32, it just doesn't feel right
release the files
What does @modal do? How does it work? What's different about AI infra? Why did we throw out Kubernetes and Docker built our own infra stack from scratch? @AmplifyPartners wrote this article about a lot of the gory details under the hood of Modal – link in 🧵
At @modal we've built every layer of the AI infra stack from scratch — from filesystems and networking to our own async queues and multi-cloud GPU orchestration. I sat down with @narayanarjun from @AmplifyPartners to go into depth on all of this, including the fun ways the…
New tutorial on Fine-tuning Whisper 🎙️ Open-source ASR models are having a ~moment~ You can fine-tune them to achieve higher accuracy on things like domain-specific vocab.
Did you notice anything different about us on X today?
Proud to announce that @modal_labs was a Day 0 Lunch Partner for the release of gpt-oss. That is, on Day 0 I got lunch with @mgoin_ of @vllm_project and then had him look at my and @shariqmobin's code to deploy the model on Modal.
Proud to announce that @modal_labs was a Day 0 Lunch Partner for the release of gpt-oss. That is, on Day 0 I got lunch with @mgoin_ of @vllm_project and then had him look at my and @shariqmobin's code to deploy the model on Modal. https://t.co/BCLmrRfq7v
the mandate of heaven is fully lost and cannot be regained
the mandate of heaven is fully lost and cannot be regained
a woman at the checkout counter told me she liked my hair because it was "a great use of my free will" little does she know that i am actually obligated to maintain this style so that people will recognize me from the Internet
The Trump administration has suspended the funding of Terence Tao and the Institute for Pure and Applied Mathematics at UCLA.
For whatever reason, @modal_labs always gets compared to "inference providers", which always confuses me? Modal was always built to be a general-purpose platform for AI/ML/data. Yes – we do inference really well! But we also do batch processing, sandboxes, training, ...
My new job is to get everyone else to see what I see in Modal: the future of data-driven computing powered by open generative models trained at the scale of the web and adapted to end-user needs by code, customization, and continual improvement. LFG. modal.com
the city of San Francisco embraces multiple novel forms of personal transportation
a cold start hates to see Modal coming 😫
a cold start hates to see Modal coming 😫
You can now cold-start vLLM in 5s on @modal_labs. GPU snapshotting is a primitive that unlocks a whole world of possibilities we're only beginning to unlock. If you're interested in working on the frontiers of what's possible with AI infra, please reach out :)
You can now cold-start vLLM in 5s on @modal_labs. GPU snapshotting is a primitive that unlocks a whole world of possibilities we're only beginning to unlock. If you're interested in working on the frontiers of what's possible with AI infra, please reach out :)
I’m soo psyched to announce this one. We have raised again! Raised the bar for AI inference. By snapshotting GPU memory, we can cold start containers running vLLM or many other things extremely fast. This will be a game changer for many customers.
I’m soo psyched to announce this one. We have raised again! Raised the bar for AI inference. By snapshotting GPU memory, we can cold start containers running vLLM or many other things extremely fast. This will be a game changer for many customers.
We just launched GPU memory snapshotting on @modal_labs in alpha. Speed up cold boots by up to 12x 😇 If you're deploying AI models, a huge amount of cold boot time comes from loading model weights into GPU memory. This makes it difficult to scale GPU resources up and down…
ElvaZacharias @5PZ51Q6amB0vh
26 Followers 2K Following
Aman Swar @AmanSwar_
2 Followers 141 Following MLSys. Hacking on CUDA kernels, compilers,and LLM infra. Pushing performance
GriseldaDonne @ietrzE0M335wzat
13 Followers 869 Following
AthenaDaniel @Hfm451n02dHHq
14 Followers 877 Following
DoreenTaylor @m337Zkz1p4h7xY3
26 Followers 1K Following
SabinaSouthey @4zGaK0sjGjWIVMz
41 Followers 2K Following
Alessandro Palmas @alexpalms_
4 Followers 90 Following AI/ML Engineer Building AI Agents for Real World Applications
Frédéric Legrand @FredericTheTall
1K Followers 980 Following Giving robots brains @phospho_ai | AI, robotics, side projects bringing the latest AI technologies to everyone
クリスタルの海 @Preedal460
2 Followers 446 Following "Life is unpredictable, but good medicine and a compassionate heart never fail."
Rebeca Shanahan @RebecaShan47737
14 Followers 2K Following
Addison mcintosh @McintoshAd738
6 Followers 221 Following maybe life leaves us with cracks so we can let in more light and see a way out of the dark
Randal Lakin @LakinRanda71209
34 Followers 2K Following
sona dolasia @teenychairs
435 Followers 235 Following leading design @modal, previously @scale_ai @spotify collector of teeny chairs 🪑
Harmya @racerfunction
148 Followers 171 Following gpu enjoyer @tensarahq and prev @modal_labs, i like math, ml and guitar
Shlok Limbhare @shlok_limbhare
52 Followers 1K Following Machine learning, GPU kernels | Ex - VFX artist in Hollywood
Saksham @sgdescent
1K Followers 2K Following Interested in making LLMs go brrrrr x+1: MS @LTIatCMU x: LLM @Zomato x-N: https://t.co/ht5ObQh7RV & Program Synthesis with LLMs @ProseMsft
Sagar @sagar0x0
35 Followers 236 Following Making GPUs go brrr. https://t.co/k7VQuekntQ https://t.co/a8wCY6whNk || @rainference
Imani Hoppe @HoppeImani53568
81 Followers 4K Following
Saleh Hindi @SalehOfTomorrow
2K Followers 2K Following math and poetry. ex @lyft, @bloomberg, now changing healthcare with the power of my voice. DM if you want to make a new friend.
miru @miru_why
1K Followers 1K Following 3e-4x engineer, unswizzled wagmi. specialization is for warps
Charles 🎉 Frye @charles_irl
14K Followers 3K Following gpu enjoyer at @modal. he/him. ex @full_stack_dl, @weights_biases (acq. @CoreWeave), phd Berkeley @Redwood_Neuro. try https://t.co/SYWVMCazZ3
Tony Adastra @tonyadastra
167 Followers 377 Following Self-starter, Well-wisher, Tech Enthusiast | where there’s a will, there’s a way
Trey Zhong @QiZhong3
102 Followers 719 Following AI/ML @Instacart | @USC Trojan Alum | Ex-@Amazon | Angel Investor
cave_mhan @vincycode7
208 Followers 1K Following Python| Flask| Django| C| Machine Learning Engineer| Deep Learning practitioner
ZenML @zenml_io
2K Followers 2K Following Open-source pipeline framework that integrates all your ML tools. Get all your ML workflows running on any tooling stack with minimum effort.
San Francisco Compute @sfcompute
7K Followers 5 Following we sell very-large H100 training clusters with IB & fast disk you can buy in short-bursts (ie: 96 H100s for a week) 🇺🇸🏳️⚧️🌁
Edward Frenkel @edfrenkel
23K Followers 110 Following Mathematician, @UCBerkeley professor, author of LOVE & MATH (published in 20 languages), host of AfterMath series on YouTube, music expolorer as DJ Moonstein
SemiAnalysis @SemiAnalysis_
34K Followers 16 Following
Sabri Eyuboglu @EyubogluSabri
1K Followers 308 Following Working on language model memory. CS PhD student @Stanford working with @HazyResearch and @james_y_zou. 🪬
hazyresearch @HazyResearch
9K Followers 1K Following A research group in @StanfordAILab working on the foundations of machine learning & systems. https://t.co/JHK58TDorG Ostensibly supervised by Chris Ré
Scaling Intelligence ... @ScalingIntelLab
23 Followers 1 Following AI and Systems Laboratory in @StanfordAILab led by @Azaliamirh
DHH @dhh
554K Followers 131 Following Father of three, Creator of Ruby on Rails + Omarchy, Co-owner & CTO of 37signals, Shopify director, NYT best-selling author, and Le Mans 24h class-winner.
Alessandro Palmas @alexpalms_
4 Followers 90 Following AI/ML Engineer Building AI Agents for Real World Applications
Pablo Hansen @thepablohansen
879 Followers 455 Following Building Keystone (YC S25) https://t.co/epiYS9kQR4
Ernest Ryu @ErnestRyu
6K Followers 345 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Jason Wei @_jasonwei
98K Followers 635 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Figure @Figure_robot
141K Followers 1 Following Figure is an AI Robotics company building the world's first commercially viable autonomous humanoid robot.
Julien Chaumond @julien_c
64K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
kwindla @kwindla
11K Followers 4K Following Infrastructure and developer tools for real-time voice, video, and AI. @trydaily // ᓚᘏᗢ // @pipecat_ai
Jordan Juravsky @jordanjuravsky
876 Followers 263 Following AI PhD Student at Stanford, proud former goose at UWaterloo.
Balaji @balajis
1.2M Followers 4K Following Author of the Network State. Founder of the Network School.
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
Sukjun (June) Hwang @sukjun_hwang
3K Followers 300 Following ML PhD student @mldcmu advised by @_albertgu
ptrblck @ptrblck_de
18K Followers 424 Following Deep learning and drums, @PyTorch engineer at @NVIDIA
Harmya @racerfunction
148 Followers 171 Following gpu enjoyer @tensarahq and prev @modal_labs, i like math, ml and guitar
Tri Dao @tri_dao
32K Followers 632 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
htmx.org / CEO of Slo... @htmx_org
56K Followers 321 Following high power tools for html - ʕ •ᴥ•ʔ made in montana https://t.co/P2PXnepoeI (u know u want some)
mobicham @mobicham
550 Followers 113 Following I like to shrink dem models 🤏 Co-Founder & Principal Scientist @mobius_labs PhD @inria
Saksham @sgdescent
1K Followers 2K Following Interested in making LLMs go brrrrr x+1: MS @LTIatCMU x: LLM @Zomato x-N: https://t.co/ht5ObQh7RV & Program Synthesis with LLMs @ProseMsft
Nikhil Murthy @NikhilKMurthy
200 Followers 208 Following Co-founder of Phonic | Prev: ML @ Genesis Therapeutics, CS @ MIT
Michael Goin @mgoin_
1K Followers 376 Following inference optimization @RedHat_AI building @vllm_project | you can call me misha
Moin Nadeem @moinnadeem
3K Followers 1K Following Co-Founder at @Phonic_Co. Previously @Stanford CS PhD Dropout, @MosaicML, CS @MIT. I tend to be wrong, but the learning process makes it enjoyable. 🇵🇰🇺🇲
ishan @0xishand
2K Followers 1K Following inference (dynamo) @nvidia | prev. @brevdev (acq.) @agora_io (acq.), @columbia
Charles Pierse @cdpierse
494 Followers 584 Following ML @weaviate_io | Occasional maker of things, regular breaker of things.
Rebecka Storm @rebecka_sara
41 Followers 308 Following Co-founder of @twirldata. Previously built data teams and data products at @tink and @izettle.
Eric Hansander @erichansander
219 Followers 945 Following Perpetually building Ex-founder @twirldata, sold to @modal
ThePrimeagen @ThePrimeagen
297K Followers 1K Following skill issues: 🟩⬛️⬛️⬛️⬛️⬛️(69/420) https://t.co/qWJnB6p4EP https://t.co/IwY3FTx1ZE https://t.co/TYJ6aSpwYs
William Falcon ⚡️ @_willfalcon
15K Followers 476 Following CEO @LightningAI. Creator, PyTorch Lightning⚡, Lightning Studio. Former AI PhD student w @kchonyc @ylecun @metaAI
Soumith Chintala @soumithchintala
250K Followers 1K Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Peyton Walters @peywalt
335 Followers 294 Following longboarding down the information superhighway @modal
Michael Waskom @michaelwaskom
6K Followers 131 Following Machine pedagogue and data aesthete. Creator of https://t.co/imXawO1Iwk. Currently @modal_labs, building a new way to develop in the cloud.
sona dolasia @teenychairs
435 Followers 235 Following leading design @modal, previously @scale_ai @spotify collector of teeny chairs 🪑
Erik Dunteman @erikdunteman
7K Followers 2K Following building deterministic agents @ButterDev_, prev founder @BananaDev_, fan of running and drinking water (no ice)
Donny Greenberg @DonnyGreenberg
1K Followers 483 Following Building Kubetorch at @runhouse_🏃♀️🏠. Previously product lead @PyTorch, Quantum Computing @IBM, Ads @Google. Compulsive cook
Phil Eaton @eatonphil
25K Followers 612 Following cheerleader, organizer, staff software engineer, databases
Alessio Fanelli @FanaHOVA
7K Followers 989 Following Building @KernelLabs_ai | Co-host @latentspacepod | Partner @decibelvc | https://t.co/u4J6NVjUzd
Trends for United States
You might like
