Andrew Hinh @ajhinh
Full-Stack ML Engineer | CS Undergraduate ajhinh.com San Francisco Joined June 2022-
Tweets29
-
Followers38
-
Following179
-
Likes170
insane to me that 800 is divisible by 32, it just doesn't feel right
release the files
What does @modal do? How does it work? What's different about AI infra? Why did we throw out Kubernetes and Docker built our own infra stack from scratch? @AmplifyPartners wrote this article about a lot of the gory details under the hood of Modal – link in 🧵
At @modal we've built every layer of the AI infra stack from scratch — from filesystems and networking to our own async queues and multi-cloud GPU orchestration. I sat down with @narayanarjun from @AmplifyPartners to go into depth on all of this, including the fun ways the…
New tutorial on Fine-tuning Whisper 🎙️ Open-source ASR models are having a ~moment~ You can fine-tune them to achieve higher accuracy on things like domain-specific vocab.
Did you notice anything different about us on X today?
Proud to announce that @modal_labs was a Day 0 Lunch Partner for the release of gpt-oss. That is, on Day 0 I got lunch with @mgoin_ of @vllm_project and then had him look at my and @shariqmobin's code to deploy the model on Modal.
Proud to announce that @modal_labs was a Day 0 Lunch Partner for the release of gpt-oss. That is, on Day 0 I got lunch with @mgoin_ of @vllm_project and then had him look at my and @shariqmobin's code to deploy the model on Modal. https://t.co/BCLmrRfq7v
the mandate of heaven is fully lost and cannot be regained
the mandate of heaven is fully lost and cannot be regained
a woman at the checkout counter told me she liked my hair because it was "a great use of my free will" little does she know that i am actually obligated to maintain this style so that people will recognize me from the Internet
The Trump administration has suspended the funding of Terence Tao and the Institute for Pure and Applied Mathematics at UCLA.
For whatever reason, @modal_labs always gets compared to "inference providers", which always confuses me? Modal was always built to be a general-purpose platform for AI/ML/data. Yes – we do inference really well! But we also do batch processing, sandboxes, training, ...
My new job is to get everyone else to see what I see in Modal: the future of data-driven computing powered by open generative models trained at the scale of the web and adapted to end-user needs by code, customization, and continual improvement. LFG. modal.com
the city of San Francisco embraces multiple novel forms of personal transportation
a cold start hates to see Modal coming 😫
a cold start hates to see Modal coming 😫
You can now cold-start vLLM in 5s on @modal_labs. GPU snapshotting is a primitive that unlocks a whole world of possibilities we're only beginning to unlock. If you're interested in working on the frontiers of what's possible with AI infra, please reach out :)
You can now cold-start vLLM in 5s on @modal_labs. GPU snapshotting is a primitive that unlocks a whole world of possibilities we're only beginning to unlock. If you're interested in working on the frontiers of what's possible with AI infra, please reach out :)
I’m soo psyched to announce this one. We have raised again! Raised the bar for AI inference. By snapshotting GPU memory, we can cold start containers running vLLM or many other things extremely fast. This will be a game changer for many customers.
I’m soo psyched to announce this one. We have raised again! Raised the bar for AI inference. By snapshotting GPU memory, we can cold start containers running vLLM or many other things extremely fast. This will be a game changer for many customers.
We just launched GPU memory snapshotting on @modal_labs in alpha. Speed up cold boots by up to 12x 😇 If you're deploying AI models, a huge amount of cold boot time comes from loading model weights into GPU memory. This makes it difficult to scale GPU resources up and down…
emily han @emilyhanyf
723 Followers 481 Following 19 yo, ai/systems + design @stanford, co-director @hackwithtrees, llm inference @modal
Alec Powell @alecpow
472 Followers 451 Following still slingin' gpus around, mostly tweeting about data infra + sports. founding gtm @modal. prev @confluentinc, @singlestoredb, @stanford.
joy liu @qjoyliu
56 Followers 85 Following
Grace @adair_grace93
312 Followers 3K Following
Srela @Srela715594
6 Followers 246 Following
Aman Swar @AmanSwar_
2 Followers 151 Following MLSys. Hacking on CUDA kernels, compilers,and LLM infra. Pushing performance
AthenaDaniel @Hfm451n02dHHq
26 Followers 1K Following
DoreenTaylor @m337Zkz1p4h7xY3
42 Followers 2K Following
SabinaSouthey @4zGaK0sjGjWIVMz
52 Followers 2K Following
Alessandro Palmas @alexpalms_
5 Followers 90 Following AI/ML Engineer Building AI Agents for Real World Applications
Frédéric Legrand @FredericTheTall
1K Followers 989 Following Giving robots brains @phospho_ai | AI, robotics, side projects bringing the latest AI technologies to everyone
クリスタルの海 @Preedal460
2 Followers 444 Following "Life is unpredictable, but good medicine and a compassionate heart never fail."
Rebeca Shanahan @RebecaShan47737
15 Followers 2K Following
Addison mcintosh @McintoshAd738
5 Followers 220 Following maybe life leaves us with cracks so we can let in more light and see a way out of the dark
Randal Lakin @LakinRanda71209
39 Followers 2K Following
sona dolasia @teenychairs
455 Followers 240 Following leading design @modal, previously @scale_ai @spotify collector of teeny chairs 🪑
Harmya @racerfunction
157 Followers 176 Following gpu enjoyer @tensarahq and prev @modal_labs, i like math, ml and guitar
Shlok Limbhare @limbizzz11
51 Followers 1K Following Machine learning, GPU kernels | Ex - VFX artist in Hollywood
Saksham @sgdescent
1K Followers 2K Following Interested in making LLMs go brrrrr x+1: MS @LTIatCMU x: LLM @Zomato x-N: https://t.co/ht5ObQh7RV & Program Synthesis with LLMs @ProseMsft
Sagar @sagar0x0
33 Followers 239 Following Making GPUs go brrr. https://t.co/k7VQuekntQ https://t.co/a8wCY6whNk || @rainference
Imani Hoppe @HoppeImani53568
88 Followers 4K Following
Saleh Hindi @SalehOfTomorrow
2K Followers 2K Following math and poetry. ex @lyft, @bloomberg, now changing healthcare with the power of my voice. DM if you want to make a new friend.
miru @miru_why
1K Followers 1K Following 3e-4x engineer, unswizzled wagmi. specialization is for warps
Charles 🎉 Frye @charles_irl
15K Followers 3K Following gpu enjoyer at @modal. he/him. ex @full_stack_dl, @weights_biases (acq. @CoreWeave), phd Berkeley @Redwood_Neuro. try https://t.co/SYWVMCazZ3
Tony Adastra @tonyadastra
175 Followers 380 Following Self-starter, Well-wisher, Tech Enthusiast | where there’s a will, there’s a way
Trey Zhong @QiZhong3
104 Followers 720 Following AI/ML @Instacart | @USC Trojan Alum | Ex-@Amazon | Angel Investor
cave_mhan @vincycode7
207 Followers 1K Following Python| Flask| Django| C| Machine Learning Engineer| Deep Learning practitioner
ZenML @zenml_io
2K Followers 2K Following Open-source pipeline framework that integrates all your ML tools. Get all your ML workflows running on any tooling stack with minimum effort.
emily han @emilyhanyf
723 Followers 481 Following 19 yo, ai/systems + design @stanford, co-director @hackwithtrees, llm inference @modal
Aleksa Gordić (水�... @gordic_aleksa
26K Followers 229 Following getting us to singularity with friends computers can be understood: https://t.co/doHE1Qv2Sj x @GoogleDeepMind @Microsoft tensor core maximalist
Jessica Livingston @jesslivingston
115K Followers 86 Following Cofounder, Y Combinator; Author, Founders at Work; Host, The Social Radars podcast.
Alec Powell @alecpow
472 Followers 451 Following still slingin' gpus around, mostly tweeting about data infra + sports. founding gtm @modal. prev @confluentinc, @singlestoredb, @stanford.
joy liu @qjoyliu
56 Followers 85 Following
Grant Sanderson @3blue1brown
414K Followers 362 Following Pi creature caretaker. Contact/faq: https://t.co/brZwdQfdif
37signals @37signals
133K Followers 13 Following Official account of the team behind Basecamp, HEY, and ONCE.
Jürgen Schmidhuber @SchmidhuberAI
165K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
brandon wang @fluorane
795 Followers 317 Following various @cartesia_ai | prev undergrad @miteecs and @mitbiology, @janestreetgroup @broadinstitute @novid
AI at Meta @AIatMeta
717K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Horace He @cHHillee
42K Followers 537 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Songlin Yang @SonglinYang4
14K Followers 3K Following research @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
thebes @voooooogel
15K Followers 900 Following "peaceful, albeit ominous" ꙮ website → https://t.co/aykxqKippW ꙮ games → https://t.co/3Pz19vHOwd ꙮ 💞💍📝 @holotopian ꙮ she/they 🏳️⚧️
San Francisco Compute @sfcompute
7K Followers 3 Following we sell very-large H100 training clusters with IB & fast disk you can buy in short-bursts (ie: 96 H100s for a week) 🇺🇸🏳️⚧️🌁
Edward Frenkel @edfrenkel
23K Followers 87 Following Mathematician, @UCBerkeley professor, author of LOVE & MATH (published in 20 languages), host of AfterMath series on YouTube, music expolorer as DJ Moonstein
SemiAnalysis @SemiAnalysis_
37K Followers 18 Following
Sabri Eyuboglu @EyubogluSabri
1K Followers 310 Following Working on language model memory. CS PhD student @Stanford working with @HazyResearch and @james_y_zou. 🪬
hazyresearch @HazyResearch
9K Followers 1K Following A research group in @StanfordAILab working on the foundations of machine learning & systems. https://t.co/JHK58TDorG Ostensibly supervised by Chris Ré
Scaling Intelligence ... @ScalingIntelLab
24 Followers 1 Following AI and Systems Laboratory in @StanfordAILab led by @Azaliamirh
DHH @dhh
564K Followers 135 Following Father of three, Creator of Ruby on Rails + Omarchy, Co-owner & CTO of 37signals, Shopify director, NYT best-selling author, and Le Mans 24h class-winner.
Alessandro Palmas @alexpalms_
5 Followers 90 Following AI/ML Engineer Building AI Agents for Real World Applications
Pablo Hansen @thepablohansen
1K Followers 259 Following Building Keystone (YC S25) https://t.co/epiYS9kQR4
Ernest Ryu @ErnestRyu
6K Followers 349 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Jason Wei @_jasonwei
98K Followers 638 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Figure @Figure_robot
145K Followers 1 Following Figure is an AI Robotics company building the world's first commercially viable autonomous humanoid robot.
Julien Chaumond @julien_c
65K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
Jordan Juravsky @jordanjuravsky
901 Followers 264 Following AI research at MSL, PhD student on leave @StanfordAILab. Proud former goose at UWaterloo.
Albert Gu @_albertgu
18K Followers 88 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
Sukjun (June) Hwang @sukjun_hwang
3K Followers 307 Following ML PhD student @mldcmu advised by @_albertgu
ptrblck @ptrblck_de
18K Followers 424 Following Deep learning and drums, @PyTorch engineer at @NVIDIA
Harmya @racerfunction
157 Followers 176 Following gpu enjoyer @tensarahq and prev @modal_labs, i like math, ml and guitar
Tri Dao @tri_dao
33K Followers 632 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
htmx.org / CEO of ifr... @htmx_org
56K Followers 294 Following high power tools for html - ʕ •ᴥ•ʔ made in montana https://t.co/P2PXnepoeI (u know u want some)
mobicham @mobicham
572 Followers 113 Following I like to shrink dem models 🤏 Co-Founder & Principal Scientist @mobius_labs PhD @inria
Saksham @sgdescent
1K Followers 2K Following Interested in making LLMs go brrrrr x+1: MS @LTIatCMU x: LLM @Zomato x-N: https://t.co/ht5ObQh7RV & Program Synthesis with LLMs @ProseMsft
Nikhil Murthy @NikhilKMurthy
200 Followers 209 Following Co-founder of Phonic | Prev: ML @ Genesis Therapeutics, CS @ MIT
Michael Goin @mgoin_
1K Followers 388 Following inference optimization @RedHat_AI building @vllm_project | you can call me misha
Moin Nadeem @moinnadeem
3K Followers 1K Following Co-Founder at @Phonic_Co. Previously @Stanford CS PhD Dropout, @MosaicML, CS @MIT. I tend to be wrong, but the learning process makes it enjoyable. 🇵🇰🇺🇲
ishan @0xishand
2K Followers 1K Following inference (dynamo) @nvidia | prev. @brevdev (acq.) @agora_io (acq.), @columbia
Charles Pierse @cdpierse
500 Followers 584 Following ML @weaviate_io | Occasional maker of things, regular breaker of things.
Rebecka Storm @rebecka_sara
40 Followers 308 Following Co-founder of @twirldata. Previously built data teams and data products at @tink and @izettle.
Eric Hansander @erichansander
235 Followers 947 Following Perpetually building Ex-founder @twirldata, sold to @modal
ThePrimeagen @ThePrimeagen
300K Followers 1K Following skill issues: 🟩⬛️⬛️⬛️⬛️⬛️(69/420) https://t.co/qWJnB6p4EP https://t.co/IwY3FTx1ZE https://t.co/TYJ6aSpwYsTrends for United States
You might like
