New in-depth blog post - "Inside vLLM: Anatomy of a High-Throughput LLM Inference System". Probably the most in depth explanation of how LLM inference engines and vLLM in particular work!
Took me a while to get this level of understanding of the codebase and then to write up…
You cannot force highly skilled people to work a set number of hours. They will just pretend to which is easy to do. They’ll read Reddit, make easy tasks stretch in time, have a longer lunch, longer meetings, etc. The only way I’ve seen or experienced seeing people work a lot of…
The course reminds me that you can just ✨ do things ✨
So if you’re ever not sure if something will work, on the edge of trying that thing, or taking a bet on yourself, just do the thing. Worst case you have fun and probably learn a thing or two
thread of youtube channels that are underrated. not necessarily small, but underrated
1. alphaphoenix. really deepened my understanding of electrodynamics. by far the biggest channel on this list with nearly 600k subscribers
The only way I’ve ever built real confidence was by doing hard things.
Not by thinking about them. Not by waiting to feel ready.
Just by showing up, doing the thing, and realizing I could handle more than I thought.
I'm writing up a blog post about Markdown streaming, because I think it is an interesting topic.
I reckon there will be almost a dozen people who agree with me!
I’m slowly beginning to accept that my productivity, when working with AI coding agents, is limited by my human brain.
AI can do many tasks in parallel, but I can only track the context of a few, so I only run a few tasks at a time.
I am the bottleneck.
tried ds*y again for another project. I can understand why people like it; instead of writing free-form system and user prompts and templates, you can write code and just rely on it. this part makes sense (though I think there's extra juice in customizing templates)
however, ...
can't agree more, seen first hand, how complex doc processing can get. Building a generalizable doc processing is 90% of the job in document search applications.
can't agree more, seen first hand, how complex doc processing can get. Building a generalizable doc processing is 90% of the job in document search applications.
I’ve always disliked how introverted and reserved I am. Back in school, I never aimed to be first—I just wanted to stay near the top to prove I wasn’t bad.
But I’ve realized the world can be brutal. If you quietly stay a nobody, your voice often goes unheard.
Recently, I saw…
@robertnishihara Search for AI agents is one of my favorite problems to work on and think about. It really pushes you to think beyond the basics of context engineering.
50K Followers 5K FollowingCofounder and Head of Post Training @NousResearch, prev @StabilityAI
Github: https://t.co/LZwHTUFwPq
HuggingFace: https://t.co/sN2FFU8PVE
1 Followers 3K Followingproud Hindu 🇮🇳. Modi bhakt. Die-hard Kohli fan. allergic to woke people. RT/likes/personal-views do NOT mean I endorse them. (read last sentence again)
1K Followers 567 Following❤️ @nimishasureka01. Views mine. ✍️ AI, LLMs, Security. Principal Applied Scientist @NetApp 💻. Led ML for security teams @Microsoft. 🏎 addict.
9K Followers 657 Following18, building @localhosthq • grants & capital @evm_capital • building software that you'll love • side-questing @mochadotemail
19K Followers 3K FollowingMostly posting about robots.
currently AI @agilityrobotics
prev embodied AI @AIatMeta, @NVIDIAAI. All views my own.
writing: https://t.co/iNLA4djfZo
30K Followers 500 FollowingI simplify System Design, and System Design will make you a better Software Engineer.
System Design • Databases • Algorithms • AI Enthusiast
1K Followers 445 FollowingEmpowering early-stage engineering teams to confidently launch AI users love, permanently ditching those 3 AM production fire alarms.