With the rising demand for AI model inference, optimizing these models is the key to real-world deployments.
Techniques like Pruning, Distillation, Quantization, efficient KV caching, MQA/GQA/MLA attention, speculative decoding, dynamic batching, MoE, and test-time compute…
While learning various algorithms, the visualization plays a significant role in grasping the concepts easily.
The algorithm-visualizer.org is an excellent resource with amazing collections of algorithms.
This is the best beginner-friendly course on AI agents!
AI Agents for Beginners is a 12-lesson course that will teach you everything you need to get started with building AI agents.
It's free and available on Github.
Curious about ELF: Executable and Linkable Format?
Head over to gabi.xinuos.com (It has a PDF too)
Essential for anyone working with binaries on Unix/Linux.
Matrix multiplication is not easy to understand.
Even looking at the definition used to make me sweat, let alone trying to comprehend the pattern. Yet, there is a stunningly simple explanation behind it.
Let's pull back the curtain!
"RAG is just fancy search" - a quote that aged poorly.
The next frontier isn't just about better retrieval, it's about giving your RAG systems components that actually do more with your data.
Building RAG is easy at this point, now, we need to start going beyond that and…
New in-depth blog post - "Inside vLLM: Anatomy of a High-Throughput LLM Inference System". Probably the most in depth explanation of how LLM inference engines and vLLM in particular work!
Took me a while to get this level of understanding of the codebase and then to write up…
📚 Is Parallel Programming Hard, And, If So, What Can You Do About It?
The classic "perfbook" is a comprehensive guide to practical parallel programming, associated challenges, and more, and is a foundational resource in parallel programming.
mirrors.edge.kernel.org/pub/linux/kern…
📚 Is Parallel Programming Hard, And, If So, What Can You Do About It?
The classic "perfbook" is a comprehensive guide to practical parallel programming, associated challenges, and more, and is a foundational resource in parallel programming.
mirrors.edge.kernel.org/pub/linux/kern… https://t.co/WrBO5S9lb1
🎓 MIT's Performance Engineering of Software Systems course is fantastic if you are interested in performance.
Topics include perf analysis, algorithmic techniques for high perf, instruction-level & caching optimizations, parallel programming, and more.
ocw.mit.edu/courses/6-172-…
💡 Did you know that CPU cores even have a frontend and a backend?
Frontend fetches instructions from memory to decode into micro-operations (μOPs), while backend executes them to maximize throughput.
See various processor architectures on WikiChip
en.wikichip.org/wiki/WikiChip
This paper shows how rearchitecting B+trees for SIMD brings multi-fold improvements in query throughput.
If you are keen to deep dive into SIMD, this is a highly recommended read - "A High Throughput B+tree for SIMD Architectures".
ece.lsu.edu/lpeng/papers/t…
This paper shows how rearchitecting B+trees for SIMD brings multi-fold improvements in query throughput.
If you are keen to deep dive into SIMD, this is a highly recommended read - "A High Throughput B+tree for SIMD Architectures".
ece.lsu.edu/lpeng/papers/t… https://t.co/ZUsO7sIXaJ
1K Followers 3K FollowingAWS Cloud Trainer | AWS Community Builder | Ph.D. scholar @TIETofficial | tweet about programming, Data structure, ML & my experiments with life n work!
70 Followers 813 FollowingI'm honest caring and open minded...I'm a woman of God with a good heart I love the word of God I love to read the word of God
589 Followers 95 FollowingSoftware, C++, Communities, Microsoft MVP.
I just make the pie bigger so that everyone gets a slice.
💪 Leading @italiancpp, @coding_gym, and @ml_modena
266 Followers 213 FollowingPrincipal Research Scientist@NVIDIA https://t.co/tNX1USGsr8 https://t.co/i04ibv0cut https://t.co/qLg0w6SGDH
Opinions are my own
10K Followers 48 FollowingAn open-source declarative framework for building modular AI software. Programming—not prompting—LLMs via higher-level abstractions & optimizers.
43K Followers 206 FollowingDysfunctional Programming account #1. Senior SWE at Bloomberg. I write C++ for money. ex-Haskell, ex-OCaml. All opinions are my own.
205K Followers 5K FollowingVC at @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.
9K Followers 518 Following20+ yrs of building browsers • chromium, webkit contributor • ♡ compilers, systems, languages • eng @browsercompany • views are personal
14K Followers 179 FollowingInterested in programming, electronics, mechanics, and hand drawing.
blog: https://t.co/O70YitimtH
backup: https://t.co/Fu5pufJ3fw
17K Followers 128 FollowingSpecializing in solving complex software challenges, with deep expertise in TCP and MySQL kernels, and a strong passion for AI, history, math, and physics.
204K Followers 25 FollowingManus is the general AI agent that bridges minds and actions: it doesn't just think, it delivers results. Download our app: https://t.co/XSfjRhjdgo
29K Followers 431 FollowingProfessor, CS, U. British Columbia. CIFAR AI Chair, Vector Institute. Sr. Advisor, DeepMind | ML, AI, deep RL, deep learning, AI-Generating Algorithms (AI-GAs)
5K Followers 3K FollowingFind me on Mastodon/Bsky. ~~Compilers @Igalia. @llvmweekly author. Previously: @lowRISC CTO and co-founder, researcher at UCambridge~~
80K Followers 1 FollowingDemocratizing AI research, education, and technologies. Learn how to build with AI in our new AI Academy: https://t.co/zQXQt0Pem8
165K Followers 2K FollowingGoogle Whistleblower via James O'Keefe . Disclosed Google's "Machine Learning Fairness", the AI system that censors and controls your access to information.
2K Followers 1K FollowingAssociate Professor, Department of Computer Science @CSAalto, @AaltoUniversity. Research interests: theory of distributed and parallel computing.
3K Followers 674 FollowingWe conduct world-class research on computer science and design innovations at @AaltoUniversity. Meet our people & read more about our work at https://t.co/w8TwAd9FiM.
3K Followers 7 FollowingOfficial account of the Polymathic Engineer newsletter, written by @franc0fernand0. Algorithms, distributed systems, and software engineering. Subscribe here:
9K Followers 2 FollowingLevel up your engineering & system design skills.
Complex topics simplified.
Thank you to our partner @getpostman who keep our content free to the community
No recent Favorites. New Favorites will appear here.