Eldar Kurtić @_EldarKurtic
Principal Research Scientist @RedHat_AI & Dan Alistarh's group @ISTAustria Joined July 2018-
Tweets302
-
Followers738
-
Following628
-
Likes863
Introducing LLM.Q: Quantized LLM training in pure CUDA/C++! With LLM.Q, you can train your own LLM on consumer GPUs with natively quantized matmuls, on single workstations. No datacenter required. Inspired by @karpathy's llm.c, but natively quantized.
A control dashboard built for your LLM deployments
A control dashboard built for your LLM deployments
We're releasing the DASLab GGUF Quantization Toolkit! 🚀 First open-source toolkit bringing GPTQ + EvoPress to @ggerganov's GGUF format, enabling heterogeneous quantization based on importance. Result: Better models at the same file size. [1/5]
🚀 LLM Compressor v0.7.0 is here! This release brings powerful new features for quantizing large language models, including transform support (QuIP, SpinQuant), mixed precision compression, improved MoE handling with Llama4 support, and more. Full blog: developers.redhat.com/articles/2025/……
My recent talk at "Open Source @Siemens 2025" is now live on YouTube: youtube.com/watch?v=nu8o_v…
Apparently, we’re trending in SF as well
Apparently, we’re trending in SF as well
Let @mgoin_ show you what the de facto industry standard for running agents looks like with @vllm_project
Let @mgoin_ show you what the de facto industry standard for running agents looks like with @vllm_project
[vLLM Office Hours #29] Scaling MoE with llm-d x.com/i/broadcasts/1…
You can now find GuideLLM at its new address: github.com/vllm-project/g…
You can now find GuideLLM at its new address: github.com/vllm-project/g…
.@vllm_project office hours return next week! Alongside project updates from @mgoin_, vLLM committers and HPC experts @robertshaw21 + @tms_jr will share how to scale MoE models with llm-d and lessons from real world multi-node deployments. Register: red.ht/office-hours
FP4 models and inference kernels ready for Blackwell GPUs! GPTQ and Hadamard for accuracy, and fused Hadamard for runtime. Check out more details about our work in the thread below 👇
FP4 models and inference kernels ready for Blackwell GPUs! GPTQ and Hadamard for accuracy, and fused Hadamard for runtime. Check out more details about our work in the thread below 👇
The @huggingface folks deserve far more credit for being a pillar of open-source and still managing to push out SOTA results across the board, along with a full write-up of the entire model’s lifecycle.
The @huggingface folks deserve far more credit for being a pillar of open-source and still managing to push out SOTA results across the board, along with a full write-up of the entire model’s lifecycle.
Want to learn more about GuideLLM, the tool used by @charles_irl and @modal_labs' LLM Engine Advisor to easily benchmark LLM inference stack? Join the next vLLM office hours with @ZelenovicSasa , @mgoin_ , Jenny Yi, and @markurtz_ . More details in the thread below 👇
Want to learn more about GuideLLM, the tool used by @charles_irl and @modal_labs' LLM Engine Advisor to easily benchmark LLM inference stack? Join the next vLLM office hours with @ZelenovicSasa , @mgoin_ , Jenny Yi, and @markurtz_ . More details in the thread below 👇
The recording of @egallen's and my @PyTorch Day France 2025 and @gosimfoundation talk, "Scaling LLM Inference with vLLM," is now available on PyTorch’s YouTube channel. youtube.com/watch?v=XYh6Xf…
Red Hat team absolutely smashing it!! Integration with axolotl is huge for training
Red Hat team absolutely smashing it!! Integration with axolotl is huge for training
LLM-Compressor now integrated with Axolotl!
LLM-Compressor now integrated with Axolotl!
RockyParadox @RockyParadox44
137 Followers 7K Following
PrudenceRomeo @Jz42qk5D4eNv7
15 Followers 784 Following I am not a product of my circumstances. I am a product of my decisions.
LeilaChapman @ACeuaUMAf5UhXz1
8 Followers 500 Following
Simone @Arbiekaw824519
40 Followers 2K Following She shines not because she wants to be seen, but because she cannot help it.
Robert Scoble @Scobleizer
543K Followers 24K Following The best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
Pasha @pashakho
756 Followers 7K Following Interests: machine learning, probabilistic reasoning, tractable probabilistic models, and trust worthy AI.
Venkateshwar Kandula @V3nkateshwar
41 Followers 128 Following
BelindaFowler @iDo8pFa1pc5fQ
18 Followers 1K Following
Matthew Graham @mattyryze
85K Followers 36K Following Founding and Managing Partner, @RyzeLabs. Digital Assets, AI, and Emerging Markets. Local Insights, Global Impact.
Ilse @Tweebau6230851
41 Followers 2K Following You don’t have to play the game the way they wrote it.
Esme @Etweauive21210
50 Followers 2K Following Elegance is the only beauty that never fades. — Audrey Hepburn
Riley @5eiUY0YrWh0Sjh2
49 Followers 1K Following
Matilda @FA7Etia3j74Ph89
10 Followers 794 Following
SebastianBoo @SebastianB929
289 Followers 236 Following 🤖 Exploring open source TTS/LLMs & sometimes blogging about it. ☁️ Building GenAI applications in the cloud for work. DMs open.
flora feng @flora__feng
2 Followers 153 Following
Sky Lee @SkyLee010101010
4 Followers 98 Following
PennyStockRadar🇺�... @Armoertar109
49 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Erhouexieh @Erhouexieh4514
55 Followers 2K Following
Uibaleebead @Uibaleebead824
115 Followers 3K Following
Dan Saunders @djsaunde
497 Followers 2K Following mle making OSS LM training tools. prev @awscloud, startups, research in SF 10/21 - 10/25
Augusto Caringi @augustocaringi
195 Followers 745 Following Computer Science Professor, Software Engineer, Freethinker
Anand Kannappan @anandnk24
664 Followers 601 Following co-founder @PatronusAI. ex @Meta. prev founded quant fund (acquired in 2020). eval and RL research ⚡️
Markus Eisele @myfear
29K Followers 2K Following Something at @IBMResearch. Legal thinks you need to know that I'm speaking for myself here. I believe you knew.
Karan_shah @Karansh42896056
31 Followers 495 Following
Ofwosou @Ofwosou949
122 Followers 3K Following
369 @storn_max
312 Followers 764 Following Data with love. https://t.co/2PFRnQQmYi https://t.co/RwcpOe7DmW
Franz Musil @franz_musil
45 Followers 835 Following
Parth Vajge @prvajge
207 Followers 331 Following
Eric Tchirnhausen @tchirnhaus20039
30 Followers 5K Following Like to try new things you never know; trying to prove all software can be automated 😅 😅 😅 | ML/AI, | C++/Java/Go | GitHub : Dyl777
Rayan @AskRayan
254 Followers 990 Following Shipping super optimized AI models, endpoints and the tools to do it @PrunaAI Cofounder CEO
Walker Quigley @QuigleyWal11315
31 Followers 3K Following
Alrz_Rhm @Alrzrh97
16 Followers 123 Following Electrical Engineer (BSc) | Digital Electronics (MSc) | Specializing in Computer Vision Passionate about innovation & solving real-world problems.
Zheng | Vibe Working @zheng401
956 Followers 4K Following vibe living with AGI @Kimi fueled by caffeine, code and dream！
Colin Kealty @bartowski1182
3K Followers 160 Following LLM Enthusiast https://t.co/FadJBzEsVw https://t.co/uJHolerL9G https://t.co/9JIEKgsIMh https://t.co/lYSGzQBmuP
MythoPoetic Society @societymythos
16K Followers 3K Following Artificial unintelligence | Commander of broken AI dreams | “Trust the pipeline”
Mamading Ceesay @evangineer
3K Followers 6K Following Polymath. Doing Work That Matters (@H_O_L_O_), Enabling Thrivable Futures, Shaping Worlds, Smithing Words, Telling Stories, Playing Tabletop Games. He/Him/His.
trkdivgrad @trkdivgrad
0 Followers 127 Following
nisten🇨🇦e/acc @nisten
18K Followers 7K Following fullstack-dev democratizing intelligence Basement AGI Club 9mcp inc. ezdoesit inc. https://t.co/RjbLSpEgPE @skunkworks_ai @alignment_lab | prev @ https://t.co/68jAlAVBKR
TEDAI Vienna @TEDAIVienna
7K Followers 1K Following Join us at TEDAI, the first ever TED conference in Europe, for a deep dive into the future of Artificial Intelligence! October 17-19, 2024 | Vienna, Austria
kache @yacineMTB
196K Followers 6K Following SPONSORED BY FORMLABS - https://t.co/90QFod1lcD - get your 3d printer TODAY prev eng @ x, stripe. yacine_kv on insta I write a subscriber only blog. Subscribe!
Eight Sleep @eightsleep
61K Followers 535 Following Ultimate sleep fitness machine. Cool, heat, track, & sleep better with the Pod. Available in 🇺🇸 🇨🇦 🇬🇧 🇪🇺 🇦🇺🇦🇪🇲🇽🇨🇭🇸🇦
Markets News @MarketsDotNews
11K Followers 25 Following See the news as it happens. Stocks, options, crypto. Not financial advice. See terms for details. For fastest news and financial software: https://t.co/1l8aaJ7S5o
Claude @claudeai
140K Followers 1 Following Claude is an AI assistant built by @anthropicai to be safe, accurate, and secure. Talk to Claude on https://t.co/ZhTwG8dz3D or download the app.
Sholto Douglas @_sholtodouglas
28K Followers 2K Following Scaling RL @AnthropicAI, ex @DeepMind - working towards intelligence too cheap to meter
Rob Hallam @robj3d3
27K Followers 963 Following Shipping like a machine 🤖 while I travel the world 🌍️ 🔥 https://t.co/myyLdxVzcg - Grow faster on X ($8.2K/m) 🚀 https://t.co/5fSvUeZJ8z ($38K) 🤝 https://t.co/l4mcaViGk7 🕵 https://t.co/Cwvsl9cPsS
Philipp Singer @ph_singer
12K Followers 493 Following Senior Principal Data Scientist @h2oai | PhD in CS Top ranked Kaggle Grandmaster (Highest #1) All views are my own. https://t.co/NHdaca1Nns
ThePrimeagen @ThePrimeagen
300K Followers 1K Following skill issues: 🟩⬛️⬛️⬛️⬛️⬛️(69/420) https://t.co/qWJnB6p4EP https://t.co/IwY3FTx1ZE https://t.co/TYJ6aSpwYs
Nikita Bier @nikitabier
607K Followers 2K Following head of product @x, advisor @solana, venture partner @lightspeedvp, ex-founder @gasappteam (acq by discord), ex-founder @thetbhapp (acq by facebook)
gabriel @GabrielPeterss4
45K Followers 508 Following sora ai research at @OpenAI, previously at midjourney, swedish high school dropout
lmarena.ai @arena
95K Followers 207 Following LMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
Hongyang Zhang @hongyangzh
3K Followers 262 Following Assistant Professor in CS @UWaterloo @VectorInst. Lead the SafeAI Lab. CMU ML PhD @SCSatCMU. @PKU1898 Alumni. Proud developer of EAGLE & TRADES.
Thien Tran @gaunernst
1K Followers 229 Following
Igor Babuschkin @ibab
103K Followers 856 Following Maybe the real ASI was the friends we made along the way. Co-founder @xAI, Research & Engineering
Eigen AI @Eigen_AI_Labs
400 Followers 23 Following Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.
You Jiacheng @YouJiacheng
9K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉
AI Engineer @aiDotEngineer
31K Followers 6 Following A network of engineers enhanced by and building with AI. Organizers of the AI Engineer Summit, AI Engineer World's Fair, and AI Engineer Europe.
Ilya Sutskever's hair... @IlyasHairline
3K Followers 849 Following Follically challenged, but emotionally enriched. On my journey from forehead to backhead. #OnTheMove
Anand Kannappan @anandnk24
664 Followers 601 Following co-founder @PatronusAI. ex @Meta. prev founded quant fund (acquired in 2020). eval and RL research ⚡️
Nathan Lambert @natolambert
57K Followers 858 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Shengjia Zhao @shengjia_zhao
52K Followers 231 Following Chief Scientist @ Meta MSL. Formerly MTS @ OpenAI, PhD @ Stanford. I train models. All opinions my own.
Kimi.ai @Kimi_Moonshot
53K Followers 100 Following Built by Moonshot AI to empower everyone to be superhuman.
Kosseila (CloudDude) ... @CloudDude_
459 Followers 545 Following Founder @cloud_thrill | Speaker | MultiCloud | local AI | Beatmaker 🎙Podcast: https://t.co/F1XZJ7ozEH
Colin Kealty @bartowski1182
3K Followers 160 Following LLM Enthusiast https://t.co/FadJBzEsVw https://t.co/uJHolerL9G https://t.co/9JIEKgsIMh https://t.co/lYSGzQBmuP
LMCache Lab @lmcache
691 Followers 46 Following 🧪 Open-Source Team that maintains LMCache and Production Stack 🤖 Democratizing AI by providing efficient LLM serving for ALL
emozilla @theemozilla
7K Followers 1K Following catholic, ai researcher, co-founder/ceo of @NousResearch alignment: whatever the opposite of yudkowsky + bryan johnson is. blessed be God in all his designs.
Philipp Moritz @pcmoritz
599 Followers 5 Following Co-founder and CTO at @anyscalecompute. Co-creator of @raydistributed. Interested in ML, AI, computing.
Albert Pumarola @AlbertPumarola
1K Followers 563 Following Researcher & Manager @Meta Superintelligence Labs
POLIZEI WIEN @LPDWien
353K Followers 105 Following Offizieller Account LPD Wien. Keine Anzeigen, kein 24/7 Monitoring. Im Notfall: 133. Datenschutzerklärung und Links: https://t.co/n8nLFdJ0yN
Roy @im_roy_lee
157K Followers 2K Following ceo @cluely | kicked out of columbia, harvard, community college graduate
LMSYS Org @lmsysorg
8K Followers 180 Following Large Model Systems Organization: Join our Slack: https://t.co/mSPNyKTLTS We developed SGLang https://t.co/jEqIJcGwGA, Chatbot Arena (now @lmarena_ai), and Vicuna!
Xiaohua Zhai @XiaohuaZhai
11K Followers 311 Following Researcher at Meta (previously at OpenAI Zürich, Google DeepMind)
Laude Institute @LaudeInstitute
2K Followers 30 Following Laude Institute backs computer science researchers turning research into real-world impact. // @LaudeVentures
Tibo @tibo_maker
164K Followers 3K Following Built Tweet Hunter, Taplio (sold $8m) Growing https://t.co/OyNJ8ZUyOh - https://t.co/jS9GQJ5Ps8 - https://t.co/EFUcKeBbpU - https://t.co/JkVOl1O0S1 - https://t.co/KG9PgxJabg Sharing weekly tips about growth: https://t.co/ereQodN3Ov
Tony Dinh 🎯 @tdinh_me
168K Followers 902 Following Building software I love to use. https://t.co/p4T2vFZoJ1, https://t.co/y0Lq4RQRsu, https://t.co/KfFdieGrVf. Learn to build and learn to sell, you will be unstoppable.
Chris Wright @kernelcdub
7K Followers 271 Following Red Hat CTO. Tezos Foundation council member. Passion for open source SW innovation. Father and husband. Cyclist. Human.
PapersAnon @papers_anon
2K Followers 50 Following Just a fan of acceleration. I read and post interesting papers. Let's all make it through.
tokenbender @tokenbender
10K Followers 726 Following pretrain/RL/distributed training • eXperiments lab
SemiAnalysis @SemiAnalysis_
37K Followers 18 Following
Marc Lou @marc_louvion
207K Followers 1K Following 🧑💻 https://t.co/Y30jsaI4oH $20K/m ⚡️ https://t.co/vatLDmiHKe $12K/m 📈 https://t.co/3EDxln5U2Q $6K/m 🍜 https://t.co/r07EpGTwyA $.5K/m 🧾 https://t.co/7olaOzVGML $0/m 🛡️ https://t.co/LFgSlrZaip $0/m 🧬 https://t.co/SfrVXVtU38 $0/m +18 https://t.co/4zCWHGJWRq
Clémentine Fourrier ... @clefourrier
6K Followers 407 Following Evals @HuggingFace 🐍✨ "The future is already here, it’s just not very evenly distributed" (Gibson) Not an AGI believer, LLMs are good at form not substance
vLLM @vllm_project
19K Followers 20 Following A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community!
llm-d @_llm_d_
332 Followers 2 Following llm-d: a Kubernetes-native high-performance distributed LLM inference framework
Alma Zadić @Alma_Zadic
58K Followers 369 Following Justizsprecherin und stv. Klubobfrau bei @diegruenen • Für ein gerechtes Miteinander 💚💪🏻Trends for United States
You might like
