Dan Alistarh @DAlistarh

Professor at IST Austria people.csail.mit.edu/alistarh/ Vienna Joined May 2022

Tweets

133
Followers

1K
Following

254
Likes

73

AK @_akhaliq

2 months ago

The Geometry of LLM Quantization GPTQ as Babai's Nearest Plane Algorithm

2 9 29 8K 23

Download Image

@MatharyCharles @_albertgu And presenting a Best Poster award to "Unified Scaling Laws for Compressed Representations" by Andrei Panferov, Alexandra Volkova, @ionutmodo, Vage Egiazarian, @mher_safaryan, and @DAlistarh! Congrats!

0 3 10 769 3

Download Image

Eldar Kurtić @_EldarKurtic

3 months ago

Our flagship paper on how far careful quantization can really go in practice got accepted as an oral at ACL 2025 (top 8%)! 🥳 Turns out, old-school methods like GPTQ, SmoothQuant, and RTN are quite good when tuned properly. All of the tricks are already in LLM-Compressor!

5 29 155 12K 91

Download Image

RorroArt @rorroart_code

10 Followers 216 Following

Research Scientist @IBMResearch | Natural Language Processing, Knowledge Representation and Reasoning, Machine Learning | Guitarist, Composer

Gaetano Rossiello @tanoross

380 Followers 1K Following Research Scientist @IBMResearch | Natural Language Processing, Knowledge Representation and Reasoning, Machine Learning | Guitarist, Composer

Quantization @Quantization89

0 Followers 25 Following Quantization, graph transforms & low-bit inference | Turning big models into lean, fast ones

nourr @ummmnouur

1 Followers 98 Following living the dream

RockyParadox @RockyParadox44

127 Followers 7K Following

Corentin Lapeyre @c_lapeyre

33 Followers 339 Following Researcher engagement @ Nvidia

Cole Hunter @ColeJHunter

114 Followers 116 Following

guan tao @tao_guan72387

14 Followers 496 Following

JQ @JQ33696166

13 Followers 3K Following Foveros！！

Gregory Axler @g_axler

94 Followers 857 Following

IAteAllYourCookies @eatallcookies

58 Followers 2K Following

Adam Zweiger @AdamZweiger

955 Followers 441 Following Rethinking how language models learn | Researcher @MIT_CSAIL

Parsa Mirtaheri @parsamirta

327 Followers 1K Following PhD Student @UCSanDiego, IOI and ICPC World Finals medalist before AI won them

lv. @lumbrigaverde

32 Followers 1K Following ...

Melian @Melian15258120

3 Followers 537 Following

Flavius Burca @ethx64

56 Followers 156 Following Creator of #tech

Sriram K @ram_sharanga

2 Followers 25 Following

eigenome @eigenome

12 Followers 762 Following

Dave @TheRealPilot__

36 Followers 318 Following slicing tensors

AI Researcher at MediaTek Research | PhD from @UniPadova, prev. intern at Meta AI, Samsung AI | Graph Representation Learning | Graph Neural Networks.

Davide Buffelli @DBuffelli

182 Followers 324 Following AI Researcher at MediaTek Research | PhD from @UniPadova, prev. intern at Meta AI, Samsung AI | Graph Representation Learning | Graph Neural Networks.

Susan Zhang @suchenzang

33K Followers 661 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.

Johnathon Corcoran �... @TheKingCorcoran

3K Followers 1K Following Royal Irish blood. Viral face. We don’t crown kings. We summon them. Follow before the empire shuts the gates.

uswinmig @uswinmig

0 Followers 86 Following

Builder of large-scale ML systems; adjunct prof @ucla; ex quant derivatives trader & startup founder. Tweets on AI, tech, science, & econ.

Arun Rao @sudoraohacker

4K Followers 3K Following Builder of large-scale ML systems; adjunct prof @ucla; ex quant derivatives trader & startup founder. Tweets on AI, tech, science, & econ.

Brij Singh @brij

2K Followers 4K Following abstraction miner

Lorė @LoreG

35 Followers 438 Following

Carlo_0001 @carlo_101010_

73 Followers 5K Following

👨‍💻 Aniket Sa... @aniketS002

41 Followers 563 Following 19 | GSoC'25 @GoogleDeepMind , Breaking into tech

Vitaliy Chiley @vitaliychiley

3K Followers 1K Following LLM Reasearch @ Meta. ex @DataBricks (@DBRXMosaicAI), @CerebrasSystems

ninjalp @ninjalp32

1 Followers 2K Following rat for a while.

Yong Wu @u_yong

14 Followers 338 Following It feels like I should say something here, but I’m not sure what to say, and there’s nothing much to say anyway — so here it is.

Saket Gurukar @saket039

165 Followers 374 Following Staff Researcher at Samsung Research America.

Shreddist @shreddist

70 Followers 625 Following

Nad @Nad_5_2

2 Followers 266 Following

abhishek sharma @asreddevils

280 Followers 4K Following Waiting for Godot https://t.co/swWyQY8T0L

Itsram @itsram63

82 Followers 1K Following catastrophic calico cat!

Aritra @ariG23498

4K Followers 893 Following MLE at @huggingface 🤗

Hoàng Tùng @hoangtung386

52 Followers 573 Following "Become so good they can't ignore you" - Cal Newport

I love perfumes,mathematics,tech and philosophy
Pure Math Grad ( Silver medalist)
🎓 Upcoming PhD
🧮 Quantum+ AI + Algebraic geometry researcher
📍🇩🇪🇪🇺

Swastik Mitra @SwastikMitra890

15 Followers 367 Following I love perfumes,mathematics,tech and philosophy Pure Math Grad ( Silver medalist) 🎓 Upcoming PhD 🧮 Quantum+ AI + Algebraic geometry researcher 📍🇩🇪🇪🇺

Vinod Grover @vinodg

3K Followers 1K Following Sr Distinguished Engineer @nvidia. Compilers, CUDA C++, PL, Machine Learning and Systems. tweets and opinions are personal.

Abhas Sinha @abhas23

128 Followers 844 Following Software Developer. Sports Person. Liberal

Xu Zu @XuBing36614469

31 Followers 460 Following

et al. @basujindal

158 Followers 1K Following aspiring singer

Ankur Parikh @ankurparikh85

135 Followers 3K Following NLP Entrepreneur, Meaning Explorer, Dreamer

bandish @bandish

234 Followers 454 Following Engineer @MosaicML, I work on making DL efficient and accessible.

Paul Twohey 🇺🇦 @paultwohey

337 Followers 1K Following Trying to make the world better using technology. VP Engineering @mindbody, dad, adventurer, athlete, cook

Aashu Singh @iam_aashusingh

95 Followers 522 Following ML Engg @Facebook Alum @GeorgiaTech

Kiwi bloke. Into Cloud Computing, DevOps and Agile/Lean for a living and Philosophy for the soul. Solutions Architect at Amazon Web Services

Matt McClean @matthewmcclean

551 Followers 4K Following Kiwi bloke. Into Cloud Computing, DevOps and Agile/Lean for a living and Philosophy for the soul. Solutions Architect at Amazon Web Services

নীলাঞ্জ... @nilansarkar

16 Followers 699 Following BITS Pilani | ex AS intern @amazonscience

degen_bobo 🤖💎 @agostino90

727 Followers 5K Following

Scale ML @scaleml

701 Followers 32 Following We are interested in Scaling ML

EXO Labs @exolabs

37K Followers 2 Following AI on any device. 12 Days of EXO: https://t.co/VMrJ6Vi4h3 We're hiring: https://t.co/BzEO8ZCvBV

CTO @summerfinance_ | Angel Investor, @Atomico Angel Program | Board Advisor | Ex @AWS, @FoundersFactory, @EA #Entrepreneur #Startup #Advisor

Andrei David @AndreiDavid

1K Followers 843 Following CTO @summerfinance_ | Angel Investor, @Atomico Angel Program | Board Advisor | Ex @AWS, @FoundersFactory, @EA #Entrepreneur #Startup #Advisor

argmax @argmaxinc

4K Followers 26 Following Foundation Models On Device

Julia Turc @juliarturc

5K Followers 442 Following Explaining AI on YouTube • YC S24 Founder • Ex-Google Research • Eastern-European nihilist & American optimist

jane zhang @jjanezhang

2K Followers 776 Following living life 🎉 | agents & llm training @dbrxmosaicai @dukeu I write monthly 📝

Jinjie Ni @NiJinjie

2K Followers 523 Following AI researcher building foundation models. I'm on the job market.

Guangxuan Xiao @Guangxuan_Xiao

3K Followers 715 Following Ph.D. student at @MITEECS Prev: CS & Finance @Tsinghua_Uni

Shital Shah @sytelus

13K Followers 11K Following Mostly research and code. If universe is an optimizer, what is its loss function? All opinions are my own.

Huizi Mao @huizi_mao

164 Followers 28 Following https://t.co/k2kMxh6WeU

Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.

Eigen AI @Eigen_AI_Labs

399 Followers 23 Following Built by researchers and engineers from MIT, we are pursuing Artificial Efficient Intelligence (AEI). Try GPT-OSS support: https://t.co/BQfsnXIGFo.

You Jiacheng @YouJiacheng

8K Followers 2K Following a big fan of TileLang 关注TileLang喵！关注TileLang谢谢喵！ https://t.co/utshC0jrCO 十年老粉

Loubna Ben Allal @LoubnaBenAllal1

8K Followers 810 Following SmolLMs @huggingface

Will Manidis @WillManidis

102K Followers 4K Following in service of the long run

Alexander Wei @alexwei_

24K Followers 194 Following Reasoning @OpenAI. Co-built CICERO @MetaAI | @Berkeley_AI PhD '23 | @Harvard '20

Google Fellow, VP | Gemini Data Area Lead | Algorithms, GraphML, ML efficiency, Economics @ Google Research. Former MSR, Amazon, MIT PhD, Sharif Univ. BSc

Vahab Mirrokni @mirrokni

2K Followers 79 Following Google Fellow, VP | Gemini Data Area Lead | Algorithms, GraphML, ML efficiency, Economics @ Google Research. Former MSR, Amazon, MIT PhD, Sharif Univ. BSc

Yichen @huangyc07

64 Followers 333 Following

AI inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (150+ ⭐). Making AI faster + cheaper

Nadav Timor @NadavTimor

1K Followers 7K Following AI inference, speculative decoding, open source. Built novel decoding algorithms – default in Hugging Face Transformers (150+ ⭐). Making AI faster + cheaper

Hatice Ozen @ozenhati

6K Followers 486 Following Head of Developer Relations @GroqInc

Thien Tran @gaunernst

1K Followers 228 Following

Senior Researcher at Microsoft GenAI | UIUC CS PhD graduate | Efficient LLM | NLP | Former Intern @MSFTResearch @Azure @AmazonScience

Liliang Ren @liliang_ren

4K Followers 582 Following Senior Researcher at Microsoft GenAI | UIUC CS PhD graduate | Efficient LLM | NLP | Former Intern @MSFTResearch @Azure @AmazonScience

rohan anil @_arohan_

25K Followers 2K Following aspiring to understand deep learning

Tijmen Blankevoort @TiRune

636 Followers 200 Following

Kimi.ai @Kimi_Moonshot

53K Followers 100 Following Built by Moonshot AI to empower everyone to be superhuman.

Ethan @3thanPetersen

492 Followers 2K Following mots @DecartAI, past: @CrusoeAI, ex-defense founder, @Tesla

𝔊𝔴𝔢𝔯𝔫 @gwern

64K Followers 106 Following Internet besserwisser; pedantic, mean reply guy. 𝘞𝘢𝘵𝘢𝘴𝘩𝘪 𝘬𝘪𝘯𝘪𝘯𝘢𝘳𝘪𝘮𝘢𝘴𝘶! (Follow requests ignored due to terrible UI.)

Aidan Clark @_aidan_clark_

13K Followers 252 Following Qualitative Mathematics @OpenAI Ex: @DeepMind Hae sententiae verbaque mihi soli sunt

elie @eliebakouch

6K Followers 3K Following Training llm's (now: @huggingface)

Ben Recht @beenwrekt

32K Followers 333 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.

CEO @SophontAI |
Founder @MedARC_AI |
PhD at 19 (2023) |
ex Research Director Stability AI |
Biomed. engineer @ 14 |
TEDx talk➡https://t.co/xPxwKTq6Qb

Tanishq Mathew Abraha... @iScienceLuvr

Laude Institute @LaudeInstitute

2K Followers 29 Following Laude Institute backs computer science researchers turning research into real-world impact. // @LaudeVentures

ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days!
BTW you should go find me on another website where i post more actively

Gergely Neu @neu_rips

11K Followers 684 Following ML theory nerd & AI non-enthusiast. thinking a lot about online learning these days! BTW you should go find me on another website where i post more actively

Alex Dimakis @AlexGDimakis

21K Followers 2K Following Professor, UC berkeley | Founder @bespokelabsai |

ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

March 2nd – March 6th, 2024, Edinburgh, UK

Official hashtag this year: #ppopp24

PPoPP @PPoPPConf

254 Followers 37 Following ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming March 2nd – March 6th, 2024, Edinburgh, UK Official hashtag this year: #ppopp24

Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.

Amin Karbasi @aminkarbasi

11K Followers 3K Following Senior director of Cisco Foundation AI, Former Chief Scientist at Robust Intelligence. ex Professor at Yale University, ex staff research scientist at Google.

mobicham @mobicham

572 Followers 113 Following I like to shrink dem models 🤏 Co-Founder & Principal Scientist @mobius_labs PhD @inria

Volkan Cevher @CevherLIONS

3K Followers 656 Following Associate Professor of Electrical Engineering, EPFL. Amazon Scholar (AGI Foundations). IEEE Fellow. ELLIS Fellow.

The AI Timeline @TheAITimeline

24K Followers 1 Following covering the latest AI & LLM research /// see "highlights" for all previous weekly threads /// building the best AI paper search engine @findmypapersai

Hamed Hassani @HamedSHassani

3K Followers 804 Following Associate Professor, University of Pennsylvania @PENN, Machine Learning, Information Theory

AI, national security, China. Part of the founding team at @CSETGeorgetown (opinions my own). Author of Rising Tide on substack: https://t.co/LKAoyL00iB

Helen Toner @hlntnr

29K Followers 1K Following AI, national security, China. Part of the founding team at @CSETGeorgetown (opinions my own). Author of Rising Tide on substack: https://t.co/LKAoyL00iB

Ryan Marten @ryanmart3n

2K Followers 2K Following @bespokelabsai previously @UofIllinois @allen_ai @UofT

Han Guo @HanGuo97

3K Followers 4K Following PhD Student @MIT_CSAIL | Past: @LTIatCMU @MITIBMLab @UNCNLP, @SFResearch, @BaiduResearch | Machine Learning, NLP.

stochasm @stochasticchasm

3K Followers 1K Following pretraining @arcee_ai • 24 • opinions my own

Vitaly 🇺🇦 Feldm... @vitalyFM

4K Followers 379 Following Proving theorems about machine learning. Worried about data privacy. Research scientist at @Apple

Senior Staff Research Scientist @GoogleDeepMind & Honorary Lecturer @UCL. ex @Meta|@MSFTResearch|@NYU|@Princeton. Llama-3, Toolformer, Rainbow Teaming, MLGym.

Roberta Raileanu @robertarail

9K Followers 2K Following Senior Staff Research Scientist @GoogleDeepMind & Honorary Lecturer @UCL. ex @Meta|@MSFTResearch|@NYU|@Princeton. Llama-3, Toolformer, Rainbow Teaming, MLGym.

Benjamin F Spector @bfspector

4K Followers 181 Following stanford cs phd student. i make ml go brr.

John Schulman @johnschulman2

65K Followers 1K Following Recently started @thinkymachines. Interested in reinforcement learning, alignment, birds, jazz music

Damien Ferbach @damien_ferbach

579 Followers 195 Following PhD at @Mila_Quebec/ Previously student in Maths and theoretical Physics at @ENS_ULM

Katie Everett @_katieeverett

3K Followers 632 Following Machine learning researcher @GoogleDeepMind + PhD student @MIT. Opinions are my own.

Efficient Systems for Foundation Models Workshop, ICML2025.

Join us if you are interested in the challenges associated with large models training & inference!

ES-FoMo@ICML2025 @ESFoMo

356 Followers 37 Following Efficient Systems for Foundation Models Workshop, ICML2025. Join us if you are interested in the challenges associated with large models training & inference!

No recent Favorites. New Favorites will appear here.