Ayoub @bitsonly4

29 / backpressure not working! i mostly rant here about my skill issues. things will get better though, fast. Passau, Germany. Joined June 2025

Tweets

30
Followers

1
Following

309
Likes

535

Ayoub @bitsonly4

2 hours ago

back?

0 0 0 3 0

Ayoub @bitsonly4

2 weeks ago

no ctx

0 0 0 6 0

Download Image

Ayoub @bitsonly4

2 weeks ago

forgot that Gauss was German

0 0 0 12 0

Download Image

Ayoub @bitsonly4

3 weeks ago

i'm just dumb, always had this question, why is it called the KV cache and not QKV cache. Don't we compute a k,v, and q for each token?

0 0 0 29 0

Ayoub @bitsonly4

3 weeks ago

k2, glm-4.5, and longcat flash are all variants of V3; that's legacy!

0 0 0 47 0

Ayoub @bitsonly4

3 weeks ago

Today (08/Sep), 3 things: > details of MLA > details of RoPE > K2 Vs V3

0 0 0 13 0

Ayoub @bitsonly4

3 weeks ago

training a 1T MoE on 15T tokens without a single loss spike is craaaazy

0 0 0 17 0

Ayoub @bitsonly4

3 weeks ago

first hard leetcode solved! disjoint sets > kruskal with path compression. Boom!

0 0 1 15 0

Ayoub @bitsonly4

4 weeks ago

30 min planned on disjoint sets turned into a 4 hours marathon, but at least i earned an apology

0 0 0 10 0

Download Image

Ayoub @bitsonly4

4 weeks ago

why would @karpathy call this a `bias` and not `mask`?

0 0 0 7 0

Download Image

Ayoub @bitsonly4

4 weeks ago

mistral 7b paper is still one of my favorite papers to check when i feel rusty (after a long layoff) and lost, like now.

0 0 0 20 0

Pablo Iyu Guerrero @pabloiyu

23 Followers 164 Following AI Inference Engineer @ AlephAlpha

Colin Fraser @colin_fraser

14K Followers 783 Following AI tweet bot.

Lincoln 🇿🇦 @Presidentlin

2K Followers 525 Following History has returned. Former SA/UK bank swe. Whale watcher 🐋 Building: https://t.co/9LDKGMQCkV | https://t.co/pQcOt1jFmP

kriztalz @kriztalzmuse

49 Followers 176 Following Privacy // Networks // Learning something new everyday

noah @noahgsolomon

9K Followers 686 Following eng @fal / 22 yo / working on health monitoring ots / prev building @deepfishlol

Defender of liberty and individual rights. Resisting expansion of government while advocating for personal freedom. MERICA! 🦅🇺🇸

MERICA MEMED @Mericamemed

222K Followers 642 Following Defender of liberty and individual rights. Resisting expansion of government while advocating for personal freedom. MERICA! 🦅🇺🇸

′ @TrustFlick

14K Followers 2K Following @fcbarcelona | fan account | pvt @hansiballs

clare ❤️‍🔥 @clarejtbirch

3K Followers 987 Following thinking, doing @thinkymachines fear is the mind-killer

Jeremy Bernstein @jxbz

7K Followers 614 Following 🧪 @thinkymachines ✍️ anon feedback @ https://t.co/RIhBhjMRdD

NLP Researcher @AiEleuther. PhD @UCSanDiego Linguistics. Previously @pleiasfr @EdinburghUni. Interested in multilingual NLP, tokenizers, open science. She/her.

Catherine Arnett @linguist_cat

1K Followers 581 Following NLP Researcher @AiEleuther. PhD @UCSanDiego Linguistics. Previously @pleiasfr @EdinburghUni. Interested in multilingual NLP, tokenizers, open science. She/her.

Ying Sheng @ying11231

12K Followers 730 Following @lmsysorg @sgl_project | Prev. @xAI @Stanford | Assist Prof @UCLA. (delayed) | Do it anyway | Live to fight another day

amrit @amritwt

32K Followers 434 Following 21, engineer. hire coders: @crackeddevs.

Bram Wasti @bwasti

1K Followers 267 Following working on fast inference things with msl

Zachary DeVito @Zachary_DeVito

1K Followers 6 Following PyTorch Core Developer and researcher at FAIR. I work on Tensor programming models.

Ferdinand Mom @FerdinandMom

3K Followers 1K Following Distributed & Decentralized training @HuggingFace

Building 3D embodiment for AI agents so that they can see, understand & interact. 🏂 Platform: https://t.co/X0fdkUyZwQ 🤖 API: https://t.co/mKPn7UES2W

Meshcapade @meshcapade

7K Followers 96 Following Building 3D embodiment for AI agents so that they can see, understand & interact. 🏂 Platform: https://t.co/X0fdkUyZwQ 🤖 API: https://t.co/mKPn7UES2W

Gabriele Berton @gabriberton

7K Followers 1K Following Postdoc @Amazon working on VLM - ex @CarnegieMellon @PoliTOnews @IITalk

Passionately in love with Science, mostly Altruistic, Engineer, Amateur Astronomer & Critical thinker. Current Research focus: ▫️Mechanistic Interpretability▫️

Akanksha @akankshanc

2K Followers 739 Following Passionately in love with Science, mostly Altruistic, Engineer, Amateur Astronomer & Critical thinker. Current Research focus: ▫️Mechanistic Interpretability▫️

@Cohere's research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.

Cohere Labs @Cohere_Labs

24K Followers 251 Following @Cohere's research lab and open science initiative that seeks to solve complex machine learning problems. Join us in exploring the unknown, together.

fast ai co-founder | past: math PhD, early eng at uber, prof at USF Data Institute | now focused on the microbiome, immunology, & chronic disease

Rachel Thomas @math_rachel

93K Followers 825 Following fast ai co-founder | past: math PhD, early eng at uber, prof at USF Data Institute | now focused on the microbiome, immunology, & chronic disease

LLMs and retrieval by day and other genres of AI when I get the chance

🧪 Senior AI Eng @NVIDIAAI
🏫 @fastdotai trained DL Eng
📝 https://t.co/By87iXx5Pu

Radek Osmulski @radekosmulski

28K Followers 599 Following LLMs and retrieval by day and other genres of AI when I get the chance 🧪 Senior AI Eng @NVIDIAAI 🏫 @fastdotai trained DL Eng 📝 https://t.co/By87iXx5Pu

Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique

Julien Chaumond @julien_c

65K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique

ₕₐₘₚₜₒₙ @hamptonism

175K Followers 687 Following quantitative finance

SzymonOzog @SzymonOzog_

2K Followers 168 Following Maximizing throughput at @Aleph__Alpha Educating people about GPUs at https://t.co/81rRJ4KWK1

Working on a new terminal: Ghostty. 👻 Prev: founded @HashiCorp. Created Vagrant, Terraform, Vault, and others. Vision Jet Pilot. 👨‍✈️

Mitchell Hashimoto @mitchellh

146K Followers 141 Following Working on a new terminal: Ghostty. 👻 Prev: founded @HashiCorp. Created Vagrant, Terraform, Vault, and others. Vision Jet Pilot. 👨‍✈️

Harold Benoit @harold_matmul

478 Followers 280 Following Another day of being a researcher in theory but an engineer in practice | tech staff @LiquidAI_

Xinyu Zhou @zxytim

2K Followers 1K Following

Tongyi Lab @Ali_TongyiLab

9K Followers 20 Following We advance the development of AGI and foster open source collaboration towards a smarter future.

Daria Soboleva @dmsobol

977 Followers 622 Following Making MoE models work @Cerebras & posting about it | Creator of SlimPajama | Ex-@Google @Yandex @Cisco.

Quoc Le @quocleix

58K Followers 98 Following Google Fellow

Peter Kim @tspeterkim

29 Followers 92 Following I like being useful.

Antidepressant Conten... @depressionlesss

245K Followers 6K Following Follow for daily cute content 😺🩶 All copyrights belong to their respective owners. DM for credits/removal/submission.

Working @AWSCloud on digital transformations and cloud migrations for largest global organisations in finance industry. Tweets & opinions are my own.

didierdurand @didierdurand

416 Followers 350 Following Working @AWSCloud on digital transformations and cloud migrations for largest global organisations in finance industry. Tweets & opinions are my own.

Team member at something young.
Adjunct Prof @ McGill.
Member of Mila, Quebec AI Institute.
Stream of consciousness is my own.

🇺🇦 Dzmitry Bahd... @DBahdanau

10K Followers 37 Following Team member at something young. Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.

Jannik @jannik_stra

2K Followers 267 Following Leading Engineering @PrimeIntellect - Building open superintelligence infrastructure

vik @vikhyatk

22K Followers 796 Following teaching computers how to see @moondreamai

bycloud @bycloudai

9K Followers 712 Following I make youtube vids on cool AI research /// AI papers newsletter https://t.co/Xn7GMDbQSd /// paper recap @TheAITimeline /// building @findmypapersAI

Tianyu Liu @__tianyu

32 Followers 22 Following

Wanchao Liang @wanchao_

1K Followers 229 Following building @thinkymachines ex-PyTorch @ Meta. Author of PyTorch DTensor and TorchTitan. Opinions are my own

Graham Neubig @gneubig

40K Followers 710 Following Associate professor @LTIatCMU. Co-founder/chief scientist @allhands_ai. I mostly work on modeling language.

PhD student @LTIatCMU / @SCSatCMU, researching long context + decoding | she/her | also @ abertsch on bsky or https://t.co/L4HBUh0R9f or by email (https://t.co/bsHqwIMFPL)

Amanda Bertsch @abertsch72

2K Followers 872 Following PhD student @LTIatCMU / @SCSatCMU, researching long context + decoding | she/her | also @ abertsch on bsky or https://t.co/L4HBUh0R9f or by email (https://t.co/bsHqwIMFPL)

Sebastien Bubeck @SebastienBubeck

58K Followers 1K Following I work on AI at OpenAI. Former VP AI and Distinguished Scientist at Microsoft.

Lianmin Zheng @lm_zheng

14K Followers 618 Following Member of technical staff @xAI | Prev: Ph.D. @UCBerkeley, Co-founder @lmsysorg

CologneAIML @CologneAIML

112 Followers 27 Following

Lukas Blübaum @LukasBluebaum

11 Followers 13 Following Inference @Aleph__Alpha

Pablo Iyu Guerrero @pabloiyu

23 Followers 164 Following AI Inference Engineer @ AlephAlpha

Surya Dantuluri @sdand

13K Followers 1K Following teaching computers to use computers, prev. #1 chatgpt plugin, #1 on polymarket

Crystal @crystalsssup

13K Followers 660 Following Staff @Kimi_Moonshot prev. co-maker of ModelizeAI & gemsouls "Personality goes a long way" @UCSanDiego

Wenting Zhao @wzhao_nlp

5K Followers 607 Following reasoning & llms @Alibaba_Qwen Opinions are my own

Thinking Machines @thinkymachines

85K Followers 1 Following Thinking, beeping, and booping.

Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.

Dimitris Papailiopoul... @DimitrisPapail

20K Followers 1K Following Researcher @MSFTResearch, AI Frontiers Lab; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.

No recent Favorites. New Favorites will appear here.