LMCache Lab @lmcache
🧪 Open-Source Team that maintains LMCache and Production Stack 🤖 Democratizing AI by providing efficient LLM serving for ALL lmcache.ai Github, Online Joined September 2024-
Tweets134
-
Followers683
-
Following46
-
Likes236
Wow… LLMs can now get insane speed & memory boosts. This open-source trick makes any large language model faster than you thought possible... LMCache caches and reuses key-value data across instances and hardware, so your AI: – Remembers context – Handles multi-round Q&A…
The fastest serving engine for LLMs is here (open-source)! LMCache is an LLM serving engine designed to reduce time-to-first-token and increase throughput, especially under long-context scenarios. It boosts vLLM with 7x faster access to 100x more KV caches. 100% open-source!
I got deep respect for niche open source project in AI. you gotta have deep expertise and a good heart to run those. kuddos to teams like LMCache on keeping the open source dream alive ❤️
Fastest inference engine for LLMs! LMCache is an LLM serving engine that reduce Time to First Token (TTFT) and increase throughput, especially under long-context scenarios. 100% Open Source
LLM responses don’t have to be so slow. Spending minutes just to get a basic answer. Meet LMCache , an open source KV cache layer that reduces time-to-first-token and boosts throughput for long context chat, RAG and doc QA. - Reuses KV across GPU/CPU/Disk → skips redundant…
This is an interesting open‑source repo. LMCache makes LLM serving more efficient by reusing KV caches across GPU, CPU memory, and disk. - Works well for long contexts - 3–10× faster responses in RAG and multi‑turn workloads
This is an interesting open‑source repo. LMCache makes LLM serving more efficient by reusing KV caches across GPU, CPU memory, and disk. - Works well for long contexts - 3–10× faster responses in RAG and multi‑turn workloads https://t.co/rMKebIwW5L
Extending LMCache Backends: A Comprehensive Guide to Custom Backend Development blog.lmcache.ai/2025-09-11-ext…
thanks for the kind words!
thanks for the kind words!
Not satisfied with your AI's ability to process long documents? LLMs do not need to take forever. With LMCache you can reduce time to first token by up to 15x through our state of the art KV Cache management, saving crucial time and money. Try us here: github.com/LMCache/LMCache
Missed our tutorial at SIGCOMM 2025? The full recording is now available! Watch the session here: youtu.be/nem6UXZIILg?si… #SIGCOMM #SIGCOMM2025 #LMCache
Missed our tutorial at SIGCOMM 2025? The full recording is now available! Watch the session here: youtu.be/nem6UXZIILg?si… #SIGCOMM #SIGCOMM2025 #LMCache
Just got the tickets. Meet our team [Oct 6(2025)] in SF!
Just got the tickets. Meet our team [Oct 6(2025)] in SF!
Join us at SIGCOMM 2025(conferences.sigcomm.org/sigcomm/2025/t…) for our full-day LMCache Tutorial — an intelligent caching middleware that makes LLM inference faster & cheaper! 📅 Sept 8, 2025 8:45 AM – 6:00 PM (Portugal Time / WEST) = 12:45 AM – 10:00 AM (PDT) What you’ll learn: 🔹 KV-cache…
Had a great time at AI Infra & Agent Meetup luma.com/kzc4ang8 hosted in our foster city office! See you next time!
Nithin R @NithinRajan00
1 Followers 9 Following
Josh Wong @wongifeng
6 Followers 227 Following
Amir Sadoughi @princehonest
221 Followers 587 Following
Kelly Buchanan @ekellbuch
1K Followers 2K Following Making AI reliable for humans. Postdoctoral Fellow @Stanford with @HazyResearch and @Scott_linderman. PhD @Columbia @ZuckermanBrain. Industry: @GoogleAI.
GhostMKC👻 AKA Ｍ�... @K3yKur0n0
585 Followers 3K Following Black Man | Hacker | Activist | LoFi | Mind Wanderer! | Blogger | Psychonaut | $Programmer | 💯% Black Thought | Ａｎｉｍｅ 幽霊 Ａｆｉｃｉｏｎａｄｏ| Security Researcher🕵️🔎
Manuel de Prada @manudeprada
366 Followers 1K Following ML intern @ Hugging Face 🤗. nlp research. gústanme as maquinitas. galego. master cs @ eth.
城陽人 @minamijoyo
949 Followers 658 Following 本と缶コーヒーを愛するWeb系インフラ園児にゃー。空気か水になりたい。 ※つぶやきは個人の見解であり、所属する組織を代表するものではありません。
Hsiang Yu Tsou @xxrjun
1 Followers 130 Following
Shrey Bansal @Shrey2091
0 Followers 8 Following
郑雨昕 @zhngyxn919952
0 Followers 34 Following
alluri @sid_alluri
119 Followers 95 Following research and engineering @ritualnet, prev: cs grad @uiuc
Daniil Larionov @Rexhaif
133 Followers 1K Following #NLProc | PhD @ Uni Mannheim | LLMs + Evaluations + Efficiency
David Edelsohn @rhy0lite
188 Followers 310 Following Heterodox Systems Thinker. Everything in moderation. I solve problems before they become problems. My tweets, my own opinions.
AI Breakfast @AiBreakfast
218K Followers 425 Following The latest rumors and developments in the world of artificial intelligence. DM to include your AI project in the newsletter.
chengjilai @chengjilai
26 Followers 966 Following
Çağla Kaymaz @caglakaymaz
311 Followers 786 Following Partner at @Category_VC investing in enterprise software. Previously @Microsoft, @CitiVentures, @Stanford CS, @HarvardHBS. Outdoor enthusiast.
Juanma @juanmaJMRS
372 Followers 760 Following Building MVPs & Fractional CTO at @deepbluecoding | Building in public | $40k+ rev
nixpiper @nixpiper
61 Followers 2K Following
xymox @clxymox
284 Followers 524 Following Sysadmin & Dev | Codeur open-source : IA, réseaux, VPN | Passionné par l’automatisation et les techs de pointe.
林瑋晟 @410011max
7 Followers 16 Following
James Alcorn @JamesAlcorn94
1K Followers 2K Following AI/infra at Lightspeed. Prev Zetta VC, Spectrum Equity, UCBerkeley 🇦🇺 🇺🇸
Nitin Francis @NitinFranc70276
33 Followers 238 Following
Ifta Khairul Alam Adi... @AdilIfta77556
2 Followers 89 Following
Harsh Mehta @HarshMeh1a
388 Followers 219 Following AI R&D @AnthropicAI Past: @GoogleDeepmind, Gemini
trent e @_trente_
9K Followers 3K Following Building inference mods @concordanceai former @______jpg______ @yamfinance and misc defi things
Donna @donnarupert28
258 Followers 3K Following
mingjie z @jmjzhao
72 Followers 352 Following
Anop @anopska
106 Followers 1K Following
Maor @Cooloova
54 Followers 193 Following
Shingo Omura ⎈ @everpeace
2K Followers 1K Following AI Platform Engineer @lycorp_jp || #Kubernetes Member || Previously @Woven_ToyotaJP, @PreferredNetJP @chatwork_ja. All posts are my own.
Morgan @Morganyu001
0 Followers 8 Following
!.! @xypyth
57 Followers 5K Following
Ivan P. Resendiz @Ivan_presendiz
456 Followers 3K Following Husband, father and data fan. Python learner, R friend and Julia explorer. Competition and econometrics. Economist @UNAM_mx @CIDE_mx, Data scientist @ITAM_mx
Jack brieftime @JackBrieftime
5 Followers 269 Following
大野泰弘 @yasu_oh_
468 Followers 602 Following 生成AI向けのGPUクラスタと通信キャリア向けのネットワークを提案・設計・構築してます / NTTPCコミュニケーションズ / 元高専生 / 発言は個人の見解であり、所属する組織の公式見解ではありません
Rowan Cheung @rowancheung
566K Followers 515 Following Founder of the world’s most read daily AI newsletter @therundownai. Sharing the latest developments in the world of artificial intelligence.
Sebastian Raschka @rasbt
358K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
Simon Willison @simonw
117K Followers 6K Following Creator @datasetteproj, co-creator Django. PSF board. Hangs out with @natbat. He/Him. Mastodon: https://t.co/t0MrmnJW0K Bsky: https://t.co/OnWIyhX4CH
AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Tim Dettmers @Tim_Dettmers
39K Followers 994 Following Creator of bitsandbytes.Research Scientist @allen_ai and incoming professor @CarnegieMellon. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Omar Khattab @lateinteraction
25K Followers 3K Following Asst professor @MIT EECS & CSAIL (@nlp_mit). Author of https://t.co/VgyLxl0oa1 and https://t.co/ZZaSzaRaZ7 (@DSPyOSS). Prev: CS PhD @StanfordNLP. Research @Databricks.
Cyrus (Zikai) Zhou @zhou_cyrus68804
27 Followers 43 Following CS PhD @StanfordNLP @StanfordOVAL | LLM4Knowledge | AI4Medical, AI4Legal, AI4Coding | Intelligent Search | Prev: Efficient ML
Kuntai Du @this_will_echo
68 Followers 48 Following Chief Scientist | Committer of vLLM / LMCache / Production Stack
Hanchen Li @lihanc02
210 Followers 326 Following PhD student at @BerkeleySky working on AI Systems. alumni @uchicago, @lmcache
Matt Wolfe @mreflow
104K Followers 1K Following AI Tools Database: https://t.co/mmVmxk3buH AI News & Tutorials: https://t.co/vUwzYBzCxO The Next Wave Pod: https://t.co/uxC0RIm1Ws
Rohan Paul @rohanpaul_ai
97K Followers 8K Following Compiling in real-time, the race towards AGI. The Largest Show on X for AI. 🗞️ Get my daily AI analysis newsletter to your email 👉 https://t.co/6LBxO8215l
Joshua Gu @astrogu_
35 Followers 99 Following CS Phd student @MIT, @MIT_CSAIL, @MITEECS👨💻| @LMCache Lab | Previous: BS @UChicago. Research on AI Systems
Artificial Analysis @ArtificialAnlys
60K Followers 567 Following Independent analysis of AI models and hosting providers - choose the best model and API provider for your use-case
Kosseila (CloudDude) ... @CloudDude_
459 Followers 545 Following Founder @cloud_thrill | Speaker | MultiCloud | local AI | Beatmaker 🎙Podcast: https://t.co/F1XZJ7ozEH
clem 🤗 @ClementDelangue
157K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
cat @_catwu
40K Followers 357 Following claude code pm @anthropicai prev: @indexventures, @dagster, @scale_ai
Jerry Liu @jerryjliu0
66K Followers 1K Following co-founder/CEO @llama_index Careers: https://t.co/EUnMNmbCtx Enterprise: https://t.co/Ht5jwxSrQB
Binyuan Hui @huybery
35K Followers 662 Following 🥝 Building Qwen @Alibaba_Qwen. Focus on CodeLLM (Pre-training and Post-training) / Reasoning / Agent. Ideas my own.
Vaibhav (VB) Srivasta... @reach_vb
33K Followers 371 Following chief get-shit-done officer @huggingface | F1 fan | Here for @at_sofdog’s wisdom | *opinions my own
Laude Ventures @LaudeVentures
344 Followers 29 Following We invest in deeply technical entrepreneurs with research roots. // @andykonwinski @psonsini @krioukov @k_tighe @bradenjhancock // @LaudeInstitute
Venky @bevenky
6K Followers 3K Following Founder/CEO @plivo. Excited about everything new in AI & Robotics.
Ce Gao @gaocegege
7K Followers 788 Following Co-founder and CEO @TensorChord, building postgres-based vector extension https://t.co/7WGvl1sR56 | Father of 1 cat | Married
Mark Collier 柯理�... @sparkycollier
14K Followers 15K Following Austin Powered. Co-founder of OpenStack & OpenInfra Foundation. General Manager of AI & Infrastructure for the Linux Foundation. open source for fun & profit.
Vikram @msharmavikram
2K Followers 593 Following @NVIDIA Sr. Research Scientist | UIUC PhD All opinions and tweets are personal. Tweets about AI Inference, CUDA and GPU systems.
Zhuohan Li @zhuohan123
9K Followers 866 Following mts @ openai | cs phd @ 🌁 uc berkeley | building @vllm_project | machine learning system | the real agi is the friends we made along the way
Zhanghao Wu @Michaelvll1
1K Followers 401 Following Building SkyPilot @skypilot_org | Co-creator of Vicuna @lmsysorg, PhD @Berkeley_EECS @ucbrise. Prev: @MIT, @sjtu1896
Tiezhen WANG @Xianbao_QIAN
7K Followers 2K Following Engineer at HuggingFace, ex-Googler on TFLite / micro. Ideas are my own.
Qizheng Zhang @qizhengz_alex
280 Followers 524 Following CS PhD student @Stanford, @LMCache. Previous: @MSFTResearch, @UChicago, @Argonne. Research on machine learning + systems.
Wey Gu 古思为 @wey_gu
13K Followers 4K Following Build things, troubleshoot& sing. Co-Founder @NowledgeLabs, build @NowledgeMem& https://t.co/RVZI2oX9pr Microsoft MVP. Feminist. Prev @NebulaGraph, @Ericsson Cloud
Ion Stoica @istoica05
5K Followers 20 Following Professor at UC Berkeley, co-founder of Databricks, Anyscale, LMArena, Conviva.
Junchen Jiang @JunchenJiang
413 Followers 319 Following CS Prof @ UChicago https://t.co/U01oOWGnip (Fast distributed LLM inference) https://t.co/hoetjwXKIt (Best KV cache layer)
Kaichao You @KaichaoYou
4K Followers 134 Following phd student in tsinghua university, working on @vllm_project
Woosuk Kwon @woosuk_k
6K Followers 627 Following @thinkymachines | @vllm_project | PhD-ing @Berkeley_EECS
Jarrod Connolly @JarrodConnolly
1K Followers 4K Following Principal Software Engineer Views are my own. 🇨🇦
stephen balaban @stephenbalaban
11K Followers 2K Following Building gigawatt-scale supercomputers for AI. Co-founder and CEO of Lambda.
Ömer Çelik @omercelik
2K Followers 1K Following Sr. Engineer at Amazon & Developer of https://t.co/zR6nrVv4xt
Knebel @knebel_f
42 Followers 350 Following AI Law & Global Governance Researcher | Tech Explorer | Policy Enthusiast
Eric L. Buehler @ericlbuehler
78 Followers 204 Following
Nikola Selic @nikola_selic
299 Followers 2K Following MSc @TU_Muenchen | Research Student @CWInl TRL Lab | ML4Sys, LLMs | Ex @awscloud @FireboltHQ | https://t.co/dUe2V6in57
Jiayi Yao @yao_jiayi10223
1 Followers 6 Following
vLLM @vllm_project
19K Followers 20 Following A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community!Trends for United States
You might like
