LMCache Lab @lmcache
🧪 Open-Source Team that maintains LMCache and Production Stack 🤖 Democratizing AI by providing efficient LLM serving for ALL lmcache.ai Github, Online Joined September 2024-
Tweets116
-
Followers653
-
Following47
-
Likes222
LMCache highlighted by CEO of Redis @rowantrollope at Redis Released SF 2025! 🎉 We’re thrilled to partner with Redis, bringing KV cache acceleration to the infra ecosystem. #Redis #LMCache #AIInfra #LLM #Caching #SFTech #RedisReleased2025 📌 PS: Our team @kobe_eee(Kobe) &…
Join us at SIGCOMM 2025(conferences.sigcomm.org/sigcomm/2025/t…) for our full-day LMCache Tutorial — an intelligent caching middleware that makes LLM inference faster & cheaper! 📅 Sept 8, 2025 8:45 AM – 6:00 PM (Portugal Time / WEST) = 12:45 AM – 10:00 AM (PDT) What you’ll learn: 🔹 KV-cache…
Had a great time at AI Infra & Agent Meetup luma.com/kzc4ang8 hosted in our foster city office! See you next time!
@lmcache in @vllm_project Singapore meetup!
🚀 Exciting to see LMCache x Mooncake being discussed at the vLLM Shanghai Meetup! The ecosystem around vLLM is evolving fast — from distributed inference to hardware optimizations — and cache innovations like this will be key to unlocking the next level of efficiency &…
🚀 Exciting to see LMCache x Mooncake being discussed at the vLLM Shanghai Meetup! The ecosystem around vLLM is evolving fast — from distributed inference to hardware optimizations — and cache innovations like this will be key to unlocking the next level of efficiency &…
Thanks to Alex @ New Port AI invite us to introduce lmcache at the Bay Area Generative AI Builders Meetup! More details here: lu.ma/5sdoeg1y
Mark your calendars! Excited for the first FastAGI meetup featuring incredible speakers on AI infra & agents 🚀 Looking forward to the discussions and energy at LMCache Lab!
Mark your calendars! Excited for the first FastAGI meetup featuring incredible speakers on AI infra & agents 🚀 Looking forward to the discussions and energy at LMCache Lab!
love how Ashutosh frames the problem, ask us any questions about kvcache!
love how Ashutosh frames the problem, ask us any questions about kvcache!
Fastest inference engine for LLMs! LMCache is an LLM serving engine that reduce Time to First Token (TTFT) and increase throughput, especially under long-context scenarios. 100% Open Source
8 KV-Cache Systems You Can’t Afford to Miss in 2025 By 2025, KV-cache has evolved from a “nice-to-have” optimization into a critical layer for high-performance large language model (LLM) serving. From GPU-resident paging tricks to persistent, cross-node cache sharing, the…
We're thrilled to share an integration between KServe and @_llm_d_, bringing powerful, scalable LLM serving to @kubernetesio. Our @RedHatAI team is integrating llm-d, a Kubernetes-native distributed inference framework, into KServe. This is all about combining the best of both…
Looking forward to seeing LMCache on stage at Cloud Native K8s AI Day! 🚀 Don’t miss the KServe Next session for cutting-edge LLM serving insights.
Looking forward to seeing LMCache on stage at Cloud Native K8s AI Day! 🚀 Don’t miss the KServe Next session for cutting-edge LLM serving insights.
CacheGen(arxiv.org/abs/2310.07240) lets you store KV caches on disk or AWS S3 and load them way faster than recomputing! Modern LLMs use long contexts, but reprocessing these every time is slow and resource-intensive. While engines like vLLM (and LMCache) can cache contexts in…
Grateful to the BentoML team for integrating LMCache — excited to help boost LLM inference together!
Grateful to the BentoML team for integrating LMCache — excited to help boost LLM inference together!
Harsh Mehta @HarshMeh1a
392 Followers 213 Following AI R&D @AnthropicAI Past: @GoogleDeepmind, Gemini
trent e @_trente_
9K Followers 3K Following Building inference mods @concordanceai former @______jpg______ @yamfinance and misc defi things
Donna @donnarupert28
257 Followers 3K Following
mingjie z @jmjzhao
71 Followers 349 Following
Anop @anopska
79 Followers 1K Following
Ethan Cole @Ethan2_13
2K Followers 305 Following Web3 Strategist | Digital Growth & Influence Architect Shaping the future of blockchain adoption & authentic communities Co-Creator of campaigns that move marke
Maor @Cooloova
51 Followers 191 Following
Shingo Omura ⎈ @everpeace
2K Followers 1K Following AI Platform Engineer @lycorp_jp || #Kubernetes Member || Previously @Woven_ToyotaJP, @PreferredNetJP @chatwork_ja. All posts are my own.
Morgan @Morganyu001
0 Followers 8 Following
!.! @xypyth
44 Followers 4K Following
Ivan P. Resendiz @Ivan_presendiz
455 Followers 3K Following Husband, father and data fan. Python learner, R friend and Julia explorer. Competition and econometrics. Economist @UNAM_mx @CIDE_mx, Data scientist @ITAM_mx
Jack brieftime @JackBrieftime
4 Followers 269 Following
大野泰弘 @yasu_oh_
469 Followers 580 Following 生成AI向けのGPUクラスタと通信キャリア向けのネットワークを提案・設計・構築してます / NTTPCコミュニケーションズ / 発言は個人の見解であり、所属する組織の公式見解ではありません
Mudit Juneja @being_mudit
423 Followers 2K Following I build (and sometimes break) things-mostly computers and talk about OSS stuff. WePlayDOS → https://t.co/0D1wbMc8BE WePlayRetro → https://t.co/V3IjpimuSR
Weihai Shen @WeihaiShen
80 Followers 237 Following CS PhD student, Stony Brook University, replication in Distributed System
Dhruv Deshmukh @DhruvDeshmukh12
1 Followers 61 Following
Abidi Jasser @AbidiJasser2
0 Followers 60 Following
StarNight Cyan @CyanStarnight
1 Followers 24 Following
Mo Malekpour @mh_malekpour
1K Followers 1K Following SWE and Graduate Research Assistant @DAIS_PolyMtl & @Mila_Quebec | former Data Analyst @Divar_Official
Gabriele Berton @gabriberton
6K Followers 1K Following Postdoc @Amazon working on VLM - ex @CarnegieMellon @PoliTOnews @IITalk
Freshmaker @freshmaker_36
59 Followers 315 Following
Bheeshma On The Compu... @DroidIsLove
62 Followers 4K Following
parameterfreak @parameterfreak
4 Followers 156 Following Thinking about model architecture and algorithms
vishal @sirsystems2
88 Followers 4K Following Interests: Information retrieval, Systems for Deep learning Experiences: IIT Kharagpur, Microsoft Turing team, UMass Amherst
Sameh Amin @sameh_m_amin
210 Followers 170 Following Father, Husband, Artificial Intelligence/ML Engineer, love reading, swimming and technology
Reku @reku_1997
1 Followers 100 Following
sharma_akash @iamSAakash
36 Followers 185 Following
U.H @0xUniHorse
591 Followers 642 Following cs @ucberkeley | ex @BuildOnCyber | Building Towards AGI https://t.co/OOgQdiqrAQ
Harshbardhan Behera @DetectConan1999
42 Followers 426 Following Software Engineer at CGI | NIT Rourkela
qi_bruce @qibruce180322
0 Followers 1 Following
Sidcapman @AnugamSiddhart1
137 Followers 252 Following Proud brother of a doctor https://t.co/DDWdqz68TO
Socio Tech @socio_tech_
132 Followers 1K Following Code, Data, Sports, Social, Meditation & Tourism.
okay @musicncode
669 Followers 2K Following Don't look back in anger. Let it all work out. Robots, software, football, shitposts and music.
Boyzzx @Realjordan0
22 Followers 827 Following
djhodurase @djhodurase76535
1 Followers 696 Following
Rowan Cheung @rowancheung
564K Followers 513 Following Founder of the world’s most read daily AI newsletter @therundownai. Sharing the latest developments in the world of artificial intelligence.
Sebastian Raschka @rasbt
355K Followers 1K Following ML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
Simon Willison @simonw
115K Followers 6K Following Creator @datasetteproj, co-creator Django. PSF board. Hangs out with @natbat. He/Him. Mastodon: https://t.co/t0MrmnJW0K Bsky: https://t.co/OnWIyhX4CH
AK @_akhaliq
425K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Tim Dettmers @Tim_Dettmers
38K Followers 991 Following Creator of bitsandbytes.Research Scientist @allen_ai and incoming professor @CarnegieMellon. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Omar Khattab @lateinteraction
24K Followers 3K Following Asst professor @MIT EECS & CSAIL (@nlp_mit). Author of https://t.co/VgyLxl0oa1 and https://t.co/ZZaSzaRaZ7 (@DSPyOSS). Prev: CS PhD @StanfordNLP. Research @Databricks.
Cyrus (Zikai) Zhou @zhou_cyrus68804
23 Followers 41 Following CS PhD @StanfordNLP @StanfordOVAL | LLM4Knowledge | AI4Medical, AI4Legal, AI4Coding | Intelligent Search | Prev: Efficient ML
Kuntai Du @this_will_echo
65 Followers 47 Following Chief Scientist | Committer of vLLM / LMCache / Production Stack
Hanchen Li @lihanc02
203 Followers 322 Following PhD student at @BerkeleySky working on AI Systems. alumni @uchicago, @lmcache
Matt Wolfe @mreflow
103K Followers 1K Following AI Tools Database: https://t.co/mmVmxk3buH AI News & Tutorials: https://t.co/vUwzYBzCxO The Next Wave Pod: https://t.co/uxC0RIm1Ws
Rohan Paul @rohanpaul_ai
83K Followers 8K Following Compiling in real-time, the race towards AGI. 🗞️ Don't miss my daily top 1% AI analysis newsletter directly to your inbox 👉 https://t.co/6LBxO8215l
Joshua Gu @astrogu_
35 Followers 98 Following CS Phd student @MIT, @MIT_CSAIL, @MITEECS👨💻| @LMCache Lab | Previous: BS @UChicago. Research on AI Systems
Artificial Analysis @ArtificialAnlys
57K Followers 543 Following Independent analysis of AI models and hosting providers - choose the best model and API provider for your use-case
Kosseila (CloudDude) ... @CloudDude_
457 Followers 537 Following Founder @cloud_thrill | Speaker | MultiCloud | local AI | Beatmaker 🎙Podcast: https://t.co/F1XZJ7ozEH
Long @lnglth
1 Followers 877 Following
clem 🤗 @ClementDelangue
155K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
cat @_catwu
39K Followers 354 Following claude code pm @anthropicai prev: @indexventures, @dagster, @scale_ai
Jerry Liu @jerryjliu0
65K Followers 1K Following co-founder/CEO @llama_index Careers: https://t.co/EUnMNmbCtx Enterprise: https://t.co/Ht5jwxSrQB
Binyuan Hui @huybery
34K Followers 649 Following 🥝 Building Qwen @Alibaba_Qwen. Focus on CodeLLM (Pre-training and Post-training) / Reasoning / Agent. Ideas my own.
Vaibhav (VB) Srivasta... @reach_vb
33K Followers 361 Following chief get-shit-done officer @huggingface | F1 fan | Here for @at_sofdog’s wisdom | *opinions my own
Laude Ventures @LaudeVentures
336 Followers 29 Following We invest in deeply technical entrepreneurs with research roots. // @andykonwinski @psonsini @krioukov @k_tighe @bradenjhancock // @LaudeInstitute
Venky @bevenky
6K Followers 3K Following Founder/CEO @plivo. Excited about everything new in AI & Robotics.
Ce Gao @gaocegege
7K Followers 786 Following Co-founder and CEO @TensorChord, building postgres-based vector extension https://t.co/7WGvl1sR56 | Father of 1 cat | Married
Mark Collier 柯理�... @sparkycollier
14K Followers 15K Following Austin Powered. Co-founder of OpenStack & OpenInfra Foundation. General Manager of AI & Infrastructure for the Linux Foundation. open source for fun & profit.
Vikram @msharmavikram
2K Followers 588 Following @NVIDIA Sr. Research Scientist | UIUC PhD All opinions and tweets are personal. Tweets about AI Inference, CUDA and GPU systems.
Zhuohan Li @zhuohan123
9K Followers 865 Following mts @ openai | cs phd @ 🌁 uc berkeley | building @vllm_project | machine learning system | the real agi is the friends we made along the way
Zhanghao Wu @Michaelvll1
1K Followers 400 Following Building SkyPilot @skypilot_org | Co-creator of Vicuna @lmsysorg, PhD @Berkeley_EECS @ucbrise. Prev: @MIT, @sjtu1896
Tiezhen WANG @Xianbao_QIAN
7K Followers 2K Following Engineer at HuggingFace, ex-Googler on TFLite / micro. Ideas are my own.
Qizheng Zhang @qizhengz_alex
264 Followers 510 Following CS PhD student @Stanford, Intern @MSFTResearch, @LMCache. Previous: BS @UChicago, @Argonne. Research on machine learning + systems.
Wey Gu 古思为 @wey_gu
13K Followers 3K Following I build things, troubleshoot & sing. GenAI Lead @NebulaGraph. Microsoft MVP. Feminist. Prev @Ericsson Cloud. Building @NowledgeLabs, @NowledgeMem at night.
Ion Stoica @istoica05
5K Followers 20 Following Professor at UC Berkeley, co-founder of Databricks, Anyscale, LMArena, Conviva.
Junchen Jiang @JunchenJiang
402 Followers 319 Following CS Prof @ UChicago https://t.co/U01oOWGnip (Fast distributed LLM inference) https://t.co/hoetjwXKIt (Best KV cache layer)
Kaichao You @KaichaoYou
4K Followers 134 Following phd student in tsinghua university, working on @vllm_project
Woosuk Kwon @woosuk_k
4K Followers 601 Following PhD student at @Berkeley_EECS building @vllm_project
Jarrod Connolly @JarrodConnolly
1K Followers 4K Following Principal Software Engineer | Conference Speaker | Politics Enthusiast | Patriot Views are my own. 🇨🇦
stephen balaban @stephenbalaban
11K Followers 2K Following Building gigawatt-scale supercomputers for AI. Co-founder and CEO of Lambda.
Ömer Çelik @omercelik
2K Followers 1K Following Sr. Engineer at Amazon & Developer of https://t.co/zR6nrVv4xt
Knebel @knebel_f
37 Followers 348 Following AI Law & Global Governance Researcher | Tech Explorer | Policy Enthusiast
Eric L. Buehler @ericlbuehler
76 Followers 197 Following
Nikola Selic @nikola_selic
290 Followers 2K Following MSc @TU_Muenchen | Research Student @CWInl TRL Lab | ML4Sys, LLMs | Ex @awscloud @FireboltHQ | https://t.co/dUe2V6in57
Jiayi Yao @yao_jiayi10223
1 Followers 6 Following
vLLM @vllm_project
17K Followers 20 Following A high-throughput and memory-efficient inference and serving engine for LLMs. Join https://t.co/lxJ0SfX5pJ to discuss together with the community!Trends for United States
You might like
