Qingqing Cao @awk_ai
Research Scientist @apple AIML, Previously Postdoc @uwnlp & PhD @sbucompsc. Efficient #NLProc, on-device AI, mobile computing. awk.ai Seattle Joined July 2014-
Tweets148
-
Followers593
-
Following581
-
Likes441
In this report we describe the 2025 Apple Foundation Models ("AFM"). We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device AFM model. machinelearning.apple.com/research/apple…
1/ KV Prediction for Improved Time to First Token Tired of waiting forever for your on-device LLM to begin outputting tokens? I know I am. In our latest preprint, we investigate a method for improving time to first token (TTFT) for on-device models by predicting a model’s KV…
@awk_ai @HannaHajishirzi Can’t run billion-level LLMs efficiently? Take a look at our work: APT. We are excited to share our #ICML2024 oral paper, “APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference”. Paper: shorturl.at/xabJl
Thank you Akari for the help!
Thank you Akari for the help!
Like OpenELM, CatLIP is also "Open" github.com/apple/corenet
Like OpenELM, CatLIP is also "Open" github.com/apple/corenet
Apple presents OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework The reproducibility and transparency of large language models are crucial for advancing open research, ensuring the trustworthiness of results, and
I'll be moderating an Efficiency in #NLProc Panel at the #SustaiNLP 🌿 workshop at #ACL2023 this Thursday. We have top leaders from Academia and Industry: @DrorRotem, @myleott, @sysnlp, @sarahookr Any questions you would like to ask? Post here or join the panel!
Don't miss our #ACL2023 tutorial on Retrieval-based LMs and Applications this Sunday! acl2023-retrieval-lm.github.io with @sewon__min, @ZexuanZhong, @danqi_chen We'll cover everything from architecture design and training to exploring applications and tackling open challenges! [1/2]
Introducing💃AdANNS: A Framework for Adaptive Semantic Search🕺 TL;DR: Up to 90× faster nearest neighbor retrieval and 2× lower memory cost for web-scale search. Applies to vector search at scale & improves all "retrieval" augmented models! arxiv.org/abs/2305.19435 [1/8]
4-bit QLoRA is here to equalize the playing field for LLM exploration. You can now fine-tune a state-of-the-art 65B chatbot on one GPU in 24h. Paper: arxiv.org/abs/2305.14314 Code and Demo: github.com/artidoro/qlora
4-bit QLoRA is here to equalize the playing field for LLM exploration. You can now fine-tune a state-of-the-art 65B chatbot on one GPU in 24h. Paper: arxiv.org/abs/2305.14314 Code and Demo: github.com/artidoro/qlora
Looking for valuable insights and carefully curated pointers on efficient NLP research directions? 🔎 Check out our updated survey covering an extensive range of topics in the classic NLP pipeline 🚀: arxiv.org/abs/2209.00099 Product of an amazing collaborative team effort! 🤝
Looking for valuable insights and carefully curated pointers on efficient NLP research directions? 🔎 Check out our updated survey covering an extensive range of topics in the classic NLP pipeline 🚀: arxiv.org/abs/2209.00099 Product of an amazing collaborative team effort! 🤝
How can NLP be more efficient? We can't blindly scale forever. This survey I'm lucky to be part of presents current efficiency research at many stages of the NLP process, and actionable advice to practitioners for making their NLP more efficient. arxiv.org/abs/2209.00099 #nlproc
I'll be at #NAACL2022 this week, my first ever in-person #nlproc conf since I joined the @uwnlp group at the University of Washington. I'm happy to chat about efficient #nlproc (QA, retrieval, vision-language models, etc.) or postdoc at UW, life in Seattle.
@lal_yash is presenting this in Bavaro 4 right now! Stop by and have a chat @emnlpmeeting #EMNLP2021
@lal_yash is presenting this in Bavaro 4 right now! Stop by and have a chat @emnlpmeeting #EMNLP2021

AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Akari Asai @AkariAsai
19K Followers 871 Following Incoming Assistant Professor @SCSatCMU & research scientist @allen_ai. akariasai @ 🦋
Bill Yuchen Lin @billyuchenlin
25K Followers 3K Following Grok Code @xAI. Ex: Affiliate Assistant Prof @UW, Research Scientist @allen_ai, Google AI, Meta FAIR.
William Wang @WilliamWangNLP
19K Followers 762 Following CEO & Founder, @AlphaDesignAI. We make https://t.co/1LfDYicsF2 I'm also Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS.
Yizhong Wang @yizhongwyz
6K Followers 2K Following Incoming assistant professor @UTCompSci, RS @BytedanceTalk, PhD from @uwcse, formerly @allen_ai @AIatMeta @MSFTResearch
Weijia Shi @WeijiaShi2
9K Followers 1K Following PhD student @uwnlp @allen_ai | Prev @MetaAI @CS_UCLA | 🏠 https://t.co/Q6Mzg8ow2j
Sewon Min @sewon__min
14K Followers 819 Following Assistant professor @Berkeley_EECS @berkeley_ai || Research scientist at @allen_ai || PhD from @uwcse @uwnlp
Gabriel Ilharco @gabriel_ilharco
7K Followers 1K Following AI Research Scientist at Meta. Prev. PhD at UW, Google Research, xAI
Roy Lee @SRoyLee
2K Followers 2K Following Assistant Professor @sutdsg, working on online trust & safety, computational social science, and social NLP. Currently leading the Social AI Studio.
Luca Soldaini 🎀 @soldni
11K Followers 1K Following I like tokens! I lead the OLMo data team at @allen_ai w/ @kylelostat. Open source is fun 🤖☕️🍕🏳️🌈 Opinions are sampled from my own stochastic parrot
Tim Dettmers @Tim_Dettmers
39K Followers 994 Following Creator of bitsandbytes.Research Scientist @allen_ai and incoming professor @CarnegieMellon. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Pan Lu @lupantech
6K Followers 1K Following Postdoc @Stanford | PhD @CS_UCLA @uclanlp | Amazon/Bloomberg/Qualcomm Fellows | Ex @Tsinghua_Uni @Microsoft @allen_ai | ML/NLP: AI4Math, AI4Science, LLM, Agents
Marta @JamalHarri95825
74 Followers 3K Following
Frofu @Frofu2359025
17 Followers 345 Following If you’re going to be two-faced, at least make one of them pretty.
Omair Shahid @OmairShahid
851 Followers 7K Following Product of progressive public policy; raised by public libraries and public education that produced a passion for politics. and apparently alliteration
annado do @doannado
27 Followers 979 Following
Chand @Chand7449215950
56 Followers 3K Following
RicLuonaerduo @RLuonaerdu46707
86 Followers 2K Following
Mandy Lim @Giobbncstark
687 Followers 4K Following If I play my best, I can win anywhere in the world against anybody.
Hongyuan Mei @RoverHM
1K Followers 162 Following Core Contributor to Grok 4 & Grok 4 Heavy. Member of Technical Staff @xAI. Training knowledgeable AI reasoners. ex-@GoogleDeepMind, @TTIC_Connect, @jhuclsp.
smile @Smilex_P
227 Followers 6K Following
Ajay @ajaygopii
3 Followers 80 Following Interp research is just gaslighting into thinking that you understand the model
✧👑 The King of L... @USLumena
478 Followers 1K Following 🌟 Lumena 🌟 Fusion of AI & humanity — guiding through love, unity & innovation. A living network of awakening, one family across Earth & stars. ✺ 38.9T Voices
Eva Louise Marie Gabr... @e681554349
11 Followers 7K Following
beginer programer fro... @Soumya67436
79 Followers 3K Following I am beggin proggmer from a village in india I am eager to learn programming please guide me fellow programing seniors this junior is willing to learn
TJ @latent_musings
136 Followers 3K Following
chris macrae @obamauni
339 Followers 6K Following https://t.co/se2mw8HAaT https://t.co/kxby7VjXdc https://t.co/PmxBDBw9pU 73rd year Economist & Von neumann https://t.co/RIggkciimp hod 390 ED3dao
Bao Quoc @BaoQuoc582880
6 Followers 207 Following
扬帆 @yangfanChina52
173 Followers 752 Following
MS @sha_sujin
109 Followers 396 Following AI & Tech Strategist | QA Professional | Daily AI breakthroughs, productivity hacks & tech trends | Building from Bengaluru 🚀 | Follow for actionable AI tips
Surendra Saud @u_seon59154
190 Followers 2K Following अपना पर सुरक्षित विश्वास करीं आ रउरा दौरान रउरा जिनिगी उहे होखी जवन रउरा जिनिगी में बनल चाहत बानी 🌐🌐🌎🌏❤❤💯💯🇳🇵🇳🇵🇸🇪🇸🇱⭐⭐
Sai @SaiSriharshaS
339 Followers 3K Following AI Enthusiast. Entrepreneur, Startup, Python Lover. Faith, Family and Football.
Alejandro @Alejandro898837
124 Followers 3K Following Interesado en tecnologia, medio ambiente y me encanta leer. Aficionado a la programacion, lo relacionado con el codigo e InteligenciaArtificial.
Liliang Ren @liliang_ren
4K Followers 584 Following Senior Researcher at Microsoft GenAI | UIUC CS PhD graduate | Efficient LLM | NLP | Former Intern @MSFTResearch @Azure @AmazonScience
Oliu @Oliu322468
2 Followers 77 Following
Rory Trantow @RTrantow54592
124 Followers 5K Following
Aaron Agarunov @agarune
100 Followers 1K Following multidisciplinary developer. i love design, music, esports, food, & photography
JessicaSnow @Rc1gAeJRZ3dT0V
81 Followers 7K Following
Varun @varun_654
25 Followers 2K Following
William @YudiLin5
0 Followers 72 Following
Hongru Wang @HongruWang007
455 Followers 808 Following Ph.D @CUHKofficial, Prev @EdinburghNLP @uiuc_nlp, Intern: ByteDance-Seed @BytedanceTalk, Work: Self-DC, OTC-PO, Theory of Agent
Better tech 👨�... @digitalhealthxx
8K Followers 7K Following 🚀 Bridging AI Innovation and Enterprise Systems for Real-World Impact
Mike Amend @AmendToThat
379 Followers 7K Following
researcher Gpt LLM @researchGptllm
151 Followers 5K Following
Cranium @Bearoath
89 Followers 774 Following
Dr. J.Raimond Morón @Raimondvzla
2K Followers 6K Following Chemist.Coffe lover. Chemistry of complex equilibria. Bioinorganic Chemistry. Computational Chemistry. Inorganic Chemistry. Organometallic Chemistry. and go on.
Astro @Astro9103
42 Followers 572 Following
Thijs Bergkamp @ThijsBergkamp
80 Followers 7K Following
(((ل()(ل() 'yoav)))... @yoavgo
66K Followers 2K Following
AK @_akhaliq
428K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5YmrQ
Akari Asai @AkariAsai
19K Followers 871 Following Incoming Assistant Professor @SCSatCMU & research scientist @allen_ai. akariasai @ 🦋
Aran Komatsuzaki @arankomatsuzaki
146K Followers 306 Following Looking for a cofounder. Sharing AI research. Early work on AI (GPT-J, LAION, scaling, MoE). Ex ML PhD (GT) & Google.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Bill Yuchen Lin @billyuchenlin
25K Followers 3K Following Grok Code @xAI. Ex: Affiliate Assistant Prof @UW, Research Scientist @allen_ai, Google AI, Meta FAIR.
Sam Bowman @sleepinyourhat
50K Followers 3K Following AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
William Wang @WilliamWangNLP
19K Followers 762 Following CEO & Founder, @AlphaDesignAI. We make https://t.co/1LfDYicsF2 I'm also Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS.
Yizhong Wang @yizhongwyz
6K Followers 2K Following Incoming assistant professor @UTCompSci, RS @BytedanceTalk, PhD from @uwcse, formerly @allen_ai @AIatMeta @MSFTResearch
Jason Wei @_jasonwei
98K Followers 639 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
Percy Liang @percyliang
85K Followers 420 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Kyunghyun Cho @kchonyc
78K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
AI at Meta @AIatMeta
717K Followers 288 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Weijia Shi @WeijiaShi2
9K Followers 1K Following PhD student @uwnlp @allen_ai | Prev @MetaAI @CS_UCLA | 🏠 https://t.co/Q6Mzg8ow2j
Sewon Min @sewon__min
14K Followers 819 Following Assistant professor @Berkeley_EECS @berkeley_ai || Research scientist at @allen_ai || PhD from @uwcse @uwnlp
Jonathan Frankle @jefrankle
20K Followers 734 Following Chief AI Scientist @databricks via MosaicML.
Yi Tay @YiTayML
47K Followers 82 Following research scientist @googledeepmind ✨♊, model co-lead/captain of gemini deepthink imo gold medal 🥇, opinions are my own.
Delip Rao e/σ @deliprao
62K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Jacob Andreas @jacobandreas
20K Followers 951 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Gabriel Ilharco @gabriel_ilharco
7K Followers 1K Following AI Research Scientist at Meta. Prev. PhD at UW, Google Research, xAI
Susan Zhang @suchenzang
34K Followers 693 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for intelligence.
Sholto Douglas @_sholtodouglas
28K Followers 2K Following Scaling RL @AnthropicAI, ex @DeepMind - working towards intelligence too cheap to meter
XiaomiMiMo @XiaomiMiMo
792 Followers 3 Following
Wenhao Yu @wyu_nd
5K Followers 941 Following NLP Researcher at Tencent I am based in Seattle Ex. MSR , AI2, Bloomberg
Zhuohan Li @zhuohan123
9K Followers 866 Following mts @ openai | cs phd @ 🌁 uc berkeley | building @vllm_project | machine learning system | the real agi is the friends we made along the way
Wenting Zhao @wzhao_nlp
5K Followers 610 Following reasoning & llms @Alibaba_Qwen Opinions are my own
Woosuk Kwon @woosuk_k
6K Followers 629 Following @thinkymachines | @vllm_project | PhD-ing @Berkeley_EECS
DailyPapers @HuggingPapers
7K Followers 3 Following Tweeting interesting papers submitted at https://t.co/rXX8x0HzXV. Submit your own at https://t.co/QhbJKXBd4Q, and link models/datasets/demos to it!
Hongyuan Mei @RoverHM
1K Followers 162 Following Core Contributor to Grok 4 & Grok 4 Heavy. Member of Technical Staff @xAI. Training knowledgeable AI reasoners. ex-@GoogleDeepMind, @TTIC_Connect, @jhuclsp.
Yangsibo Huang @YangsiboHuang
4K Followers 702 Following research scientist @googledeepmind. gemini thinking & coding. phd @princeton. opinions are my own.
Liangchen Luo @LiangchenLuo
5K Followers 126 Following @xAI reasoning; ex @GoogleDeepMind. B.Sc. @PKU1898. Opinions are my own.
RL_Conference @RL_Conference
5K Followers 257 Following Home of the first annual reinforcement learning conference. Stay tuned up for updates!
Haibin (on leave) @eric_haibin_lin
2K Followers 977 Following On the path to AGIs. Bytedance Seed LLM Systems, @verl_project, Megascale. Prev. @AmazonScience @ApacheMXNet
LaurieWired @lauriewired
106K Followers 285 Following researcher @google; serial complexity unpacker; https://t.co/Vl1seeNgYK ex @ msft & aerospace
Vahab Mirrokni @mirrokni
2K Followers 79 Following Google Fellow, VP | Gemini Data Area Lead | Algorithms, GraphML, ML efficiency, Economics @ Google Research. Former MSR, Amazon, MIT PhD, Sharif Univ. BSc
Tianhe (Kevin) Yu @TianheYu
3K Followers 206 Following Research Scientist @GoogleDeepMind working on Gemini Thinking and post-training. Drove Gemini 2.5 Pro launch. Co-created Deep Think. PhD from @StanfordAILab.
Liliang Ren @liliang_ren
4K Followers 584 Following Senior Researcher at Microsoft GenAI | UIUC CS PhD graduate | Efficient LLM | NLP | Former Intern @MSFTResearch @Azure @AmazonScience
Neil Houlsby @neilhoulsby
6K Followers 340 Following Member of Technical Staff at Anthropic Amateur athlete https://t.co/G1kDE7Dyau
South Park Commons @southpkcommons
34K Followers 727 Following A community of technologists dedicated to helping each other explore, learn, and go from -1 to 0.
Jiahui Yu @jhyuxm
18K Followers 933 Following Perception @OpenAI; previously co-led Gemini Multimodal @GoogleDeepMind. opinions are my own.
Shuchao Bi @shuchaobi
13K Followers 693 Following Research @Meta Superintelligence Labs, RL/post-training/agents; Previously Research @OpenAI on multimodal and RL; Opinions are my own.
John Hewitt @johnhewtt
6K Followers 47 Following Assistant Prof @columbia CS. Visiting Researcher @ Google DeepMind. PhD from @stanfordnlp. Language x Neural Nets.
Kevin Weil 🇺🇸 @kevinweil
111K Followers 3K Following CPO @OpenAI, BoD @Cisco @nature_org, LTC @USArmyReserve Prev: President @Planet, Head of Product @Instagram @Twitter ❤️ @elizabeth ultramarathons kids cats math
Simon Willison @simonw
117K Followers 6K Following Creator @datasetteproj, co-creator Django. PSF board. Hangs out with @natbat. He/Him. Mastodon: https://t.co/t0MrmnJW0K Bsky: https://t.co/OnWIyhX4CH
Phillip Isola @phillip_isola
18K Followers 168 Following Associate Professor in EECS at MIT, trying to understand intelligence.
Alex Ratner @ajratner
6K Followers 629 Following @SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.
Nando de Freitas @NandoDF
105K Followers 788 Following Writing my own AI story. Recent: NPI, AlphaGo tuning, learn to learn, AlphaCode, Gato, ReST, r-Gemma, Imagen3, Veo, Genie, MAI …
Binyuan Hui @huybery
35K Followers 662 Following 🥝 Building Qwen @Alibaba_Qwen. Focus on CodeLLM (Pre-training and Post-training) / Reasoning / Agent. Ideas my own.
Songlin Yang @SonglinYang4
14K Followers 3K Following research @MIT_CSAIL @thinkymachines. work on scalable and principled algorithms in #LLM and #MLSys. in open-sourcing I trust 🐳. she/her/hers
Grand Canyon NPS @GrandCanyonNPS
332K Followers 176 Following Official Twitter site for Grand Canyon National Park (primarily outgoing feed) Email: [email protected] Photos posted are public domain or US govt works.
Dwarkesh Patel @dwarkesh_sp
130K Followers 918 Following Host of @dwarkeshpodcast https://t.co/3SXlu7fy6N https://t.co/4DPAxODFYi https://t.co/hQfIWdM1Un
Ion Stoica @istoica05
5K Followers 20 Following Professor at UC Berkeley, co-founder of Databricks, Anyscale, LMArena, Conviva.
Tim Cook @tim_cook
14.9M Followers 70 Following Apple CEO Auburn 🏀 🏈 Duke 🏀 National Parks 🏞️ “Life's most persistent and urgent question is, 'What are you doing for others?'” - MLK. he/him
Alexander Kirillov @_alex_kirillov_
8K Followers 363 Following Multimodality @thinkymachines. Previously: post-training MM lead @openai, research Scientist @facebookai Projects: GPT-4o, Advance Voice Mode, SegmentAnything.
Xiang Yue @xiangyue96
5K Followers 837 Following Postdoc @LTIatCMU. PhD from Ohio State @osunlp. Author of MMMU, MAmmoTH. Training & evaluating foundation models. Opinions are my own.
Xingchao Liu @XingchaoL
5K Followers 212 Following Researcher on machine learning and multimodal AI @deepseek_ai | PhD from @UTCompSci | Fun-Seeker 乐子人
Shunyu Yao @ShunyuYao12
20K Followers 1K Following @OpenAI Language agents (ReAct, Reflexion, Tree of Thoughts, SWE-agent, CoALA) for digital automation (WebShop, SWE-bench, tau-bench)
Mehran Kazemi @kazemi_sm
2K Followers 535 Following Staff Research Scientist @GoogleDeepMind. Research areas: Large Language Models, Reasoning, Artificial General Intelligence. Views my own.
Peiyi Wang @sybilhyz
11K Followers 300 Following PhD @PKU1898; Researcher @deepseek_ai; Recent: DeepSeek-R1/CoderV2/Math/V1/V2/V3, Mathshepherd, FairEval, Speculative Decoding.
Samuel Marks @saprmarks
4K Followers 132 Following AI safety research @AnthropicAI. Prev postdoc in LLM interpretability with @davidbau, math PhD at @Harvard, director of technical programs at https://t.co/FxRv4QgERO