Yong Jae Lee @yong_jae_lee
Professor, Computer Sciences, UW-Madison. I am a computer vision and machine learning researcher. cs.wisc.edu/~yongjaelee/ Madison, WI Joined April 2018-
Tweets94
-
Followers973
-
Following125
-
Likes338
My students called the new CDIS building “state-of-the-art”. I thought they were exaggerating. Today I moved in and saw it for myself. Wow. Photos cannot capture the beauty of the design.
#ICCV2025 Introducing X-Fusion: Introducing New Modality to Frozen Large Language Models It is a novel framework that adapts pretrained LLMs (e.g., LLaMA) to new modalities (e.g., vision) while retaining their language capabilities and world knowledge! (1/n) Project Page:…
LLaVA-Prumerge, the first work of Visual Token Reduction for MLLM, finally got accepted after being cited 146 times since last year. Congrats to the team! @yuzhang_shang @yong_jae_lee See how to do MLLM inference much cheaper while holding performance. llava-prumerge.github.io
LLaVA-Prumerge, the first work of Visual Token Reduction for MLLM, finally got accepted after being cited 146 times since last year. Congrats to the team! @yuzhang_shang @yong_jae_lee See how to do MLLM inference much cheaper while holding performance. llava-prumerge.github.io https://t.co/TQa9BThm1P
Training text-to-image models? Want your models to represent cultures across the globe but don't know how to systematically evaluate them? Introducing ⚕️CuRe⚕️ a new benchmark and scoring suite for cultural representativeness through the lens of information gain (1/10)
Thank you @_akhaliq for sharing our work!
Congratulations Dr. Mu Cai @MuCai7! Mu is my 8th PhD student and first to start in my group at UW–Madison after my move a few years ago. He made a number of important contributions in multimodal models during his PhD, and recently joined Google DeepMind. I will miss you a lot Mu!
🚀 Excited to announce our 4th Workshop on Computer Vision in the Wild (CVinW) at @CVPR 2025! 🔗 computer-vision-in-the-wild.github.io/cvpr-2025/ ⭐We have invinted a great lineup of speakers: Prof. Kaiming He, Prof. @BoqingGo, Prof. @CordeliaSchmid, Prof. @RanjayKrishna, Prof. @sainingxie, Prof.…
Public service announcement: Multimodal LLMs are really bad at understanding images with *precision*. x.com/lukeprog/statu… A thread🧵: 1/13.
Public service announcement: Multimodal LLMs are really bad at understanding images with *precision*. x.com/lukeprog/statu… A thread🧵: 1/13.
Check out our new ICLR 2025 paper, LLaRA, which transforms a pretrained vision-language model into a robot vision-language-action policy! Joint work with @XiangLi54505720, @ryoo_michael, et al from Stony Brook U, and @MuCai7. github.com/LostXine/LLaRA
Check out our new ICLR 2025 paper, LLaRA, which transforms a pretrained vision-language model into a robot vision-language-action policy! Joint work with @XiangLi54505720, @ryoo_michael, et al from Stony Brook U, and @MuCai7. github.com/LostXine/LLaRA
🔥Poster: Fri 13 Dec 4:30 pm - 7:30 pm PST (West) It is the first time for me try to sell a new concept that I believe but not in trend. I truely trust the language between llm/lmms are embeddings, and interfacing with embeddings is essential in future! Welcome everyone to come😀
📢Come to join our 1st Workshop on Video-Langauge Models at #NeurIPS 2024. We have seen a great progress on image-language models, now it is time for Videos! Our invited speakers will talk more about how we further move forward! …and-language-workshop-2024.webflow.io Special invited talks…
📢Come to join our 1st Workshop on Video-Langauge Models at #NeurIPS 2024. We have seen a great progress on image-language models, now it is time for Videos! Our invited speakers will talk more about how we further move forward! …and-language-workshop-2024.webflow.io Special invited talks… https://t.co/iN5NqOYf76
🚨 I’ll be at #NeurIPS2024! 🚨On the industry job market this year and eager to connect in person! 🔍 My research explores multimodal learning, with a focus on object-level understanding and video understanding. 📜 3 papers at NeurIPS 2024: Workshop on Video-Language Models 📅…
I am not in #EMNLP2024 but @bochengzou is in Florida! Go checkout vector graphics, a promising format that is completely different from pixels for visual representation. Thanks to LLMs, vector graphics are more powerful now! Go chat with @bochengzou if you are interested!
I am not in #EMNLP2024 but @bochengzou is in Florida! Go checkout vector graphics, a promising format that is completely different from pixels for visual representation. Thanks to LLMs, vector graphics are more powerful now! Go chat with @bochengzou if you are interested!

AI Interfaces @ai_interfaces
72 Followers 505 Following Aiii, is making AI seamless. FliezEye AI is the premier home intelligence system , and Holy is the multi modal orchestration engine
Gpbhupinder @gpbhupinder
470 Followers 7K Following 👨💻 Full-Stack Developer & AI Integration Expert 🚀 From concept to launch, we bring your tech vision to life
Naman Rastogi @Stardust_nds
20 Followers 277 Following Research @synclabs_so | Controllable Generative Models, Multimodal Learning and 3D Vision
Muhammad Ovais Yusuf @movaisyusuf
1 Followers 45 Following I make your AI/ML research 50x better | 12+ Publications | MS CS @ BSU | Breaking down research clarity, baselines & experiments
Saber Darabi @SADarabi
310 Followers 7K Following
Arcuvo @Arcuvo3165
32 Followers 1K Following
Ierhonal @Ierhonal7844
14 Followers 1K Following
S-I-Z-Z-L-E Tech!!! @SizzleTechUSA
28 Followers 117 Following S-I-Z-Z-L-E Tech!!!™ & AI PhD…Seminal technology for the future of mankind, more pervasive than “F-I-R-E”!!!
Pranav Pawar @KagglePawar
5 Followers 139 Following AI Researcher | Evolution is a mystery, Clock makes a fool of history |
Tufo @Tufo3471
41 Followers 1K Following
Minhajur Rahman Chowd... @MinhajurC
1 Followers 61 Following
Srinivasa Raghavan @imsraghavan
294 Followers 7K Following A constant in the world of variables நன்றே வருவதெல்லாம் நமக்குப் பரமொன்றிலதே!
Suji Kim @suji_kim__
1 Followers 30 Following
Doaldie @Doaldie849
9 Followers 738 Following
Avi @Being_Avinav
88 Followers 698 Following Turning ideas into reality 🔁 | Human Perception | Ex NYU Courant & Center for Data Science, CTO @ Youth HealthTech, Google AR/VR, Samsung Research
Li Sheng /listen/ spe... @cs_lisheng
638 Followers 6K Following ◆2025 new faculty of Science Tokyo ◆Speech tech+multilingual+multimodal+security ◆Welcome collaboration, discussion CV: https://t.co/naL0tJB3sI
Dongjun Min @mindongjun7719
6 Followers 276 Following
Siheng Chen @chensiheng
187 Followers 528 Following Associate Professor at Shanghai Jiao Tong University, Ph.D at Carnegie Mellon University Integrating AI Agents into Human Lives
Viet Nguyen @vng_sofw
11 Followers 199 Following ECE Ph.D. @JohnsHopkins | ex-Research Intern @Qualcomm
Anh Nguyen (Aengus) @aengusng8
108 Followers 2K Following Son & brother; AI Research Resident @Qualcomm; Contributor @huggingface🤗; Prev: @VinAI_Research. Update gradients in generative dimensions of computer vision.
İpek Öztaş @pekzta4
30 Followers 143 Following MSc student @Bilkent @DeepLearningResearch Lab computer vision & 3D graphics enthusiast
Jaewoo Lee @jaew00_lee
218 Followers 460 Following Incoming CS PhD student @unccs working w. @mohitban47 | Multimodality, Efficiency | Prev BS & MS @KAIST | Prev-Interned @NTU, @MIT
sabrina @sabrina123979
13 Followers 681 Following
Amanuel Tafese @dufera_ama36621
72 Followers 3K Following #Visual SLAM #3D Reconstruction #Robot perception | Vision
이석민 @iseogmi63015852
3 Followers 20 Following
Chengxuan Qian @qian_xuan46760
17 Followers 553 Following Junior Undergraduate with great interests in Reasoning, Planning and Alignment for Multimodal LLMs and Agents.
Arjun Choudhry @Arjun_7m
265 Followers 1K Following 1st Year ML PhD @GeorgiaTech. Previously @AutonLab @SCSatCMU, @UTSAAII, @UQAM, @dtu_delhi. Interests: Multimodal FMs, Structured Data, Efficiency
vsan dhayan @nextxdeveloper
18 Followers 1K Following
Jongho Park @jon_ghoh
323 Followers 631 Following 🧑💻 PhD student @berkeley_ai. M.S. @WisconsinCS 👾 ex-researcher @Krafton_AI (@PUBG)
Jzz @jjzznnmm
7 Followers 187 Following
Anirudh Thatipelli @AThatipelli
534 Followers 5K Following PhD-CS @UCFCRCV, MS-CS @UCR_CSE, Former Applied Science Intern at @amazon
Taqdeer Gill @Agfromspace
1K Followers 4K Following PhD candidate @UWMadison | M.S @TSUedu | B.S @PAU_ldh | Nitrogen management in vegetables 🫛🫘using remote sensing 🛰 and ML🤖
Shawn Zhong @ShawnZhong_
69 Followers 392 Following
wuc9521 @wuc9521
84 Followers 1K Following
Carter Peterson @imakelights
104 Followers 419 Following interested in computers and how they affect us. building the future of lighting @enody_lighting; prev apple
Andy Konwinski @andykonwinski
8K Followers 98 Following Co-founder of @databricks, @perplexity_ai, @laudeinstitute, @laudeventures
Simon Zhai @simon_zhai
1K Followers 519 Following Research Scientist @GoogleDeepMind. PhD @berkeley_ai. I troll most of the time.
Jaemin Cho @jmin__cho
2K Followers 1K Following Incoming Assistant Prof @JHUCompSci & Young Investigator @Allen_AI | PhD @UNCCS | jmincho @ 🦋
Tianbao (TB) Yang @yang_ML
610 Followers 1K Following Professor at Texas A&M University; ML/AI researcher; optimization for ML/AI; large reasoning models, developing LibAUC library for training deep neural nets.
Glenn Ko @glennko
652 Followers 531 Following ceo @stochasticai building private, efficient and adaptive ai systems previously @harvard @qualcomm @ibmresearch @samsung
Anand Bhattad @anand_bhattad
3K Followers 434 Following Assistant Professor @JHUCompSci, @HopkinsDSAI Past: RAP @TTIC_Connect | PhD @SiebelSchool Research: Exploring Knowledge in Generative Models
Jason Ren @RenZhongzheng
362 Followers 864 Following Researcher @Ai2Prior @uwcse, Incoming Assistant Professor @UNC | PhD @IllinoisCS
Jang Hyun (Vincent) C... @vincent_jh_cho
119 Followers 181 Following Research scientist @AIatMeta. Broadly interested in VLMs and multimodal reasoning.
Shane @shinheeshanelee
2K Followers 4K Following Co-founder @DeftRobo | systems integrator of wheeled humanoid robots for 🇺🇸 OEMs & Tiers 1-2 | prev @UCBerkeley, @Tesla Motor Design + Autopilot Hardware
yuyin zhou @yuyinzhou_cs
2K Followers 879 Following Assistant Professor @ucsc, Postdoctoral Researcher @Stanford @StanfordAIMI, Medical Image Analysis, Machine Learning / former Ph.D. @JohnsHopkins M.S. @UCLA
Yifei Wang @yifeiwang77
2K Followers 2K Following Postdoc @MIT_CSAIL. Self-supervised learning. Foundation Models. AI Safety. Prior BS+BA+PhD @PKU1898.
Xin Eric Wang @xwang_lk
18K Followers 1K Following Professor @ UCSB (@ucsantabarbara). Head of Research @SimularAI. Interim Director @ucsbcrml. #Multimodal #Embodied #Agents. AI for Humanity in the long run.
Yixin Lin @yixin_lin_
2K Followers 7K Following something new. prev: embodied AI @GoogleDeepMind, FAIR/@AIatMeta, Google Brain.
Aykut Erdem @aykuterdemml
6K Followers 1K Following Associate Professor of Computer Science at @kocuniversity; A Researcher at @KuisAICenter; Researcher in #ComputerVision #ML #AI; Geek; Boardgamer.
Chenyu You @Charlesyooo1
381 Followers 405 Following Assistant Professor at Stony Brook @AmsBrook @sbucompsc | PhD @Yale | #ML, #AI, #health
Chanwoo Park @chanwoopark20
1K Followers 1K Following Games, Multi-agent (gen) AI | @speedrun SR003 | @mit EECS Ph.D. Candidate
Kaustav Kundu @kkundu10
421 Followers 579 Following Senior ML scientist@AWS AI working on multi-model models. PolygonRNN, 3DOP, PC training, TubeR. PhD (ABD) at University of Toronto ML group
Anh Nguyen @NguynTu24128917
787 Followers 4K Following
Vikas Raunak @vyraun
691 Followers 5K Following Senior Research Scientist @GoogleDeepMind. Working on Gemini.
Nino Scherrer @ninoscherrer
994 Followers 2K Following Research Scientist at @Google | Rigorous evaluations, cognitive science & causality | Ex: {@PatronusAI, @VectorInst, @Mila_Quebec, @MPI_IS, @ETH_en}
Mike Shou @MikeShou1
2K Followers 463 Following Asst Prof at NUS. Forbes 30 under 30 Asia. Previously at Facebook AI and Columbia U. Passionate about video, multi-modal, AI assistant.
Kevin Patrick Murphy @sirbayes
61K Followers 529 Following Research Scientist at Google DeepMind. Interested in Bayesian Machine Learning.
Richard Sutton @RichardSSutton
45K Followers 64 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award
Fei-Fei Li @drfeifei
519K Followers 1K Following Prof (CS @Stanford), Co-Director @StanfordHAI, Cofounder/CEO @theworldlabs, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Russ Salakhutdinov @rsalakhu
109K Followers 166 Following UPMC Professor of Computer Science @ CMU, President Elect ICML Board, VP of Research @ Meta (Multimodal LLMs, AI Agents), ex-Director of AI research at @Apple
Nando de Freitas @NandoDF
105K Followers 776 Following Some projects I was lucky to be part of AlphaGo tuning, AlphaCode, Gato, ReST, r-Gemma, Imagen3, Veo, Genie, MAI. Ex Berkeley, UBC, Oxford Prof, Google DeepMind
Wenhu Chen @WenhuChen
22K Followers 663 Following AI researcher. Interested in Reasoning, Multimodal. I direct TIGER-Lab. Author of PoT, MMMU, MMLU-Pro, MAmmoTH, LongRAG, MAP-Neo, YuE, VL-Rethinker
Amir Bar @_amirbar
2K Followers 1K Following Research Scientist at Meta (FAIR). Prev: Postdoc, PhD at @TelAvivUni and @berkeley_ai
Roei Herzig @roeiherzig
1K Followers 846 Following Researcher @IBMResearch. Postdoc @berkeley_ai. PhD @TelAvivUni. Working on Compositionality, Multimodal Foundation Models, and Structured Physical Intelligence.
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Jiasen Lu @jiasenlu
1K Followers 351 Following Researcher@Apple (Ex Senior researcher @AI2, PhD@Georgia Tech)
Unnat Jain @unnatjain2010
1K Followers 362 Following AI Research = Deep Learning, Vision, and Robotics Faculty @UCIrvine Previously @AIatMeta @SkildAI Postdoc @CMU_Robotics | PhD @UofIllinois | UG @IITKanpur
Anirudh Sundara Rajan @AniSundar18
18 Followers 190 Following PhD at UW-Madison, deep learning, computer vision
Sander Dieleman @sedielem
63K Followers 2K Following Research Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).
Lu Lu @cosmic_lulu
247 Followers 192 Following Neutrino hunter @uw_icecube | Assistant Prof @UWMadison | US-SCAR Physical Sciences Rep (Scientific Committee on Antarctic Research)
Fuxin Li @fuxinli2
811 Followers 303 Following Associate Professor in AI, Deep Learning and Computer Vision, Oregon State University
Aakanksha Chowdhery @achowdhery
11K Followers 5K Following @Stanford @reflection_ai // Previously @GoogleDeepMind :: PaLM, Gemini // @MSFTResearch, @Princeton // views my own and subject to change
Ryan Yuan @RainbowYuhui
1K Followers 3K Following Research Director@Canva; ex-MSRA. Build a research team focused on fundamental research for world-leading graphic design generation. Email: [email protected]