Jesse Thomason @_jessethomason_
Assistant Prof @CSatUSC leading the GLAMOR lab https://t.co/VQhcMiC8hE (he/him; 💖💜💙) jessethomason.com Los Angeles, CA Joined July 2017-
Tweets559
-
Followers3K
-
Following1K
-
Likes5K
I am co-organizing an incredible workshop about using LLMs for well-being in the context of HRI 🔥 more info below 👇 📢 Keynote speakers: @rcalo, @_jessethomason_, @brain_on_dance 🌴 Hosted at IEEE RO-MAN in beautiful Pasadena, California 🔗 lnkd.in/dt-V68DU Join us!
It's true, and the need for single-modality ablations during model building and dataset curation extends beyond classification tasks into actions too. A few years ago we found that many "embodied" agents end up either ignoring language OR ignoring vision. arxiv.org/abs/1811.00613
It's true, and the need for single-modality ablations during model building and dataset curation extends beyond classification tasks into actions too. A few years ago we found that many "embodied" agents end up either ignoring language OR ignoring vision. arxiv.org/abs/1811.00613
I had a great time visiting UCLA and USC during the spring break to give talks on "Amazing Multilingual Capabilities and Concerning Cultural Biases in Large Language Models". Thanks to @_jessethomason_ @VioletNPeng @kaiwei_chang @robinomial for hosting!
Localization in LLMs is often mentioned. But do localization methods actually localize correctly? In our #NAACL2024 paper, we (w/ @_jessethomason_, @robinomial) develop two benchmarking ways to directly evaluate how well 5 existing methods can localize memorized data in LLMs.
LLMs alone aren't that reliable. Search is on for ways to combine them with other software. I describe a couple of examples here, including work by @_jessethomason_ , @Ishika_S_ , Ruzica Piskac and @scottjshapiro open.substack.com/pub/robots4the…
LLMs can act as planners in simple settings, but struggle in complex ones, e.g. multi-agent, where planner has to track agent-specific states. TwoStep leverages strengths of LLMs & classical planners to produce faster, shorter, and guaranteed plans! glamor-usc.github.io/twostep 🧵👇
LLMs can act as planners in simple settings, but struggle in complex ones, e.g. multi-agent, where planner has to track agent-specific states. TwoStep leverages strengths of LLMs & classical planners to produce faster, shorter, and guaranteed plans! glamor-usc.github.io/twostep 🧵👇 https://t.co/F8ooE8KeoN
A model that reports predictions without introspection on how OOD it might be is not acceptable in a human-AI team. The ReCoVERR algorithm squeezes information out of extratextual modalities like vision during inference to improve such selective prediction arxiv.org/abs/2402.15610
A model that reports predictions without introspection on how OOD it might be is not acceptable in a human-AI team. The ReCoVERR algorithm squeezes information out of extratextual modalities like vision during inference to improve such selective prediction arxiv.org/abs/2402.15610
Great article by @davidberreby that highlights the work of GLAMOR Lab's @Ishika_S_ in collaboration with @NVIDIAAI folks like @animesh_garg and continued with funding from @ArmyResearchLab. Upshot: if LLMs tell robots what to do, experts should decide what actually gets done.
Great article by @davidberreby that highlights the work of GLAMOR Lab's @Ishika_S_ in collaboration with @NVIDIAAI folks like @animesh_garg and continued with funding from @ArmyResearchLab. Upshot: if LLMs tell robots what to do, experts should decide what actually gets done.
Before asking "How to Train Your Robot", ask "for what?" Training and evaluating in similar conditions lets you know the model fit the problem, but what about when the problem space shifts? The Colosseum lays out sim and real perturbations to stress-test learned control policies.
Before asking "How to Train Your Robot", ask "for what?" Training and evaluating in similar conditions lets you know the model fit the problem, but what about when the problem space shifts? The Colosseum lays out sim and real perturbations to stress-test learned control policies.
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingWilliam Wang @WilliamWangNLP
14K Followers 718 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistYoav Artzi @yoavartzi
13K Followers 162 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCJacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciBill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_uscSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Xin Eric Wang @xwang_lk
7K Followers 1K Following Multimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/himKayo Yin @kayo_yin
8K Followers 560 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Luca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (Dolma 🍇), OSS is fun, @QueerInAI organizer 🤖☕️🍕they/them (views mine, not my employer’s)Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himYonatan Bisk @ybisk
3K Followers 883 Following Assistant Professor (he/him) @LTIatCMU/@SCSatCMU - embodied #NLProc Stealing ideas from @_Hao_Zhu @viddivj @_Yingshan @SoYeonTiffMin, @FernJared @abitha___Felix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sNaomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.🌞♀️ IA Defence.. @DelightAi6881
162 Followers 5K Following .:. Whoever controls the information controls the people .:.David Paulius @davidpaulius
94 Followers 201 Following A roboticist from the Caribbean 🦾🏝️ • Postdoc at @BrownCSDept • Grad of @USouthFlorida and @UVI_edu • he / him • human?simpletrading @simpletrad17722
399 Followers 7K Followingssteevens @Steevens43
159 Followers 5K FollowingAshutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.Lin Ting @LinTing_SG
70 Followers 1K Following Interested in NLP, IR, RecSys, and ML E2E model implementation.Anna Ciaunica @annaci.. @AnnaCiaunica
12K Followers 10K Following Philosopher/Cognitive scientist |PI working on Self-Consciousness, Embodiment & Social Interactions in Humans & Artificial Agents | RT not endorsementVikram Dutt @vd_
837 Followers 7K FollowingRamya Vinayak @ramyavinayak
17 Followers 36 Following Assistant Professor at UW-Madison. Working on Machine Learning, Statistical Inference and Crowdsourcing.Vikram Pande @VikramPande007
23 Followers 355 Followingmann @punsbymann
105 Followers 347 Following ML @google | ms cs/ai @USC | geometric deep learning, language modelling, all things computeBoss A @AkshatW6189
1 Followers 36 FollowingJindong Gu @Jindong73504766
293 Followers 891 Following Senior Research Fellow in University of Oxford @OxfordTVG Faculty Researcher @Google #ResponsibleAI #AISafety #GenAI Homepage: https://t.co/YOSVO3jb6hYuting Ning @yuting_ning
31 Followers 120 Following Master Student at USTC | Visiting Student @nlp_uscsourjyadip @bunueldante
136 Followers 2K Following MS (Research) @iitkgp | Vision and Language for healthcare @cnerg | Musician | NerdTaki @Takihasanrafi
53 Followers 757 Following Foundation Models / LLMs / VLMs / Responsible AI | PhD in CS @Hanyang!Jason Wu @jasonwuishere
2K Followers 1K Following PhD student, Human-Computer Interaction Institute, Carnegie Mellon UniversityWilliam Sun @williamsun2020
116 Followers 1K FollowingPensé FFun @inftyCategory
100 Followers 6K FollowingAdrian Garza @AdMicG
23 Followers 117 FollowingTommi Somersuo @somersuo
320 Followers 1K Following Director of Technology @Solita_Insights https://t.co/rDkjp5NAIOannusyser @annusyser43541
1 Followers 28 Followingkunal singh @ikunalsingh7
61 Followers 668 Following Lead AI Researcher https://t.co/z4idFlmggM (T2I), Lead AI Researcher @fractalai Prev: GSoC @CERN, Alumni @IITKgp, Intern @AmiiThinks Diffusion, VLMs, reasoning@LLMJeremie @jfcbecker
12 Followers 207 FollowingAlexander Wan @alexwan55
475 Followers 944 Following CS at Berkeley; @BerkeleyML @BerkeleyNLP; NLP researchRohith Peddi @rohithpeddi7
27 Followers 352 FollowingSumin Hu @sumin_hu
16 Followers 125 FollowingSunqi Fan @Sunqi_Fan
111 Followers 586 Following a third-year undergrad @Tsinghua_Uni, studying NLP/LLM/CV. Seeking for 25 Fall Ph.D. positionUlas Berk Karli @uberkkarli
69 Followers 153 Following Graduate Student Yale / Robotics MSE Johns Hopkins / BS Koc UniDavid Stafford @davidstafford
693 Followers 2K Following AI and robotics. Bit twiddling. Opinions are my own.some|body @CoderHermit
127 Followers 4K Following Favorite movie: 'The Man from Earth'. A book I wish to be written:'How to git gud at Starcraft and life in general' by Oriol V.Anil Murthy @Anil_MurthyB
7 Followers 522 Followings-miyawaki∣Algomati.. @catshun_
844 Followers 1K Following NLP Engineer & Academic Researcher #DocVQA #OpenQA #RetrievalArto Bendiken @bendiken
5K Followers 5K Following CTO @HaltiaAI. Autodidact, coder, cypherpunk, entrepreneur, hacker, maker. ex-NEAR, ex-Aurora, ex-Dydra. Find me also at @[email protected].Eran Hirsch @hirscheran
255 Followers 486 Following PhD candidate @biunlp ; Tweets about NLP, ML and researchAditya @_AdityaKapoor_
144 Followers 806 Following #TCS Predoc Researcher || Founder of StraysCue: #AnimalRescueLee @ohnoleo
0 Followers 969 FollowingRamin Hamedi @HamediRamin
56 Followers 2K FollowingCarter Leffen @carterleffen
1K Followers 870 Following We are here to learn, make a difference, and have fun. - DemingWilliam Wang @WilliamWangNLP
14K Followers 718 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistYoav Artzi @yoavartzi
13K Followers 162 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCJacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Ana Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Xin Eric Wang @xwang_lk
7K Followers 1K Following Multimodal and Embodied AI Researcher / Professor @UCSC. Director of https://t.co/Y4swOBag21. AI for Humanity in the long run. he/himDanish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Kayo Yin @kayo_yin
8K Followers 560 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Luca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (Dolma 🍇), OSS is fun, @QueerInAI organizer 🤖☕️🍕they/them (views mine, not my employer’s)Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Mark Dredze @mdredze
4K Followers 786 Following John C Malone Professor at @JohnsHopkins @JHUCompSci @jhuclsp @jhumceh; Part time @techatbloomberg (tweets my own) Mastodon @[email protected]Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Greg Durrett @gregd_nlp
6K Followers 752 Following CS professor at UT Austin. I do NLP most of the time. he/himTal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAIDavid Paulius @davidpaulius
94 Followers 201 Following A roboticist from the Caribbean 🦾🏝️ • Postdoc at @BrownCSDept • Grad of @USouthFlorida and @UVI_edu • he / him • human?Ramya Vinayak @ramyavinayak
17 Followers 36 Following Assistant Professor at UW-Madison. Working on Machine Learning, Statistical Inference and Crowdsourcing.Ashutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.Lin Ting @LinTing_SG
70 Followers 1K Following Interested in NLP, IR, RecSys, and ML E2E model implementation.Anna Ciaunica @annaci.. @AnnaCiaunica
12K Followers 10K Following Philosopher/Cognitive scientist |PI working on Self-Consciousness, Embodiment & Social Interactions in Humans & Artificial Agents | RT not endorsementYuting Ning @yuting_ning
31 Followers 120 Following Master Student at USTC | Visiting Student @nlp_uscTaki @Takihasanrafi
53 Followers 757 Following Foundation Models / LLMs / VLMs / Responsible AI | PhD in CS @Hanyang!Alex Lu @alexijielu
4K Followers 567 Following Researcher at @MSFTResearch. I study how AI can learn biology through puzzle-solving. Deaf and queer (he/his)Wenpeng_Yin @Wenpeng_Yin
1K Followers 3K Following Assistant Professor at Penn State, State College Department of Computer Science and EngineeringJason Wu @jasonwuishere
2K Followers 1K Following PhD student, Human-Computer Interaction Institute, Carnegie Mellon UniversityToby Mintz @toby_mintz
56 Followers 29 Following Departments of Psychology and Linguistics, Director of the Undergraduate Cognitive Science Program, Univ. of Southern California @USC. Language and cognition.Alexander Wan @alexwan55
475 Followers 944 Following CS at Berkeley; @BerkeleyML @BerkeleyNLP; NLP researchLearning and Intellig.. @MIT_LISLab
1K Followers 245 Following PIs: Leslie Pack Kaelbling, Tomás Lozano-Pérez AI/ML/Robotics Research @MIT_CSAIL Website: https://t.co/TgsPKmvPCbSunqi Fan @Sunqi_Fan
111 Followers 586 Following a third-year undergrad @Tsinghua_Uni, studying NLP/LLM/CV. Seeking for 25 Fall Ph.D. positionUlas Berk Karli @uberkkarli
69 Followers 153 Following Graduate Student Yale / Robotics MSE Johns Hopkins / BS Koc UniAditya @_AdityaKapoor_
144 Followers 806 Following #TCS Predoc Researcher || Founder of StraysCue: #AnimalRescueEran Hirsch @hirscheran
255 Followers 486 Following PhD candidate @biunlp ; Tweets about NLP, ML and researchZiyi Liu @ZiyiLiu21755818
23 Followers 103 Following Visiting scholar at USC. Interested in reinforcement learning and robot learning.Nicholas Lourie @NickLourie
137 Followers 287 Following I build things. 🤖 Doing a PhD at @nyuniversity (@CILVRatNYU) on better empirical methods for deep learning and data science. Advised by @kchonyc and @hhexiy.Nina Beguš @ninabegus
3K Followers 2K Following Researcher @UCBerkeley Founder @Interpret_AI #ArtificialHumanitiesEmma Webster @emmawebstah
290 Followers 891 Following paintress | green-screen space & virtual landscape | NFTs on SuperRare | https://t.co/WXyWOjUsvvDr. Allyson Sgro @AllysonSgro
2K Followers 894 Following How do cells work together and make decisions when people have so much trouble? Group Leader @HHMIJanelia She/They 🏳️🌈 @[email protected]lauren lee mccarthy @laurenleemack
18K Followers 1K Following artist, creator @p5xjs, professor @ucla_dma, co-director @sosoftuclaJessica Brillhart (@b.. @brillhart
10K Followers 400 Following Mixed reality creator, author, and theorist. Find me on Bluesky 🪂Agnieszka Kurant @agnieszkakurant
265 Followers 87 Following https://t.co/3Uw8RNKMqb and https://t.co/Ozv47KZpdPZihao He @ZihaoHe95
177 Followers 280 Following Computer Science PhD Student @USC ML on Graphs, NLP for Computational Social ScienceNoah Patton @Noah_T_Patton
16 Followers 43 Following Computer Science PhD Student at the University of Texas at AustinPrateek Yadav @prateeky2806
2K Followers 2K Following Ph.D. at @unccs Continual Model Adaptation and Composition Previously @MSFTResearch, @AmazonScience, @iitmadras. UG @iiscbangalore. Opinions are my own.Emily is wearing a ma.. @emtseng
2K Followers 2K Following PhDing @cornellcis | HCI, privacy and security, care | prev @msftresearch @princeton | she/herMichelle Li @michelleli__
85 Followers 265 Following Research @Waymo, previously undergrad @MIT and intern @CHAI_BerkeleyVinitha Ranganeni @vinitha910
42 Followers 91 Following PhD Candidate at @uwcse @uw_robotics | Interested in Assistive Robotics and Human-Robot Interaction | Opinions my own.Yiannis Kantaros @YiannisKantaros
143 Followers 217 Following Assistant Professor, ESE department, Washington University in St. Louis.Wilbert @wpumacay7567
6 Followers 337 FollowingWillie Neiswanger @willieneis
1K Followers 206 Following Assistant Professor @USC in CS + AI. Previously @Stanford, @SCSatCMU. Machine Learning, Decision Making, AI-for-Science, Generative AI, Uncertainty, ML Systems.Changbin Li @lichangbin101
155 Followers 1K Following PhD student at UT Dallas. Ex-Research Intern @AIatMeta @Bosch_AIJaehong Yoon @jaeh0ng_yoon
536 Followers 678 Following Postdoc @unccs & @uncnlp, working w/ @mohitban47 | PhD @MLAI_KAIST | Interned @MSFTResearch | Video & Multimodal LLM, Efficiency, Compositionality, FaithfulnessAditya Mohan @amsks96
324 Followers 647 Following Ph.D. Student searching for Structure in #ReinforcementLearning, #MetaLearning and #AutoML amsks96 on the blue app@nrokh.bsky (Nataliya.. @natrokh
802 Followers 1K Following biomechanics+haptics PhD candidate @CarnegieMellon+@MPI_ISMartin Ziqiao Ma @ziqiao_ma
1K Followers 1K Following 〽️ PhD @Michigan_AI | 💼 @Adobe | 🎓@SJTU1896 @Amazon |🤔️ = (🗣️#NLProc + 🤖#EmbodiedAI + 🤝#Interaction) x 🧠#CogSci | Grounding language to 👥 & 🌎.Mingkai Deng @mdeng34
324 Followers 278 Following PhD student @LTIatCMU | MSML @mldcmu | BA Math-Stats + CS @Columbia | CV, RL, NLP | He/HisQuanting Xie @DanielXieee
325 Followers 766 Following Incoming PhD @CMU CLAW_Lab @CMU_RI | Prev @Apple || #Embodied_AI #Robot_Learning #Humanoid #Dexterous_handSijia Liu @letti_liu
46 Followers 163 Following Research Scientist @Amazon AGI. | Interests: AI/LLMs/Conversations. | Previously: @CarnegieMellon @pku1898Ali Raza @Aliraza32743112
342 Followers 5K Following RF Optimization||SQL||Python||Data Analyst||ML EngineerNo surprises here :)
Make cute word clouds with data from your Google scholar page :) shiny.rcg.sfu.ca/u/rdmorin/scho… (for those who would imagine I would write the word integration all that often, I don't :) ) very fun tool! Try it! #academicchatter #AcademicTwitter
In final rule, FTC bans non-compete clauses for *all* workers!
this paper was sent out of anger to unsubscribe from a low-quality research journal's mailing list but ended up getting accepted
@_jessethomason_ I’m renaming “the Mona Lisa smile” to “Jesse Thomason smile”
@_jessethomason_ That was a very insightful paper :)
I have been working on vision+language models (VLMs) for a decade. And every few years, this community re-discovers the same lesson -- that on difficult tasks, VLMs regress to being nearly blind! Visual content provides minor improvement to a VLM over an LLM, even when these…
Today we’re releasing OpenEQA — the Open-Vocabulary Embodied Question Answering Benchmark. It measures an AI agent’s understanding of physical environments by probing it with open vocabulary questions like “Where did I leave my badge?” More details ➡️ go.fb.me/7vq6hm…
it's taking surprisingly long for an LLM bro to announce the discovery of task oriented dialogue systems
I think I might be a lot less angsty about drivers if there was literally anywhere in town I could go to escape the presence of cars. Every act of using transit, going to a park, shopping, or just walking around involves navigating drivers in two-ton blocks of metal.
I had a great time visiting UCLA and USC during the spring break to give talks on "Amazing Multilingual Capabilities and Concerning Cultural Biases in Large Language Models". Thanks to @_jessethomason_ @VioletNPeng @kaiwei_chang @robinomial for hosting!
I have a spreadsheet on my desktop tracking my progress to prizes titled "oops I didn't get it again". (3/5)
Localization in LLMs is often mentioned. But do localization methods actually localize correctly? In our #NAACL2024 paper, we (w/ @_jessethomason_, @robinomial) develop two benchmarking ways to directly evaluate how well 5 existing methods can localize memorized data in LLMs.
"Wow, that solved none of my problems, but it looked really good" -- my wife tries to use ChatGPT for coding for the first time
I think conference orgs need to set policy for LLMs in experiments. Is NOT using proprietary systems (GPT, Claude, ...) a major concern? Is ONLY using proprietary systems a major concern? In reviews of my papers, and as AC, I've seen both, and it's super unfair to authors.
LLMs alone aren't that reliable. Search is on for ways to combine them with other software. I describe a couple of examples here, including work by @_jessethomason_ , @Ishika_S_ , Ruzica Piskac and @scottjshapiro open.substack.com/pub/robots4the…
They get written up in notepad for that extra level of authenticity
Here is my thought on the news about Microsoft and Inflection AI: Nadella hired a toxic manager who abused his people, and dragged out sexual abuse cases to run their new AI division. But I guess hiring a founder of DeepMind is more important than having good leadership.
6 years ago, we flew to ATL to start the next chapter of our lives. I started as faculty at @gtcomputing, found PhD students who were willing to take a chance on me 🙏, took risks on exciting research. Today, I’m excited to share that I’ve been promoted to Assoc Prof w/ Tenure!!!
Y'all. My 15yo niece is bullying me on Instagram. Keeps commenting on my posts talking about "very real" "very up to date" "very fashionable" what do I dooooo
So it begins! Kicking off #HRI2024 week with Day 1 of #TAHRI2024! Already great to see so many friends!