Pang Wei Koh @PangWeiKoh
Assistant professor at @uwcse. Formerly @StanfordAILab @GoogleAI @Coursera. 🇸🇬 koh.pw Joined June 2020-
Tweets260
-
Followers3K
-
Following790
-
Likes1K
.@rajivmovva, @PangWeiKoh, and I write for @NatureMedicine on using unlabeled data to improve generalization + fairness of medical AI models: nature.com/articles/s4159… We highlight two nice recent papers illustrating this - nature.com/articles/s4159…, nature.com/articles/s4159….
I’m really excited to be starting a new adventure with multiple amazing friends & colleagues. Our company is called Physical Intelligence (Pi or π, like the policy). A short thread 🧵
Long overdue but here's a new blogpost on training LLMs in the wilderness from the ground up 😄🧐 In this blog post, I discuss: 1. Experiences in procuring compute & variance in different compute providers. Our biggest finding/surprise is that variance is super high and it's…
𝗛𝗼𝘄 𝗰𝗮𝗻 𝘄𝗲 𝗯𝘂𝗶𝗹𝗱 𝗺𝗼𝗿𝗲 𝗿𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗟𝗠-𝗯𝗮𝘀𝗲𝗱 𝘀𝘆𝘀𝘁𝗲𝗺𝘀? Our new position paper advocates for retrieval-augmented LMs (RALMs) as the next gen. of LMs, exploring the promises, limitations, and a roadmap for wider adoption. arxiv.org/abs/2403.03187 🧵
Excited to announce the ICLR 2024 Workshop on Data Problems for Foundation Models (DPFM)! - Topics of Interest: data quality, generation, efficiency, alignment, AI safety, ethics, copyright, and more. - Paper Submission Date: Feb 3, 2024 | Workshop Date: May 11, 2024 (Vienna and…
Excited to finally share that "Impossibility Theorems for Feature Attribution" is published in PNAS. TL;DR Methods like SHAP and IG can provably fail to beat random guessing. w/ @natashajaques @PangWeiKoh @_beenkim PNAS: pnas.org/doi/10.1073/pn… arXiv: arxiv.org/abs/2212.11870
Join us at the NeurIPS Workshop on Distribution Shifts (DistShift) tomorrow! When: Friday, Dec 15, 9am-5pm Where: Room R06-R09 Website: sites.google.com/view/distshift… Virtual site: neurips.cc/virtual/2023/w…
Honored to be on the list! 🙏 I’m actively recruiting students who are interested in AI and writing to understand how AI will change the way we communicate. ✍️ Please consider applying to @UChicagoCS and @DSI_UChicago! More info: minalee.info/prospective-st…
Honored to be on the list! 🙏 I’m actively recruiting students who are interested in AI and writing to understand how AI will change the way we communicate. ✍️ Please consider applying to @UChicagoCS and @DSI_UChicago! More info: minalee.info/prospective-st…
I’ve resigned from my role leading the Audio team at Stability AI, because I don’t agree with the company’s opinion that training generative AI models on copyrighted works is ‘fair use’. First off, I want to say that there are lots of people at Stability who are deeply…
Richard Feynman said “What I cannot create, I do not understand”💡 Generative Models CAN create, i.e. generate, but do they understand? Our 📣new work📣 finds that the answer might unintuitively be NO🚫 We call this the 💥Generative AI Paradox💥 paper: arxiv.org/abs/2311.00059
Myth: open foundation models are antithetical to AI safety. Fact: open foundation models are critical for AI safety. Here are three reasons why:
Ever wondered which data black-box LLMs like GPT are pretrained on? 🤔 We build a benchmark WikiMIA and develop Min-K% Prob 🕵️, a method for detecting undisclosed pretraining data from LLMs (relying solely on output probs). Check out our project: swj0419.github.io/detect-pretrai… [1/n]
I am recruiting PhD students for Fall '24! Please apply to Cornell CS if you are interested in ML, data science, health, or inequality. Feel free to retweet! We are based in NYC - here's the view from our island campus (taken during Pride - note the rainbow lights!)
Introducing COLM (colmweb.org) the Conference on Language Modeling. A new research venue dedicated to the theory, practice, and applications of language models. Submissions: March 15 (it's pronounced "collum" 🕊️)
I’m on the academic job market! I’ll have a PhD from @Stanford CS in 2024. My research develops ML + network science methods to tackle complex societal challenges, from pandemics to polarization to supply chains. See my website + research statement for details! Highlights below:
Introduce LightSeq for long-context LLM training: - Highly optimized for decoder models - smarter checkpointing - better support for fewer heads models up to 2x faster, 2-8x longer sequences vs Megatron-LM. arxiv.org/abs/2310.03294
We are excited to announce the 1st version of our multimodal assistant, Yasa-1, a language assistant with visual and auditory sensors that can take actions via code execution 🪄. Yasa-1 can understand text, images, videos, sounds & more! 🚀 Check out more details below👇
We’re organizing the NeurIPS 2023 Workshop on Distribution Shifts: New Frontiers with Foundation Models. Please submit your paper! Website: sites.google.com/view/distshift… Deadline: Oct 2, 2023 Workshop date: Dec 15, 2023
We are excited to announce OpenFlamingo V2 🦩! We are releasing five new multimodal models, across the 3B, 4B, and 9B scales, that outperform our previous model. w/ @irena_gao. Repo: github.com/mlfoundations/… Demo: huggingface.co/spaces/openfla… Blog: laion.ai/blog/open-flam…
We’re coming out of stealth with $58M in funding to build generative models and advance AI research at @RekaAILabs 🔥🚀 Language models and their multimodal counterparts are already ubiquitous and massively impactful everywhere. That said, we are still at the beginning of this…
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistGautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Ananya Kumar @ananyaku
4K Followers 469 Following Researcher at @openai Previously PhD at Stanford University (@StanfordAILab) advised by Percy Liang and Tengyu MaBehnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingYi Tay @YiTayML
28K Followers 97 Following Chief scientist & Co-founder @RekaAILabs past: Research Scientist @Google Brain 🧠 currently learning to be a dad 🍼👶Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳rishi @RishiBommasani
4K Followers 2K Following Stanford CS PhD @StanfordCRFM @StanfordNLP @StanfordAILab @StanfordHAI Advisers: @percyliang @jurafsky Previous: @CornellCIS @clairecardie #FoundationModelsJacob Andreas @jacobandreas
13K Followers 955 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Emma Pierson @2plus2make5
9K Followers 794 Following CS faculty @cornell_tech; past @MSFTResearch, @StanfordAILab, @Rhodes_Trust scholar. Health+inequality+ML. "On the whole, though, I take the side of amazement."Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Yann Dubois @yanndubs
4K Followers 1K Following PhD student @stanfordAILab | Prev: AI resident @metaai, @vectorinst, @CambridgeMLGAlex Ratner @ajratner
5K Followers 542 Following @SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.Sizun Jiang @SizunJ
2K Followers 2K Following Asst Prof @harvardmed @BIDMChealth @DanaFarber @broadinstitute | 🦀 🦠 🤧 | 🇸🇬 "Spatial? Back in my day, it was just multiplexed imaging"Thomas Paes @thpaes
90 Followers 1K FollowingAbdulrahman Tabaza @embed_dim
2 Followers 447 Following Enjoyer of various vector spaces and modalitiesnion @ubernion
180 Followers 2K Following its all sand kiddo. privacel. striving for erudition. random walker. DM ME!!!Kunvar Thaman @firstuserhere
241 Followers 608 Following Taking apart neural networks and putting them back together for a living Social profiles: https://t.co/OxoeMvCw3aking @nguynking
29 Followers 269 FollowingKelvin 🦖🤓 @kelvinhan
56 Followers 712 Following #NLProc PhD student at LORIA/Université de Lorraine, I work on generation of questions, from structured and unstructured data.buntr @buntr007
7 Followers 140 Followingautopoietic dreams @liminaught
35 Followers 161 Following liminal lurker. meme magician. trickster technoshaman. weaving wyrd sigils from the threads of the collective unconscious.GAO Hongnan @gaohongnan
36 Followers 292 FollowingTechnoPublic @Technopublic24
32 Followers 2K Following Technology is the application of knowledge for achieving practical goals in a reproducible way. Software Engineer/Dad/Reader. This is my notebook of thoughts.Tran Bao Chi @TranBaoChi7
28 Followers 458 Following Undergrad #DSAI #HUST Research Intern #NLP #VinAIIvan Leo @ivanleomk
2K Followers 724 Following Professional GPT wrapper writer, I write longer tweets at https://t.co/02byZNKMa8Alpay Ariyak @AlpayAriyak
1K Followers 2K Following 𝗔𝗜 @RunPod_io | 𝗟𝗲𝗮𝗱: @OpenChatDev (𝟲𝟬𝟬𝗸+ 𝗱𝗼𝘄𝗻𝗹𝗼𝗮𝗱𝘀 on HuggingFace🤗)Addison_And @AndAddison80999
7 Followers 390 Following I swear in the name of God, don't miss an opportunity to earn 500-5000usdc every day. https://t.co/GPT6iyNdCiPolly_US_ @UsPolly90768
3 Followers 419 Following Nice to meet you. My hobbies are reading, food and sports. I like cats😘 I like to meet new friends while traveling🎉🎉🎉Yichen (Zach) Wang �.. @YichenZW
101 Followers 172 Following Senior Undergrad Interning @UWNLP @Tsvetshop & @BerkeleyNLP | Honored CS BS @XJTU1896 24’Makya @Makya12345678
5 Followers 905 FollowingChandan Singh @csinva
883 Followers 506 Following Senior researcher @MSFTResearch. Seeking good explanations with machine learning. Likes trees and brains. PhD from @Berkeley_AIMickel Liu @mickel_liu
106 Followers 233 Following research visiting @uwnlp, Prev: @PKU1898, @uoftengineering RL + LLMEr-Te Zheng @ErteZheng
118 Followers 634 Following pre-PhD Student @SheffieldUni | Bsc @ZJU_China | Scientometrics, Science of Science, Computational Social Science, Data Science, Research Integrity #AI #LLMClayton @cthorrez
1K Followers 1K Following LLM applied scientist by day, esports data scientist for fun. Working on rating systems and benchmarks for esports (and LLMs?) I ❤️ paired comparison dataHarsh Kohli @hkohli14
31 Followers 207 Following PhD student at The Ohio State University Previously - Amazon, Microsoft, GeorgiaTech, BITS Pilani Research interests: Language Models and all things NLPIRTESH Conferences @IRTESH_CONF
48 Followers 724 Following International Research in Technology, Engineering, Sciences and Humanitiesrose lin @roselin86992969
3 Followers 62 FollowingYanda Chen @yanda_chen_
423 Followers 383 Following 3rd year PhD @ColumbiaCompSci, working on NLP & ML | Student Researcher @GoogleAI | Prev Intern @MSFTResearch, @AmazonScienceEva Louise Marie Gabr.. @e681554349
6 Followers 3K FollowingTeddi Worledge @TeddiWorledge
37 Followers 78 Following (she/her) Computer Science PhD Student @Stanford. Formerly @Berkeley.Barbad @BarbadForoughi
0 Followers 1K FollowingZhiyong Wang @Zhiyong16403503
358 Followers 2K Following Visiting Ph.D. student at Cornell University. Ph.D. candidate at CUHK. Working on bandits and reinforcement learning theory.Fusheng Liu @mathlfs
6 Followers 45 Following PhD student @ National University of Singapore [email protected]Victor K Mitchell @MitchellVictot
8 Followers 3K FollowingNafiira Nurfita | A L.. @fianfitr
169 Followers 5K Following @F_Nurfitriana | Psy. | Always go with the choice that scares you the most, because that's the one that is going to help you grow. | Bismillah CHRO.Wanru Zhao (Looking f.. @Renee42581826
510 Followers 2K Following Postgraduate Student @CaMLSys @Cambridge_CL | Ex-Intern @DGLGraph @AWS and @CambridgeJBS | Do not go gentle into that good night 🧗Khang Zhie Phoong @KhangZhie_
4 Followers 132 Following he/him • NLP Researcher at DSO (National Laboratories) • Former undergrad at @uwcse • Clarinetist • CrossFitterChuanming @ChuanmingLiu
221 Followers 4K Following Ex-PhD student and alumni @sjtu1896 . Global citizen. Bootstrapping silicon-based life.Puneesh Deora @puneeshdeora
32 Followers 234 Following Grad student at UBC. Working on ML Theory and Optimization.Geyang Guo @CherylolGuo
20 Followers 40 Following Undergrad at Renmin University of China; Research intern @MSFTResearch; NLP/ML/LLM Alignment.Hannah Lawrence @HLawrenceCS
516 Followers 397 Following PhD @ MIT CSAIL. Geometric deep learning, especially learning with symmetries (equivariance). https://t.co/0XcSE5V8S2Jan @janframework
1K Followers 170 Following Turning computers into AI computers. An open-source alternative to ChatGPT that runs offline on your computer or server. DC: https://t.co/gXXor3pWNDPercy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistGautam Kamath @thegautamkamath
44K Followers 502 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Ananya Kumar @ananyaku
4K Followers 469 Following Researcher at @openai Previously PhD at Stanford University (@StanfordAILab) advised by Percy Liang and Tengyu MaKyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingRosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRClément Canonne @ccanonne_
31K Followers 926 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Yi Tay @YiTayML
28K Followers 97 Following Chief scientist & Co-founder @RekaAILabs past: Research Scientist @Google Brain 🧠 currently learning to be a dad 🍼👶Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Akari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Sasha Rush @srush_nlp
51K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzrishi @RishiBommasani
4K Followers 2K Following Stanford CS PhD @StanfordCRFM @StanfordNLP @StanfordAILab @StanfordHAI Advisers: @percyliang @jurafsky Previous: @CornellCIS @clairecardie #FoundationModelsJacob Andreas @jacobandreas
13K Followers 955 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwChristopher Manning @chrmanning
126K Followers 114 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Emma Pierson @2plus2make5
9K Followers 794 Following CS faculty @cornell_tech; past @MSFTResearch, @StanfordAILab, @Rhodes_Trust scholar. Health+inequality+ML. "On the whole, though, I take the side of amazement."Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCSam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Fangyuan Xu @brunchavecmoi
319 Followers 498 Following 许方园👩🏻💻phd student @ ut austin, interested in nlpTim Dettmers @Tim_Dettmers
28K Followers 819 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Pavel Izmailov @Pavel_Izmailov
6K Followers 1K Following Working on LLM reasoning @OpenAI 🤖 Incoming Assistant Professor @nyuniversity 🏙️ #StopWar 🇺🇦Dubs @DubsUW
22K Followers 10 Following Hi, I’m Dubs! This is my official Twitter account as the University of Washington live mascot 🐾Josephine Teo @joteo_ylm
2K Followers 46 Following Published by and at the direction of Mrs Josephine Teo, Yong Li Min.Niloofar (Fatemeh) Mi.. @niloofar_mire
4K Followers 1K Following Postdoc @uwcse-@uwnlp, Ph.D. from @ucsd_cse /Privacy, ML, NLP, @winlpworkshop chair, @MSFTResearch - Semantic MachinesLP Morency @lpmorency
1K Followers 21 Following Associate Professor at CMU studying multimodal and Social AI. Ice hockey goalie.Paul Liang @pliang279
4K Followers 910 Following PhD student @mldcmu @SCSatCMU. Foundations of multimodal learning & applications in social AI, NLP, and healthcare with @lpmorency and @rsalakhu.Maarten Sap (he/him) @MaartenSap
4K Followers 642 Following Working on #NLProc for social good. Currently at @LTIatCMU, previously at @UWNLP, @MSFTResearch, and @allen_ai. 🏳🌈Luca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai, open source science fan, @QueerInAI organizer 🤖☕️🍕they/themWeijia Shi @WeijiaShi2
5K Followers 963 Following PhD student @uwcse @uwnlp | Visiting Researcher @MetaAI | Undergrad @CS_UCLA | https://t.co/eLBQmgkvymSuchin Gururangan @ssgrn
4K Followers 248 Following he/him Research scientist on Llama team, @meta GenAI prev: PhD @uwcse + @uwnlpJingkang Yang @NTU�.. @JingkangY
1K Followers 551 Following NTU MMLab PhD Student - Reasoning in the Open World. ECCV’22 Best Backpack Award 🎒Charlotte Loh @charlotteloh_
39 Followers 97 Following PhD candidate @ MIT EECS. Interested in self-supervised learning, uncertainty quantification and how AI can advance scientific discoveries.serena khoo @serena_khoo
13 Followers 47 FollowingJason Phang @zhansheng
3K Followers 1K Following Policy Research at @OpenAI. PhD @NYUDataScience, @AiEleuther, 🇸🇬. Prev: @Google, @MicrosoftOfir Press @OfirPress
9K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Josh Gardner @jpgard
327 Followers 270 FollowingJoel Jang @jang_yoel
931 Followers 478 Following PhD student @uwcse. Research Intern at @nvidiaai robotics. Prev: @allen_aiKaiyang Zhou @kaiyangzhou
1K Followers 379 Following Assistant Professor at HKBU. Interested in machine learning & computer vision.Baris Kasikci @bariskasikci
5K Followers 926 Following Professor @uwcse; previously Morris Wellman Professor of EECS @UMichCSE, @MSFTResearch, @intel, @VMware; he/himTogether AI @togethercompute
27K Followers 303 Following The future of AI is open-source. Let's build together.Lisa Schut @miouantoinette
1K Followers 211 Following PhD student @oatml_oxford supervised by @yaringal | previously interned at deepmind, google brain | former professional chess playerDenny Zhou @denny_zhou
9K Followers 416 Following @GoogleDeepMind founder & lead of Reasoning Team. Build LLMs to reason. Opinions my own.Greg Durrett @gregd_nlp
6K Followers 751 Following CS professor at UT Austin. I do NLP most of the time. he/himKelly Buchanan @ekellbuch
789 Followers 1K Following Machine Learning & Computational Neuroscience PhD student @cu_neurotheory. Formerly Research @GoogleAI Brain. Peruvian & AmericanMichael Choi @michaelchchoi
1K Followers 2K Following Assistant Professor @NUSingapore @YaleNUS. Applied probabilist. Probability, MCMC, statistical physics, optimization, information theory, TCS. Opinions my own.UW Data Science @uwdatascience
456 Followers 88 Following Center for Data Science is a hub for experts in data analytics, data management, and data mining. Our mission: societal impact through big data.Siddhartha Srinivasa @siddhss5
4K Followers 19 Following Boeing Endowed Professor in #robotics @uwcse. I’m a full-stack roboticist, tennis player, book reader, & cook. Tweets my own.Elba Garza @heyelbs
1K Followers 467 Following Latina 🇲🇽🇺🇸 Assistant Teaching Prof @uwcse. Computer Architect. ADHD-PI wrangler. Veteran. Former DREAMer. Subtitles user 24/7. Personal opinions, obvs.Qi Lei @Qi_Lei_
3K Followers 1K Following Assistant professor in Math and Data Science, NYU, Postdoc at Princeton ECE, PhD from UT Austin, interested in machine learning, deep learning and optimizationSaining Xie @sainingxie
14K Followers 1K Following researcher in #deeplearning #computervision | assistant professor at @NYU_Courant @nyuniversity | previous: research scientist @metaai (FAIR) @UCSanDiegoMike Shou @MikeShou1
1K Followers 285 Following Asst Prof at NUS. Previously at Facebook AI and Columbia U. Passionate about video, multi-modal, AI assistant.Yifan Zhang @Yifan_Zhang77
36 Followers 529 Following PhD in Computer Science at National University of SingaporeBeidi Chen @BeidiChen
6K Followers 348 Following Asst. Prof @CarnegieMellon, Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.Vaishaal Shankar @Vaishaal
807 Followers 336 Following ML research @ apple. Trying to find artificial intelligence. Opinions are my own.Sachin Goyal @goyalsachin007
761 Followers 714 Following PhD student @ CMU MLD || Microsoft Research || UG @ IIT BombaySam Park @smsampark
321 Followers 347 Following Machine Learning PhD student at MIT, advised by Aleksander Mądry.Hadi Salman @hadisalmanX
5K Followers 317 Following Research Scientist @OpenAI. Previously: PhD @MIT @MSFTResearch @UberATG @SCSatCMU @AUB_Lebanon.@rajivmovva, @PangWeiKoh, and I write for @NatureMedicine on using unlabeled data to improve generalization + fairness of medical AI models: nature.com/articles/s4159… We highlight two nice recent papers illustrating this - nature.com/articles/s4159…, nature.com/articles/s4159….
I am a fifth year phd student yet I still get nervous when i see the little icon in overleaf that shows that my advisor is actively looking at our paper
Honored to receive the 2024 Jane Street Graduate Research Fellowship! Thank you @JaneStreetGroup for the award and for organizing an amazing workshop! The best part of this was getting to meet PhD students working on algebraic geometry, cosmology, quantum algorithms, and more!
Meet Reka Core, our best and most capable multimodal language model yet. 🔮 It’s been a busy few months training this model and we are glad to finally ship it! 💪 Core has a lot of capabilities, and one of them is understanding video --- let’s see what Core thinks of the 3 body…
It is currently PhD visit days at UW. Choosing among schools for a PhD is a tough choice. I wrote a blog post about some ways to think about this choice to make it easier and to find the school that is the best fit for you: timdettmers.com/2022/03/13/how…
I’m really excited to be starting a new adventure with multiple amazing friends & colleagues. Our company is called Physical Intelligence (Pi or π, like the policy). A short thread 🧵
Honored to have been named an AI2050 fellow by Schmidt Sciences. This award recognizes work with a wonderful group of students and collaborators, and I'm very much looking forward to working with the other fellows. news.cornell.edu/stories/2024/0…
𝗛𝗼𝘄 𝗰𝗮𝗻 𝘄𝗲 𝗯𝘂𝗶𝗹𝗱 𝗺𝗼𝗿𝗲 𝗿𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗟𝗠-𝗯𝗮𝘀𝗲𝗱 𝘀𝘆𝘀𝘁𝗲𝗺𝘀? Our new position paper advocates for retrieval-augmented LMs (RALMs) as the next gen. of LMs, exploring the promises, limitations, and a roadmap for wider adoption. arxiv.org/abs/2403.03187 🧵
This morning I'm representing @MIT at the @UN World @WildlifeDay celebration, speaking about how AI now plays a significant role in global scale wildlife conservation in partnership with @WILDLABSNET 🦍🐅🦒🦏🐘🦉
SAVE THE DATE 📅| #WorldWildlifeDay2024 @UN Celebration on Monday, 4 March (10AM-1PM EST) Join our global watch party: webtv.un.org/en/asset/k11/k…
Long overdue but here's a new blogpost on training LLMs in the wilderness from the ground up 😄🧐 In this blog post, I discuss: 1. Experiences in procuring compute & variance in different compute providers. Our biggest finding/surprise is that variance is super high and it's…
Deeply honored to receive the 2024 International Society for Computational Biology (ISCB) Innovator Award! My heartfelt gratitude goes out to my students and collaborators for their contributions in harnessing the transformative power of AI to drive breakthroughs in biomedicine.
The computer vision class at @MIT has nearly doubled in size since just last year!! Looking forward to teaching close to 700 students this term alongside the amazing @vincesitzmann, Mina Konakovic Lukovic, and Kaiming He 😁😁😁
We are excited to share Reka Flash ✨, a new state-of-the-art 21B multimodal model that rivals Gemini Pro and GPT 3.5 on key language & vision benchmarks 📈. We've trained this model from scratch and ground zero with a small (but amazingly capable team 🧙♂️) and relatively finite…
Introducing Reka Flash, our efficient and highly capable multimodal language model. Try it at Reka playground 🛝 for free today. 🧵 Thread, blog & links below 👇
Excited to announce the ICLR 2024 Workshop on Data Problems for Foundation Models (DPFM)! - Topics of Interest: data quality, generation, efficiency, alignment, AI safety, ethics, copyright, and more. - Paper Submission Date: Feb 3, 2024 | Workshop Date: May 11, 2024 (Vienna and…
Extremely happy to announce that I defended my PhD; next week is my first day on the LLaMA team at @Meta GenAI 🥳🦙!! Excited to help build the best open models in the world. To the UWNLP community, thank you for everything. You can watch my defense at youtube.com/watch?v=xNPLT-…
Happy to share In-Context Pretraining 🖇️ is accepted as an #ICLR2024 spotlight. We study how to pretrain LLMs with improved context understanding ability paper📄: arxiv.org/pdf/2310.10638… code: github.com/swj0419/in-con…
Introduce In-Context Pretraining🖇️: train LMs on contexts of related documents. Improving 7B LM by simply reordering pretrain docs 📈In-context learning +8% 📈Faithful +16% 📈Reading comprehension +15% 📈Retrieval augmentation +9% 📈Long-context reason +5% arxiv.org/abs/2301.12652
They rolled out the purple carpet and I couldn’t help myself! 🐾
Excited to finally share that "Impossibility Theorems for Feature Attribution" is published in PNAS. TL;DR Methods like SHAP and IG can provably fail to beat random guessing. w/ @natashajaques @PangWeiKoh @_beenkim PNAS: pnas.org/doi/10.1073/pn… arXiv: arxiv.org/abs/2212.11870
I’m here and ready! 🐾