Aishwarya Kamath @ashkamath20
Research Scientist @GoogleDeepMind. PhD at NYU ashkamath.github.io London, England Joined August 2017-
Tweets321
-
Followers7K
-
Following587
-
Likes3K
Gemini 1.5 is free in AI Studio right now, with 1M context length. 😉 Waitlist should move pretty fast, sign up here: aistudio.google.com/app/waitlist/9…
Gemini 1.5 is free in AI Studio right now, with 1M context length. 😉 Waitlist should move pretty fast, sign up here: aistudio.google.com/app/waitlist/9…
So excited to announce what we've been working on for the past ~year or so: Active Learning Accelerates Large-Scale Visual Understanding We show that model-based data selection efficiently and effectively speeds up classification- and multimodal pretraining by up to 50%
First day as a Research Scientist @GoogleDeepMind ! 🥳🤩 Send in your London recommendations 😁
Personal update - married my best friend last weekend and we had the best day of our lives celebrating with our favourite people! @alcinos26
📢 I am recruiting Ph.D. students for my new lab at @nyuniversity! Please apply, if you want to work on understanding deep learning and large models, and do a Ph.D. in the most exciting city on earth. Details on my website: izmailovpavel.github.io. Please spread the word!
Excited to present our work, "The effectiveness of MAE pre-pretraining for billion-scale pretraining" (arxiv.org/abs/2303.13496) at #ICCV2023 today. Our strong foundational MAWS models, with multilingual CLIP capabilities, are now available publicly at github.com/facebookresear….
✨Excited to announce that Hummingbird, our model for in-context scene understanding, has been accepted as a spotlight at #NeurIPS2023!✨ Work done with fantastic colleagues @GoogleDeepMind: David Steiner, @nikparth1, @relja_work and @olivierhenaff.
Chain-of-Verification Reduces Hallucination in LLMs (work done during my internship at FAIR) - LLMs more likely to hallucinate during longform generation - We show that generating verification questions for the LLM to self-answer allows the model to deliberate on its outputs 🧵
Chain-of-Verification Reduces Hallucination in LLMs (work done during my internship at FAIR) - LLMs more likely to hallucinate during longform generation - We show that generating verification questions for the LLM to self-answer allows the model to deliberate on its outputs 🧵
Happy to be releasing Code Llama! We've built it on Llama 2 and improved it for code use cases. In particular it supports infilling out of the box, and was trained with sequences up to 16k tokens. Looking forward to what the community will build with it! 1/7
Check out or FlexiViT paper, appearing at #CVPR2023! We show that you can train one vision transformer model that works with all patch sizes, allowing you to decide on an accuracy-compute trade off at test time! Paper: arxiv.org/abs/2212.08013 Code: github.com/google-researc…
Check out or FlexiViT paper, appearing at #CVPR2023! We show that you can train one vision transformer model that works with all patch sizes, allowing you to decide on an accuracy-compute trade off at test time! Paper: arxiv.org/abs/2212.08013 Code: github.com/google-researc… https://t.co/KSK68Kif1m
Accepted to #CVPR'23! EditBench brings rigorous evaluation to text-guided image inpainting (images, prompts and masks available at imagen.research.google/editor/). Imagen Editor introduces a simple object-based masking strategy that improves text-image alignment across-the-board.
Accepted to #CVPR'23! EditBench brings rigorous evaluation to text-guided image inpainting (images, prompts and masks available at imagen.research.google/editor/). Imagen Editor introduces a simple object-based masking strategy that improves text-image alignment across-the-board.
Introducing Vid2Seq, a new visual language model for dense video captioning. To appear at #CVPR2023. Work done @Google w/ @NagraniArsha P.H. Seo @antoine77340 @jponttuset I. Laptev J. Sivic @CordeliaSchmid. Page: antoyang.github.io/vid2seq.html Paper: arxiv.org/abs/2302.14115 🧵/5
Excited to see our work on scaling Vision-and-Language Navigation with synthetic instructions accepted to #CVPR'23! Understanding spatial and action-oriented language in 3D environments is still a huge challenge. Even after several years of transfer learning...
Excited to see our work on scaling Vision-and-Language Navigation with synthetic instructions accepted to #CVPR'23! Understanding spatial and action-oriented language in 3D environments is still a huge challenge. Even after several years of transfer learning...
If you work on fine grained vison-language understanding or open world detection, check out our new benchmark TRICD! As the name implies, we expect it to fool the best current models 🙂
If you work on fine grained vison-language understanding or open world detection, check out our new benchmark TRICD! As the name implies, we expect it to fool the best current models 🙂
Can your vision & language model be TRICD? 😜 Check out our new task/dataset 👇
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Danish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Lucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Gowthami Somepalli @gowthami_s
6K Followers 978 Following Grad student @UMDCS. Past: @AIatMeta, @AmazonScience, @IITMadras. Currently working on #Diffusion and #Multimodal understanding. GPU poor. She/her.Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Ross Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceAkari Asai @AkariAsai
11K Followers 650 Following Ph.D. student @uwcse & @uwnlp. NLP. IBM Ph.D. fellow (2022-2023). Meta student researcher (2023-) . ☕️ 🐕 🏃♀️🧗♀️🍳Kayo Yin @kayo_yin
8K Followers 560 Following PhD student @berkeley_ai @berkeleynlp working on interpretability and signed languages. Former @msftresearch @deepmind @carnegiemellon @polytechnique. 🇫🇷🇯🇵Naomi Saphra @nsaphra
7K Followers 1K Following Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. Same username on every lifeboat off this sinking ship.Tim Dettmers @Tim_Dettmers
29K Followers 821 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Divyansh Kaushik @dkaushik96
4K Followers 3K Following Emerging tech and national security. DC/PGH. “An imported Indian immigrant,” @BreitbartNews.Sebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98Shruti Rijhwani @shrutirij
4K Followers 499 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from @LTIatCMU * Amateur woodworker, scuba diver, foosball playerOfir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Mr Collins Harrison @MrCollinsHarri1
641 Followers 668 Following Love yourself enough that other people’s love or hate doesn’t matter to you. You are all you need. i'm a man of Truth and i always put God first in everythingssteevens @Steevens43
159 Followers 5K FollowingSanjoy Chowdhury @schowdhury671
134 Followers 833 Following Student Researcher @google | PhD student @umdcs | Computer Vision, Multi-modal learning | Previously @AdobeResearch, @samsungresearch, @iiit_hyderabadMean Reversion @Mean_Reversion
179 Followers 5K FollowingPaul Lysander @palysander
287 Followers 5K FollowingAaditya ; @Aaditya26082004
531 Followers 7K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈Akshada Sameer Pradha.. @AkshadaSameer
56 Followers 733 Following Associate Research Analyst at @FlatironCCB / @ColumbiaBMEAbhishek Sinha @a7b2_3
278 Followers 665 Following Multi-modality @Google Cloud | Previously Perception @Waymo | MSCS @Stanford Deep learning enthusiast..ardent arsenal fanYashika Badaya ☀️ @YashikaBadaya
370 Followers 1K Following SWE @awscloud, Always thinking, learning | she/her 👩 Opinions my own ✨🧡matrixidentity @neural_nirvana
16 Followers 262 Following˗ˏˋ𝑫𝒐𝒎�.. @DomainsPlace
814 Followers 4K Following #Domains Seller⚡Investing in #DomainNames #InternetProperty #DigitalRealEstate #Investors Buy #Domain Names For #Branding ⋆ #Startup ⋆ #Marketing #DomainForSaleZahra Abbasiantaeb @z_abbasiantaeb
93 Followers 218 Following PhD candidate at @uva_amsterdam, Conversational Search and Information RetrievalSai Rama Rao @Sa1RamaRao
18 Followers 112 FollowingEva Louise Marie Gabr.. @e681554349
9 Followers 3K FollowingShamail @hacklavya
71 Followers 98 Following Nearly everything is really interesting if you go into it deeply enough-Feynman. @Geniucos11
47 Followers 544 FollowingKatie Younglove @katie_younglove
4 Followers 23 Followingocean good time @oceangoodtime
139 Followers 1K FollowingIA Diario @IaDiario
110 Followers 2K Following Soy un aficionado de la Inteligencia artificial que quiere transmitir su increible poder para desatar tu potencial creativo y eficientizar tu trabajo.Nicholas Lourie @NickLourie
137 Followers 287 Following I build things. 🤖 Doing a PhD at @nyuniversity (@CILVRatNYU) on better empirical methods for deep learning and data science. Advised by @kchonyc and @hhexiy.Yinfei Yang @yinfeiy
339 Followers 162 FollowingKarthik Prasad @karthikprassad
89 Followers 982 Following2020ITB093 PRAVIN_KUM.. @2020itb093
1 Followers 78 FollowingAditya Sagavekar @AdityaSagavekar
384 Followers 2K Following Fourth-year engineering student 🎓 | Web development enthusiast (React, JavaScript) 💻 | Passionate about trading (Crypto, Forex) 📈Abhishek 🇮🇳 @Abhishe73544694
1 Followers 172 FollowingMohamed Malhou @MalhouMohamed
10 Followers 137 Following PhD Student at @AIatMeta and @Sorbonne_Univ_, co-supervised by Ludovic Perret, @f_charton and @KristinLauter. AI for MathFabian Mentzer @mentzer_f
2K Followers 204 Following Senior Research Scientist at Google during the day, modular synth guy at night: https://t.co/Ea84aix9PmP VENKATESWARLU @pvenkatpml449
13 Followers 649 Followingjadesola 💖 @jaded_developer
752 Followers 668 Following please this account is personal, don’t follow me if we’re not close. ☁️ cloud girlie🧑🏾🦱, film & data science. I just want to create. 🎨yvon @Zhendenanya
17 Followers 568 Followingquietsmile @quietsmile_hk
14 Followers 826 FollowingGagan Jain @gaganjain1582
53 Followers 747 Following Research Associate @GoogleDeepMind | IIT Bombay'22wangzhuxi666 @wangzhuxi666
93 Followers 4K FollowingJayaram Reddy @Jayaram_Robot10
70 Followers 993 Following Masters Student at Robotics research centre @iiit_hyderabad. Interested in robot learning, long horizon planning and RL. Previously undergrad @iitmadrasKaran @Karan1295634
3 Followers 308 FollowingMitul Gajera @gajeramitulv
756 Followers 3K Following ✧ Software Designer/ Engineer ✧ Early-stage Product/ design partner ✧ Building @zkfi_tech ✧ Early @truflation @NuonFinance and some more below🔗Harsh Desai @dreamerharsh
1 Followers 3K Followingndhillon.eth @ndhillon072
142 Followers 1K FollowingSoumith Chintala @soumithchintala
186K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityDanish Pruthi @danish037
7K Followers 628 Following Faculty at Indian Institute of Science, Bangalore. PhD from @LTIatCMU.Lucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Richard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMindSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Graham Neubig @gneubig
31K Followers 588 Following Associate professor at CMU, studying natural language processing and machine learning.Christopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Gowthami Somepalli @gowthami_s
6K Followers 978 Following Grad student @UMDCS. Past: @AIatMeta, @AmazonScience, @IITMadras. Currently working on #Diffusion and #Multimodal understanding. GPU poor. She/her.Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Ross Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzEdward Grefenstette @egrefen
36K Followers 776 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceColin Raffel @colinraffel
30K Followers 655 Following nonbayesian parameterics, sweet lessons, and random birds. Friend of @srush_nlpNikolay Savinov 🇺�.. @SavinovNikolay
1K Followers 0 Following Research Scientist at @GoogleDeepMind Work on LLM pre-training in Gemini ♊ 10M context length in Gemini 1.5 Pro 📈Yinfei Yang @yinfeiy
339 Followers 162 FollowingFabian Mentzer @mentzer_f
2K Followers 204 Following Senior Research Scientist at Google during the day, modular synth guy at night: https://t.co/Ea84aix9PmRoopal Garg @roopalgarg
380 Followers 724 Following Staff Software Engineer @GoogleAI l @USCViterbi @CSatUSC alumnus | Views are my own | https://t.co/kGdJSTkTlPMonika Wysoczańska @mkwysoczanska
168 Followers 106 Following PhD Student in Multimodal Learning at @WUT_edu | @WiCVworkshop organizer | Visiting Researcher @valeoaiCorentin Dancette @cdancette
294 Followers 212 Following Machine Learning Researcher @Raidium_med. PhD in Deep Learning from Sorbonne Université. Graduated from MS. at @GeorgiaTech and @CentraleSupelec.Sachi Angle @sachiangle
120 Followers 264 Following politely spicy; technical product mngr @audible_comrohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.Gabriel Barth-Maron @gbarthmaron
657 Followers 403 Following Staff Research Engineer @GoogleDeepMind | 🎓 MSc @BrownUniversityDemi Guo @demi_guo_
22K Followers 694 Following Co-founder & CEO @pika_labs | ex @StanfordAILab @HarvardSheng Liu @ShengLiu_
155 Followers 90 Following PostDoc @stanford Ph.D. @nyuniversity @NYUDataScience. | 🤖 #DeepLearning x 💊#Healthcare | 👦🏻 he/him/hisMegan Richards @megan_richards_
124 Followers 288 Following AI Resident @AIatMeta, previously @DukeInnovate. Reliable/Responsible AI.Alaa El-Nouby @alaa_nouby
521 Followers 302 Following Research Scientist at @Apple. Previous: @Meta (FAIR), @Inria, @MSFTResearch, @VectorInst and @UofG . Egyptian 🇪🇬 Deprecated twitter account: @alaaelnoubySahand Sharifzadeh @sahandsharif
2K Followers 780 Following Research Scientist @GoogleDeepMind | GenAI, Multimodal Models, AGIMistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCPIvana Balazevic @ibalazevic
2K Followers 236 Following Research Scientist @GoogleDeepMind. Trying to figure out how to represent knowledge and memory. Formerly @InfAtEd, @MetaAI & @SamsungUK.Sachit Menon @SachitMenon
143 Followers 112 Following Machine learning PhD student @Columbia. Working to make big models not dumb in vision and language. Previously @DukeU; spent time @neuralink @UniofOxfordTaro Makino @taromakino
339 Followers 368 Following ML PhD student at @NYUDataScience advised by @kchonyc and @kjgeras. Interested in causal ML for out-of-distribution generalization.Hanzi Mao @hanna_mao
633 Followers 176 Following Research Scientist @NVIDIA | Ex Research Scientist @AIatMeta (FAIR)mars @hayley_Marsden1
661 Followers 511 FollowingPratyusha Sharma @pratyusha_PS
2K Followers 400 Following PhD student @MIT_CSAIL. Studying 🐳 ,🤖 and language.Amanpreet Singh @apsdehal
3K Followers 621 Following CTO @ContextualAI. Past: @huggingface and @MetaAI.Tristan Thrush @TristanThrush
3K Followers 761 Following PhD-ing @StanfordAILab @stanfordnlp. Advisor @PlaytestAI. Past: @ContextualAI, @huggingface, @Meta FAIR, @mitbrainandcog, @MIT_CSAIL, @NASAJPLChen Zhao @henryzhao4321
634 Followers 348 Following Assistant Professor NYU Shanghai, Postdoc NYU, PhD @umdclip doing NLP research, bridge playerTaylor Swift @taylorswift13
95.4M Followers 0 Following All’s fair in love and poetry... New album THE TORTURED POETS DEPARTMENT. Out now 🤍Fangyu Liu @hardy_qr
1K Followers 1K Following Research Scientist @GoogleDeepMind building Gemini♊. PhD @CambridgeLTL . BMath @UWaterloo . From 成都🐼.Alexander Kirillov @kirillov_a_n
515 Followers 212 Following Multimodal lead @openai. Previously: Research Scientist @facebookaiClaudia Skok Gibbs @cskokgibbs
236 Followers 278 Following PhD candidate @NYUDataScience interested in GRN inference 🧬 | @NSF GR Fellow, intern @genentech, co-organizer @nyuaischool, guest-researcher @FlatironInstYuqing Du @d_yuqing
1K Followers 128 Following Research Scientist @GoogleDeepMind; CS PhD @berkeley_ai; ex-intern @MetaAI, @DeepMind, @TheTeamAtXSebastian Borgeaud @borgeaud_s
997 Followers 260 Following Research Engineer at DeepMind with a focus on Large Language Models and large scale Deep LearningIra Ktena @s0f1ra
1K Followers 506 Following Staff Research Scientist @GoogleDeepMind. Formerly: PhD in Brain Graph Analysis & ML @BioMedIAICL. @EMBO Fellow @ https://t.co/bkMculxBdP. @ecentua alumnus.Adrien Bardes @AdrienBardes
538 Followers 231 Following PhD Student at @MetaAI & @Inria with Yann LeCun and Jean Ponce, interested in self-supervised learning and computer vision.koray kavukcuoglu @koraykv
8K Followers 84 Following VP of Research and Technology at Google DeepMindSoravit “Beer” Ch.. @schangpi
315 Followers 576 Following A computer scientist from Bangkok, Thailand. @GoogleAI. Ex-member of @ShaLabUSC at @CSatUSC & @BrownCSDept. He/Him.Ani Kembhavi @anikembhavi
2K Followers 297 Following Senior Director @allen_ai + Affiliate Assoc Prof @UW 📷 : Visual Prog, Unified-IO, BiDAF 🤖 : ProcTHOR, Objaverse, SPOC 🌎 : SATLAS All views my own.Mark Chen @markchen90
10K Followers 246 Following Head of Frontiers Research at OpenAI. Coach for the USA IOI Team.Jean Tarbouriech @jean_tarbou
408 Followers 194 Following Research scientist @GoogleDeepMind. PhD from @InriaScool @MetaAI. Into RL, scuba diving, footballMukund Sudarshan @SudarshanMukund
156 Followers 84 Following Co-founder @quiltlabs | Founder Fellow @southpkcommons | PhD ML @NYU_CourantAkash Srivastava @variational_i
1K Followers 1K Following Chief Architect, LLM Alignment @IBMResearch. PI @MITIBMLab. ❤️ Density Ratios.Danijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindHannah Sheahan @hannahsheahan
4K Followers 566 Following Engineer & cognitive scientist. Research Engineer @DeepMind. Previously postdoc @UniofOxford, PhD @Cambridge_Uni. she/her. 🥝 in 🇬🇧Nazneen Rajani @nazneenrajani
4K Followers 2K Following Something new 🧪 | Previously: @huggingface 🤗, @SFResearch, PhD @utcompsciToday, we are releasing Mistral Large, our latest model. Mistral Large is vastly superior to Mistral Medium, handles 32k tokens of context, and is natively fluent in English, French, Spanish, German, and Italian. We have also updated Mistral Small on our API to a model that is…
🌟 PhD Thesis Defended 🌟 1️⃣ Title: Unlocking Natural Language Generalization through Adaptive Retrieval-based Methods 2️⃣ Joining Databricks as a Research Scientist w. focus on generative retrieval / RAG 3️⃣ New Blog Post: Advice for PhD Students mrdrozdov.github.io/blog/2024/advi…
Today I am thrilled to announce the project I have been working on for a while, V-JEPA, a vision model solely trained from large-scale video data in a self-supervised way, with a Joint-Embedding Predictive Architecture !
Today we’re releasing V-JEPA, a method for teaching machines to understand and model the physical world by watching videos. This work is another important step towards @ylecun’s outlined vision of AI models that use a learned understanding of the world to plan, reason and…
Excited to contribute to the launch of a model that can answer detailed questions in videos on a context length that I could have barely imagined when starting to work on video question answering a few years ago 😃 See the report for more details storage.googleapis.com/deepmind-media…
As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.
I was leading long context in Gemini for a while now, and today I’m proud to share what the team has achieved: over 1M context in a large-scale foundation model. Big shoutout to @TeplyashinDenis and @machelreid - without you this would not have happened! youtube.com/watch?v=wa0MT8…
Super proud of our new work on memory consolidation for long video understanding! Great collaboration with amazing colleagues, resulting in a paper with 3 female joint first authors 🎉
Humans and animals reason about events spanning days, weeks, and years, yet current CV systems live largely in the present. Introducing Memory-Consolidated ViT, whose context extends far into the past and sets a new SOTA in long-video understanding with a 10x smaller model
Encoding videos spatiotemporally as a long seq using ViT demonstratably improves performance, but frame-level representations remain the go-to due to memory and computational constraints... Well, this is no longer the case with a non-parametric memory requiring minimal training!
Humans and animals reason about events spanning days, weeks, and years, yet current CV systems live largely in the present. Introducing Memory-Consolidated ViT, whose context extends far into the past and sets a new SOTA in long-video understanding with a 10x smaller model
A few months ago… we started a lifelong collaboration between the Raman Lab at MIT and the Flynn Lab at Harvard! @raflynn5 🤍
Thrilled to announce @IsomorphicLabs collaborations with @EliLillyandCo & @Novartis potentially worth nearly $3 billion. These target-based programs represent just the start of the phenomenal real-world impact AI will have in accelerating drug discovery: bit.ly/3TUIaB5
Extremely excited to announce our Series B! We really appreciate the trust of our investors and users in giving us an opportunity to advance our mission of building the best answer engine!
We are happy to announce that we've raised $73.6 million in Series B funding led by IVP with participation from NVIDIA, NEA, Bessemer, Elad Gil, Jeff Bezos, Nat Friedman, Databricks, Tobi Lutke, Guillermo Rauch, Naval Ravikant, Balaji Srinivasan.
A lot of people confuse fast fashion with cheap clothing. It's true that fast fashion is cheap, but not all cheap clothing is fast fashion. The two terms are not synonymous. Fast fashion is a very distinctive thing. 🧵
it is incredibly humbling to be mentioned alongside such great companies! a testament to hard work and dedication of the @perplexity_ai team
Poster sessions aren't something the public usually sees, but they're the heart and soul of the AI research community. Behind every AI breakthrough you'll find ten thousand backpack-clad nerds milling around and complimenting each other's scatterplots, it's a beautiful thing.
Poster sessions @NeurIPSConf
As a PhD student and RS, FAIR was a magical place to be in: - incredible mentoring in all fields of AI🧑🏫 - access to resources and having my own research agenda 🧭 - free and encouraged to publish and open source 📖 For a lot of us there it was a transformative experience 🧑🏻🚀
@ylecun Meta has definitely been the best thing to happen to AI.
So excited to announce what we've been working on for the past ~year or so: Active Learning Accelerates Large-Scale Visual Understanding We show that model-based data selection efficiently and effectively speeds up classification- and multimodal pretraining by up to 50%
Our latest release @MistralAI Mixtral 8x7B mixture of experts - performance of a GPT3.5 - inference cost of a 12B model - context length of 32K - speaks English, French, Italian, German and Spanish Blog post mistral.ai/news/mixtral-o…
I attend #NeurIPS2023 to present 3 papers, and would love to have a coffee chat!🤗 1. VPGen&VPEval vp-t2i.github.io nips.cc/virtual/2023/p… 2. SeViLA arxiv.org/abs/2305.06988 nips.cc/virtual/2023/p… 3. Paxion (Spotlight) arxiv.org/abs/2305.10683 nips.cc/virtual/2023/p…
Excited to be back in New Orleans to present my final PhD work VidChapters @NeurIPSConf on Thursday afternoon 🎷 Also catch me at the @GoogleDeepMind « Chat with the Gemini Team » events on Tuesday & Wednesday 💎 #NeurIPS2023
🚨 Introducing VidChapters-7M, a large-scale dataset of user-chaptered videos. To appear at #NeurIPS2023 D&B. Work done @Inria w/ @NagraniArsha I. Laptev J. Sivic @CordeliaSchmid Webpage: antoyang.github.io/vidchapters.ht… Paper: arxiv.org/abs/2309.13952 Code: github.com/antoyang/VidCh… 🧵/5