Olivier Hénaff @olivierhenaff
Staff Research Scientist @GoogleDeepMind, interested in active, multimodal, and memory-augmented learning. Formerly @NYU_CNS and @Polytechnique olivierhenaff.com London, UK Joined May 2019-
Tweets129
-
Followers2K
-
Following222
-
Likes328
Latest work where we present OpenEQA, a modern embodied Q&A benchmark which tests multiple capabilities such as spatial reasoning, object recognition and world knowledge on which SOTA VLMS like GPT4V/Claude/Gemini fail. A new challenge for embodied AI! To be presented @CVPR.
Latest work where we present OpenEQA, a modern embodied Q&A benchmark which tests multiple capabilities such as spatial reasoning, object recognition and world knowledge on which SOTA VLMS like GPT4V/Claude/Gemini fail. A new challenge for embodied AI! To be presented @CVPR.
The New York Times Style section everyone. Eid Mubarak!
This was such a good time, and a nice opportunity to reflect on why I think AI research can be used to deepen our understanding of the human experience. Thanks so much @misssaxbys for inviting me and @JoshuaWohle for hosting!
This was such a good time, and a nice opportunity to reflect on why I think AI research can be used to deepen our understanding of the human experience. Thanks so much @misssaxbys for inviting me and @JoshuaWohle for hosting!
Super excited to chat with @misssaxbys about brains, machines, vision, memory, and art and what they can all learn from each other tomorrow at the @MindstoneHQ AI meetup tomorrow. Do stop by if you're in London! app.mindstone.com/mindspace/mind…
Encoding videos spatiotemporally as a long seq using ViT demonstratably improves performance, but frame-level representations remain the go-to due to memory and computational constraints... Well, this is no longer the case with a non-parametric memory requiring minimal training!
Encoding videos spatiotemporally as a long seq using ViT demonstratably improves performance, but frame-level representations remain the go-to due to memory and computational constraints... Well, this is no longer the case with a non-parametric memory requiring minimal training!
Google Deepmind presents Memory Consolidation Enables Long-Context Video Understanding paper page: huggingface.co/papers/2402.05… Most transformer-based video encoders are limited to short temporal contexts due to their quadratic complexity. While various attempts have been made to…
DeepMind presents MC-ViT Sets a new SotA in long-context video understanding, outperforming methods that benefit from orders of magnitude more parameters arxiv.org/abs/2402.05861
Super proud of our new work on memory consolidation for long video understanding! Great collaboration with amazing colleagues, resulting in a paper with 3 female joint first authors 🎉
Improvements from using longer context is unsurprising, but we found a way to do it ✨in style✨ with x10 memory savings with greater perf gain. A super fun and rewarding experience working with Ivana Balazevic (@ibalazevic) and Olivier Henaff (@olivierhenaff) and many more!
Improvements from using longer context is unsurprising, but we found a way to do it ✨in style✨ with x10 memory savings with greater perf gain. A super fun and rewarding experience working with Ivana Balazevic (@ibalazevic) and Olivier Henaff (@olivierhenaff) and many more!
🤔 Weight averaging is great, but can you merge arbitrary trained models? Our #ICLR2024 spotlight shows that you can - and should! For example, we find that weak models have unique knowledge missed by bigger and better ones, and careful integration can make them even stronger!
Bring your AI knowledge right up to date as @graphcoreai's Charlie Blake shares the latest 'Papers of the Month': Great teachers, beyond Chinchilla, improving diffusion training and Olympiad geometry.distillationpod.buzzsprout.com/2277524/144277…
Summer Research Internships in Computational Neuroscience @FlatironCCN Graduate students and advanced undergraduates: Spend a summer doing research at the Flatiron Institute in NYC! Application deadline 2 Feb 2024: apply.interfolio.com/137388
Welcome back Nikhil!!
A bit belated, but happy to share that I defended my PhD thesis! Thanks to my advisor @EeroSimoncelli for all the support along the way! This week I'm excited to start a new chapter as a Research Scientist @GoogleDeepMind building models of vision with @olivierhenaff and others!
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
Lucas Beyer (bl16) @giffmana
56K Followers 446 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Patrick Mineault @patrickmineault
19K Followers 3K Following Neuro AI, vision, Python, open science. Senior ML scientist @ Mila. Previously engineer @ Google, Meta. Updates from https://t.co/d0o7cSLC6o, https://t.co/duh0cFwLyw
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Thomas Kipf @tkipf
25K Followers 1K Following AI Research at @GoogleDeepMind. Ex-Physicist. Graph Neural Networks & Controllable Generative Models (e.g. GCNs, Structured World Models, Slot Attention).
Shahab Bakhtiari @ShahabBakht
3K Followers 1K Following || assistant prof @UMontreal || leading the systems neuroscience and AI lab (SNAIL) || @Mila_Quebec || #NeuroAI || vision and learning in brains and machines
Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpress
Dima Damen @dimadamen
8K Followers 644 Following Professor of Computer Vision, University of Bristol - passionate about the temporal stream in our lives.
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
Tim Kietzmann @TimKietzmann
11K Followers 3K Following ML meets Neuroscience #NeuroAI, Full Professor at the Institute of Cognitive Science (@UniOsnabrueck), prev. @DondersInst, @Cambridge_Uni #neuroconnectionism
Yuki @y_m_asano
3K Followers 683 Following Assistant Professor for Computer Vision and Machine Learning at the QUVA Lab, @UvA_Amsterdam. Previously @Oxford_VGG, @OxfordAI, interned @facebookai
Andreas Kirsch 🇮�.. @BlackHC
9K Followers 5K Following Past: 🧑🎓 DPhil @AIMS_oxford @ExeterCollegeOx @UniofOxford (4.5yr) 🧙♂️ RE @DeepMind (1yr) 📺 SWE @Google (3yrs) 🎓 @TU_Muenchen 👤 Fellow @nwspk
Tony Zador @TonyZador
11K Followers 2K Following Neuroscientist at CSHL. Interests: neuroAI, molecular connectomics, & cortical circuits underlying decisions. Co-founder of Cosyne and NAISys meetings.
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Esmeralda Potocnik @EsmeraldaP61120
78 Followers 5K Following
Michal Valko @misovalko
5K Followers 2K Following Llama @AIatMeta Paris & Inria & MVA - Ex: Gemini and BYOL @GoogleDeepMind
Camille Jongsma @jongs_cami
21 Followers 3K Following
Esme-rose Beeghly @BeeghlyEsm10794
70 Followers 5K Following
Sarah @cripstoph
10 Followers 383 Following
Ela Shreeves @ElaShreeve96430
39 Followers 5K Following
Kortney Castellanos @KortneKortney
61 Followers 5K Following
Tasour @TasourR
41 Followers 355 Following Error code: 0xF2024 (Lost in the virtual world). Backup failed. All data lost.
Volodymyr Volkov @lepricon85
21 Followers 416 Following
Diego Guerra @diegoguerror
76 Followers 556 Following Consultant @McKinsey by day. Bag packer on the weekends. @Wharton alumnus. AI and VC. 🇲🇽 living the dream 🗽. He/him. Views my own
Vera Tarwater @VerTarwat
45 Followers 5K Following
Hien Hoefflin @hoeff_hi
56 Followers 5K Following
Sylvain Peyronnet @sylvain_babbar
333 Followers 242 Following I live by and for the algorithms. Currently CEO at @babbartech (also @yourtextguru). French account can be found here: @speyronnet
Nish Sinha @SonchonSinha
13 Followers 234 Following
AI World News🤖💕 @TheWorldNews
56K Followers 9K Following The first rule of AI club is, We Don't Talk About AI Club! The second rule of AI Club is......
Pensivy Ewen @PensivyE65820
9 Followers 60 Following
Nefel Tellioglu @nefeltellioglu
91 Followers 141 Following PhD Student at @unimelb studying epidemiological dynamics of infectious diseases. BSc/MSc in Industrial Engineering at @UniBogazici
Omar Sanseviero @osanseviero
32K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽
Marlo Ibale @IbaleIba
60 Followers 5K Following
Latesha Gimar @lates_gi
58 Followers 5K Following
_ @FUCK_CCTV
6 Followers 3K Following
Leveur martin @LeveurM
0 Followers 161 Following
Joel Ye @_JoelYe
345 Followers 540 Following NeuroAI PhD student @CarnegieMellon. Being a brain-computer interface.
BruceXu @bbbrucex333
3 Followers 26 Following Computer Engineering PhD @ UC Santa Barbara | Working on Efficient MLs and LLMs
Liew Zheng Jie @lyleliewzj
9 Followers 7 Following
Metawade @Metawade2024
101 Followers 492 Following
Luigi Acerbi @AcerbiLuigi
2K Followers 487 Following Asst. Prof. of Machine & Human Intelligence @UnivHelsinkiCS @FCAI_fi | Bayesian ML & probabilistic modeling of behavior — currently hiring PhDs/postdocs
Albert Vilella @AlbertVilella
21K Followers 8K Following Next-Generation Sequencing, Single-Cell and Spatial Biology, Next-Generation Proteomics, Synthetic Biology, Compute Acceleration in Biotech.
Johan S. Obando 👍�.. @johanobandoc
1K Followers 2K Following Graduate student @Mila_Quebec @UMontrealDIRO | RL/Deep Learning/AI | De Cali/Colombia pal’ Mundo 🇨🇴 | #JuntosProsperamos⚡#TogetherWeThrive| 🌱🌎
long paul e/acc @fakevisioning
32 Followers 544 Following
MMM @MMM1897775
9 Followers 806 Following
Mahmoud A. Basiouny @basiouny_a
76 Followers 387 Following Working on a better bio .. Music is a must! .. Bayern munich!..
GigA ShLЁpA e/acc �.. @gigaAcc
6 Followers 302 Following MSc of math & physics with a gap. My enemy is DEATH — goal is to WIN.
Babak Taati @Babak_Taati
1K Followers 2K Following Senior Scientist @KITE_UHN. Also at @UOFTCompSci and @bme_uoft. All my tweets are certified Y2K compliant.
吴lucky @lucky_town720
0 Followers 120 Following
Rushikesh Zawar @ZawarRushikesh
15 Followers 263 Following
K Z @KZpunkurt
20 Followers 1K Following On a mission to bring AI to the edge and make our world smarter and more efficient 🤖 Enthusiastic futurist and self-growth aficionado! 🌟
GyuBin Lee @gyubin0521
73 Followers 2K Following
Eyup Cinar @dreyupc
131 Followers 772 Following Assoc. Prof. (Docent), @FulbrightPrgrm Fellow, researcher of A.I. from Industry, @RITtigers alum, Ex-Silicon Valley engineer, academician, https://t.co/Lohyvb57dl
Andrej Karpathy @karpathy
980K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Oriol Vinyals @OriolVinyalsML
167K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.
Michael Black @Michael_J_Black
59K Followers 643 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
NeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
Thomas Kipf @tkipf
25K Followers 1K Following AI Research at @GoogleDeepMind. Ex-Physicist. Graph Neural Networks & Controllable Generative Models (e.g. GCNs, Structured World Models, Slot Attention).
Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸
Jeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @Stanford
Andrew Ng @AndrewYNg
1.0M Followers 913 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @Balderton
Tim Kietzmann @TimKietzmann
11K Followers 3K Following ML meets Neuroscience #NeuroAI, Full Professor at the Institute of Cognitive Science (@UniOsnabrueck), prev. @DondersInst, @Cambridge_Uni #neuroconnectionism
Yuki @y_m_asano
3K Followers 683 Following Assistant Professor for Computer Vision and Machine Learning at the QUVA Lab, @UvA_Amsterdam. Previously @Oxford_VGG, @OxfordAI, interned @facebookai
Michal Valko @misovalko
5K Followers 2K Following Llama @AIatMeta Paris & Inria & MVA - Ex: Gemini and BYOL @GoogleDeepMind
Sampriti Bhattacharyy.. @sampritibh
5K Followers 340 Following CEO & Founder @navierboat Roboticist🤖. Ex @ NASA🚀. MIT PhD'17. Building electric flying boats 🌊🚤
Fauna Robotics @faunarobotics
730 Followers 18 Following
Daniel Jeffries @Dan_Jeffries1
22K Followers 1K Following I'm an author, futurist, thinker and systems architect.
Jason Carman @jasonjoyride
21K Followers 2K Following Launching satellites @astranis & weekly startup documentaries via S³
Noor Siddiqui @noor_siddiqui_
8K Followers 984 Following Helping everyone have a healthy baby @OrchidInc Prev Stanford CS, AI Lab, @thielfellowship
David Park @Davidjpark96
31K Followers 305 Following ceo @ jenni ai (3m users) tweets about growth and my startup learnings!
Devi Parikh @deviparikh
23K Followers 151 Following Former Sr. Director, GenAI @Meta. Prof @GeorgiaTech. Generative artist https://t.co/z4n9IRQ3s5. Co-founded Caliper. @CarnegieMellon @RowanUniversity alum.
Dan Hendrycks @DanHendrycks
17K Followers 81 Following • Director of the Center for AI Safety (https://t.co/ahs3LYCpqv) • GELU/ImageNet-C/MMLU/safety groundwork • PhD in AI from UC Berkeley https://t.co/rgXHAnYAsQ https://t.co/YtGtDh1aAV
Eleanor Warnock @misssaxbys
7K Followers 2K Following Writes stuff. Previously @siftedeu @atomico, @insead MBA, @wsj tokyo. Tweets about VC/Japan/journalism/Pokémon.
Asha Easton @AshaMarie18
2K Followers 2K Following Innovation | Immersive Tech | XR | Spatial Computing | ED&I | Ecosystem Builder | Connector | International Speaker | Leading @IUK_Immersive | Co-Founder @XRDI_
lmsys.org @lmsysorg
38K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtm
Martin Signoux @MartinSignoux
2K Followers 1K Following Public policy @Meta - Interested in #AI #XR #competition #IP / Tweeting in my own capacity
David @DavidSHolz
54K Followers 5K Following founder @midjourney, prev founder leap motion, nasa, max planck
Symmetry and Geometry.. @neur_reps
3K Followers 1K Following NeurIPS workshop and digital community | 🌐 geometry, algebra, topology + 🤖 deep learning + 🧠 neuroscience | Join us on slack! https://t.co/Run9wPnZt9
Machine Learning for .. @ML4CDworkshop
1K Followers 0 Following The official Twitter for the NeurIPS Workshop on Machine Learning for Creativity and Design 🎨
Chentian Jiang @chentian_jiang
211 Followers 228 Following PhD student @InfAtEd. Previously research intern @GoogleDeepMind. Working on world models, reinforcement learning, causality and generalization.
Together AI @togethercompute
27K Followers 304 Following The future of AI is open-source. Let's build together.
Sara Beery @sarameghanbeery
11K Followers 3K Following Research on computer vision and the environment 🌍 Asst Prof at @MIT_CSAIL #QueerInAI 🏳️🌈 sarabeery on threads @[email protected]
Talfan @talfanevans
341 Followers 908 Following Denoising, all the way down. Research scientist at @Deepmind, views my own. 🏴
Harini Suresh @harini824
5K Followers 488 Following incoming assistant professor @BrownUniversity / postdoc @cornell / previously @mit / thinking about participatory + equitable + accountable ML
Chenlin Meng @chenlin_meng
8K Followers 833 Following Co-founder & CTO @pika_labs | ex @StanfordAILab @Stanford
Celine Halioua @celinehalioua
31K Followers 3K Following Founder + CEO @loyalfordogs 🐶 Working on aging drugs! Longevity Fund, @UniofOxford health econ, @UTAustin neuroscience. Write to learn things.
Pika @pika_labs
116K Followers 53 Following Video on command. Website: https://t.co/G5bjmrMQsx Discord: https://t.co/bX68ThPTQH About: https://t.co/atvdcgbe9S
Avi @AviSchiffmann
77K Followers 3K Following
Nassim Nicholas Taleb @nntaleb
1.0M Followers 2K Following Flaneur: probability (philosophy), probability (mathematics), probability (real life),Phoenician wine, deadlifts & dead languages. Greco-Levantine.Canaan. #RWRI
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
SpaceX @SpaceX
34.6M Followers 113 Following SpaceX designs, manufactures and launches the world’s most advanced rockets and spacecraft
Reka @RekaAILabs
11K Followers 13 Following An AI research and product company 🫠. We are a team of scientists and engineers building state-of-the-art multimodal language models 😻
Chris Albon @chrisalbon
86K Followers 2K Following Director of Machine Learning at the Wikimedia Foundation. We host Wikipedia.
Kenneth D Harris @kennethd_harris
6K Followers 113 Following Neuroscientist at University College London
Caswell Barry @caswellcaswell
3K Followers 523 Following Neuroscientist interested in representations of space & memory. Using tools from experimental & theoretical neuroscience as well as machine learning. @ucl
#CVPR2024 @CVPR
41K Followers 329 Following Official account for IEEE/CVF Conference on Computer Vision & Pattern Recognition. #CVPR2024 🇺🇸 hosts @CSProfKGD @abby621 @jbhuang0604 @hi_ice_boy @BoqingGo
UCL_NeuroAI @UCL_Neuro_AI
941 Followers 15 Following UCL NeuroAI community. Also on [email protected]
Michael Eisen @mbeisen
77K Followers 15K Following I science & try to make science open. Tweets do not represent my employer's views, but are always correct. My conflicts of interest https://t.co/bZ7I9oSJe0.
Eero Simoncelli @EeroSimoncelli
617 Followers 71 Following Professor at NYU; Scientific Director, Ctr for Computational Neurocience, Flatiron Institute. Research in Computational Vision (neurons, perception, machines).
Molly White @molly0xFFF
116K Followers 2K Following crypto researcher & critic, software engineer, wikipedian • @web3isgreat creator • subscribe to my newsletter at https://t.co/WftJCrCfSY
Vayu Robotics @VayuRobotics
2K Followers 108 Following We are building environmentally sustainable and scalable robotics solutions.
Nancy Kanwisher @Nanc.. @Nancy_Kanwisher
11K Followers 574 Following
Refik Anadol @refikanadol
135K Followers 2K Following Media Artist & Director at RAS. Embedding media arts into architecture with data and machine intelligence for public art.
Mariel Pettee @marielpettee
641 Followers 661 Following Postdoctoral fellow in AI for fundamental physics @BerkeleyLab & @CERN. Performing artist working with AI. PhD @Yale, prev. @Harvard & @Cambridge_Uni.
"To be frontier you first need to be be pareto-frontier". ~ First law of LLM training. 😃
@pmarca Ridiculous for a mere 5% of the world population, all located in the North American landmass. Totally natural for the 95% of the world population. You too can join the 21st Century.
The New York Times Style section everyone. Eid Mubarak!
Latest work where we present OpenEQA, a modern embodied Q&A benchmark which tests multiple capabilities such as spatial reasoning, object recognition and world knowledge on which SOTA VLMS like GPT4V/Claude/Gemini fail. A new challenge for embodied AI! To be presented @CVPR.
Today we’re releasing OpenEQA — the Open-Vocabulary Embodied Question Answering Benchmark. It measures an AI agent’s understanding of physical environments by probing it with open vocabulary questions like “Where did I leave my badge?” More details ➡️ go.fb.me/7vq6hm…
@arimorcos @NandoDF That’s a weird take. Don’t you think griffin is a cool new model, and the data is the usual stuff?
No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance Web-crawled pretraining datasets underlie the impressive "zero-shot" evaluation performance of multimodal models, such as CLIP for classification/retrieval and Stable-
@giffmana @srush_nlp @CVPR If you want real-time performance, particularly for detection/localization, ConvNets are still way more practical/efficient than ViTs.
@karpathy I think you are rediscovering the concept of “vacation”.
I’ll give a talk about UViM (and similar methods X-Decoder, UnifiedIO, etc), RL-tuning in vision and maybe PaLI. Very relevant to recent LLM+vision I’ll do my best to make the general idea as accessible as possible rather than saying “here’s our method, it’s sota, look, tables”
Announcing 📢 a special ZurichCV Meetup #2! Lucas Beyer @giffmana from @GoogleDeepMind will be speaking about structured computer vision in the age of LLMs on April 16th at 17:00. Come check it out! 🚀 zurich-nlp.ch/event/zurichcv…
Straight to perf. No detours. I’m not even finishing my current dota game.
@giffmana doing tge heavy lifting for gemini's pr team
@giffmana +1 for this! I always point people to the FixRes paper. Also surprising that we don't consider resolution more given the capabilities of human peripheral vs foveal vision... But ofc the right thing to do is to move to resolution adaptive architectures like NaViT and FlexiViT.
@pmddomingos Suddenly, many of your tweets look like jokes, Pedro.
I’m thrilled to unveil @Waabi_ai latest research, Copilot4D: the first foundation model that explicitly reasons in both 3D space and time and leverages LiDAR. Big step forward in bringing generative AI to the physical world. Learn more here: waabi.ai/introducing-co…
Amazing fireside chat at the @MindstoneHQ London AI meetup as always with @misssaxbys and @olivierhenaff :)
Discussing memory, art + what AI can teach us about human perception and the mind in a church ⛪️ was certainly a career highlight. A huge thank you to @olivierhenaff for sharing your insights and @JoshuaWohle for having us
Discussing memory, art + what AI can teach us about human perception and the mind in a church ⛪️ was certainly a career highlight. A huge thank you to @olivierhenaff for sharing your insights and @JoshuaWohle for having us
Today, I am very proud share what we have been working on for the last 14 months. ✨ Introducing Aya -- a new state-of-art for massively multilingual models. 🔥🎉
Today, we’re launching Aya, a new open-source, massively multilingual LLM & dataset to help support under-represented languages. Aya outperforms existing open-source models and covers 101 different languages – more than double covered by previous models. cohere.com/research/aya
@neilhoulsby @YugeTen @ibalazevic @olivierhenaff It’s already happening :)
@YugeTen @ibalazevic @olivierhenaff Very nice, bravo Jimmy and collaborators👏 Only thing, I am a little disappointed in those parameter counts, you gotta pump those numbers up!
@olivierhenaff @ibalazevic @YugeTen @pinelopip3 @Rahma_Chaa @skandakoppula Hi, really cool work! Some questions: - the evaluation datasets consist of ~158 frames (Diving48), 3 min (EgoSchema), 44 seconds (Next-QA), etc. How is that "far into the past"? Isn't this still very short-term? - any plan to open-source the work which would 🚀🚀 the impact?
Implementing this on my GitHub
Humans and animals reason about events spanning days, weeks, and years, yet current CV systems live largely in the present. Introducing Memory-Consolidated ViT, whose context extends far into the past and sets a new SOTA in long-video understanding with a 10x smaller model
Trends for United States
You might like
