Cees Snoek @cgmsnoek
Head of Video & Image Sense Lab | University of Amsterdam | Director @Ellis_Amsterdam | Scientific Director Amsterdam AI CeesSnoek.info Mostly Amsterdam Joined August 2008-
Tweets3K
-
Followers4K
-
Following2K
-
Likes3K
How can one easily teach caption-pretrained VLMs to localize objects? We show that a small Positional Insert (PIN) can unlock object localization abilities without annotated data on frozen autoregressive VLMs. #CVPR2024 📝: arxiv.org/abs/2402.08657 🌐: quva-lab.github.io/PIN/
Last week I gave my lecture on Parameter-Efficient Finetuning (PEFT) at the @UvA_IvI MSc in AI - Foundation Models course! Find the slides here: dropbox.com/scl/fi/gngd55q… and the rest of our course with @cgmsnoek: uvafomo.github.io
Our #CVPR2024 paper explores low-resource tasks in computer vision and their challenges for foundation models. By collecting a new benchmark of genuinely low-resource image data we see tasks share the challenges of data scarcity, fine-grained differences and specialized domains
📢 New #Master #AI course on #Foundation #Models. We consider fundamental algorithmic questions concerning their #multimodal #learning and #reasoning abilities, as well as the #ethical, #legal, and #social aspects of their deployment in society. uvafomo.github.io
Models are the new data! We could hit over 2M AI models @huggingface by 2025. How can we leverage all that data? The answer is obvious: Deep Learning! Let the neural network learn from neural networks. 1/n
🔍How can we design neural networks that take neural network parameters as input? 🧪Our #ICLR2024 oral on "Graph Neural Networks for Learning Equivariant Representations of Neural Networks" answers this question! 📜: arxiv.org/abs/2403.12143 💻: github.com/mkofinas/neura… 🧵 [1/9]
ZigMa Zigzag Mamba Diffusion Model The diffusion model has long been plagued by scalability and quadratic complexity issues, especially within transformer-based structures. In this study, we aim to leverage the long sequence modeling capability of a State-Space
Congratulations Dr. @artemmoskalev 🥳
Congratulations Dr. @MohsenFyz with your summa cum laude defense at University of Bonn 👏
#FoMo winterschool last day 🥲 but plenty of good speakers left. Local hero @wellingmax starts on fluids and representations.
Finally we have a video-native lecture at the #FoMo winterschool, by @HildeKuehne
The #FoMo saga continues today we kick-off with generative modeling by @TimSalimans 🤩
Wrap-up of day 2 at our @ELLISforEurope winter school on Foundation Models: our poster session with drinks and Dutch borrel! Seriously strong research here. Also check out our amazing t-shirts :)
#FoMo talk #3: local NLP-rockstar @raquel_dmg on large language models and human cognition 🤩
#FoMo talk #2: the one and only @HochreiterSepp
Talk #2 by Thomas Wolf from @huggingface #FoMo Winterschool Amsterdam #Open #Source #AI
@Ellis_Amsterdam ELLIS Winter school on Foundation Models kicking off! Happy to have a super diverse students with us in Amsterdam. @ELLISforEurope
Kosta Derpanis @CSProfKGD
48K Followers 198 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chair
Dima Damen @dimadamen
8K Followers 644 Following Professor of Computer Vision, University of Bristol - passionate about the temporal stream in our lives.
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
#CVPR2024 @CVPR
41K Followers 329 Following Official account for IEEE/CVF Conference on Computer Vision & Pattern Recognition. #CVPR2024 🇺🇸 hosts @CSProfKGD @abby621 @jbhuang0604 @hi_ice_boy @BoqingGo
Yuki @y_m_asano
3K Followers 681 Following Assistant Professor for Computer Vision and Machine Learning at the QUVA Lab, @UvA_Amsterdam. Previously @Oxford_VGG, @OxfordAI, interned @facebookai
Sindy Löwe @sindy_loewe
3K Followers 361 Following PhD Student with @WellingMax at the University of Amsterdam. Deep Learning with Structured Representations.
Laura Leal-Taixe @lealtaixe
10K Followers 118 Following Senior Research Manager at @NVIDIA. Prev Professor at @TU_Muenchen. Computer Vision mostly. Views are my own.
Autonomous Vision Gro.. @AutoVisionGroup
12K Followers 371 Following Awesome Vision Group of Andreas Geiger at the University of Tübingen. We are excited about Computer Vision, Machine Learning and Robotics.
Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeV
Max Welling @wellingmax
32K Followers 429 Following
F. Güney @ftm_guney
7K Followers 1K Following research on computer vision, teaching, and movies. asst. prof. @KuisAICenter @kocuniversity tweets in TR, EN
Andrei Bursuc @abursuc
7K Followers 1K Following Research scientist @valeoai | Teaching @Polytechnique @ENS_ULM | Alumni @upb1818 @Mines_Paris @Inria @ENS_ULM
Christian Wolf @chriswolfvision
7K Followers 1K Following Principal Scientist at @NaverLabsEurope, Lead of Spatial AI team. AI for Robotics, Computer Vision, Machine Learning. Austrian in France. IEEE-PAMI area editor.
Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSci
Efstratios Gavves @egavves
2K Followers 562 Following Associate Professor & Co-Founder - Temporal Learning & Neural Dynamics
Victor Escorcia @3scorciav
2K Followers 1K Following AI Researcher @samsungresearch Cambridge 🇬🇧 Ph.D. @KAUST_Alumni. Ex. @AdobeResearch @Qualcomm_EU. Latino 🇨🇴 Let go FOMO by sharing thoughts
Makarand Tapaswi @MakarandTapaswi
1K Followers 530 Following Senior ML Scientist @WadhwaniAI | Assistant Professor @IIIT_Hyderabad | Opinions my own
Taco Cohen @TacoCohen
21K Followers 3K Following Deep learner at FAIR. Into codegen, equivariance, generative models. Spent time at Qualcomm, Scyfer (acquired), UvA, Deepmind, OpenAI.
Jan van Gemert @jan_gemert
1K Followers 337 Following Head of the Computer Vision Lab @ TU Delft. Visual Inductive Priors for data efficient Deep Learning.
ELLIS Amsterdam @Ellis_Amsterdam
1K Followers 258 Following Twitter account of the ELLIS Amsterdam Unit. Promoting research excellence and advancing breakthroughs in AI. Maintainers: @pranindiati, @cgmsnoek
Delois Hitchen @DeloisHitc59357
85 Followers 5K Following
Blair Rizas @BlRiza
32 Followers 5K Following
Alessia Bathrick @BathrAles
55 Followers 5K Following
Henriette Dilling @HenrietteD31645
90 Followers 5K Following 🌷Do whatever you want with me . Arizona . 24🌽
Thaha Mohammed @research_bod
7 Followers 379 Following Solutions Architect | Computer Vision | Video Analytics | Deep Learning |Product development & AI enthusiast |
Zaryab Akram @zaryabmakram
27 Followers 665 Following A CS undergrad with interests in Machine Learning and Deep Learning. Currently, I am learning and so is my machine.
Esther Berry @BerryEsthe58848
2 Followers 66 Following
GJ Raza @GjDoesML
14 Followers 649 Following Full Stack Deep Learning Engineer | Building AI Products that create value. I talk about #AI #IoT #ML
Haya Walters @haya_walte51462
68 Followers 5K Following
Abhinav Gupta @backpropper
799 Followers 5K Following phd student @Mila_Quebec | ms @CILVRatNYU @NYU_Courant | previously @GoogleDeepMind @AIatMeta @GoogleAI @labsdotgoogle @MSFTResearch @AdobeResearch
Namitha Guruprasad @gnam1410
33 Followers 419 Following PhD @JohnsHopkins | MSc @ualberta | BE - VTU Computer vision I am interested in pixels
Muizz @muizzkhan77
31 Followers 1K Following
Huy Hoàng Lê @Splendor1811
10 Followers 175 Following
Filipe Laitenberger @FLaitenber23987
0 Followers 7 Following
dig8italX @dig8italX
134 Followers 2K Following dig8italX, the leading artificial intelligence firm that specializes in creating customized AI solutions for businesses.
Manu Gaur @gaur_manu
72 Followers 661 Following Doing matrix multiplications @IIIT_Hyderabad | Applied Physics DCE’23 | Prev @amazon, UTS,Sydney
Loise Hinckson @LoiHincks
39 Followers 5K Following
David Wessels @Dafidofff
116 Followers 135 Following PhD candidate w/ @erikjbekkers & @egavves interested in geometric deep learning and generative modelling at @AmlabUva & @amsterdamumc & @ellogonai
Pensé FFun @inftyCategory
113 Followers 6K Following
Trinh Mai @maittrinh156_
0 Followers 37 Following
Jeff Rose @rosejn
254 Followers 368 Following Entrepreneur, engineer, creative thinker. I did neuroscience/ML/retrieval research at Deepmind, a decade of ML consulting, and now founding https://t.co/FkxuxiqqAN.
Paco López. Andruino @andruinos
2K Followers 5K Following PhD Ingeniero y profesor FP. Robots learning. Antes todo era campo.
nima @nima55899895
2 Followers 51 Following
Gram Workshop @GRaM_workshop
28 Followers 154 Following Hi, I am the official account for the first edition of GRaM: Geometry-grounded Representation learning and generative Modeling Workshop at ICML2024
Molly Barnas @BarnasBarn
34 Followers 5K Following
Mila Lachowicz @LachowiczM48066
54 Followers 5K Following
Sai Charan Paloju @SmartCherrysTho
27K Followers 17K Following Founder of Smart Cherrys Thoughts, Global Technology Influencer, International Speaker.
🄼🅁 𝘔𝘖𝘗 @MrMoPor
119 Followers 693 Following Rotterdammer, econometrist, filosoof, muzikant. 🌹 🇳🇱 | 🇺🇦 | 🇪🇺 | 🇮🇱🇵🇸 | Castigat ridendo mores
Gianna Chiz @GianChiz
40 Followers 5K Following
Lluís Castrejón @LluisCastrejon
14 Followers 75 Following
Alice Jones @alice_jone88997
52 Followers 2K Following
Katherine Curenton @KatherineC94008
77 Followers 5K Following
Berna Cheatham @CheathBer
85 Followers 5K Following
Tech Rani @rip_through_it
25 Followers 347 Following
Ellie @Ellie_Ypr
7 Followers 504 Following Everything can change at any moments, suddenly and forever
Martin Sedláček @_MartinSedlacek
2 Followers 50 Following
Edin Scholl @EdinScholl99628
83 Followers 5K Following
MR X @Ahmad367263
38 Followers 92 Following
AK @_akhaliq
309K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Kosta Derpanis @CSProfKGD
48K Followers 198 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chair
Michael Black @Michael_J_Black
58K Followers 641 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
Dima Damen @dimadamen
8K Followers 644 Following Professor of Computer Vision, University of Bristol - passionate about the temporal stream in our lives.
Matthias Niessner @MattNiessner
31K Followers 162 Following Professor for Visual Computing & Artificial Intelligence @TU_Muenchen Co-Founder @synthesiaIO
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
#CVPR2024 @CVPR
41K Followers 329 Following Official account for IEEE/CVF Conference on Computer Vision & Pattern Recognition. #CVPR2024 🇺🇸 hosts @CSProfKGD @abby621 @jbhuang0604 @hi_ice_boy @BoqingGo
Yuki @y_m_asano
3K Followers 681 Following Assistant Professor for Computer Vision and Machine Learning at the QUVA Lab, @UvA_Amsterdam. Previously @Oxford_VGG, @OxfordAI, interned @facebookai
Sindy Löwe @sindy_loewe
3K Followers 361 Following PhD Student with @WellingMax at the University of Amsterdam. Deep Learning with Structured Representations.
Laura Leal-Taixe @lealtaixe
10K Followers 118 Following Senior Research Manager at @NVIDIA. Prev Professor at @TU_Muenchen. Computer Vision mostly. Views are my own.
Autonomous Vision Gro.. @AutoVisionGroup
12K Followers 371 Following Awesome Vision Group of Andreas Geiger at the University of Tübingen. We are excited about Computer Vision, Machine Learning and Robotics.
Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeV
Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]
Max Welling @wellingmax
32K Followers 429 Following
F. Güney @ftm_guney
7K Followers 1K Following research on computer vision, teaching, and movies. asst. prof. @KuisAICenter @kocuniversity tweets in TR, EN
NeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
Jürgen Schmidhuber @SchmidhuberAI
106K Followers 0 Following Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
Gautam Kamath @thegautamkamath
44K Followers 505 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.
Andrei Bursuc @abursuc
7K Followers 1K Following Research scientist @valeoai | Teaching @Polytechnique @ENS_ULM | Alumni @upb1818 @Mines_Paris @Inria @ENS_ULM
Time Capsule Tales @timecaptales
378K Followers 37 Following History & nostalgia thru pictures & videos!
Nebius @nebiusofficial
335 Followers 2 Following Nebius is an independent international company headquartered in the Netherlands, with engineering hubs in Finland, Serbia and Israel.
Suzan Verberne 🤹�.. @suzan
3K Followers 2K Following 1980 | Full Professor of Natural Language Processing (@TMLeiden), @LIACS @UniLeiden | Lives in #Nijmegen | Mother of 2 | 👩🏻💻👩🏻🏫🤹♀️🌱 🎼
Extinction Rebellion .. @NLRebellion
34K Followers 730 Following Wij zijn gewone mensen, uit alle hoeken van het land en van alle leeftijden die zich ernstig zorgen maken over de klimaat- en ecologische crisis.
Admiral Rob Bauer @CMC_NATO
24K Followers 310 Following Chair of the #NATO Military Committee - #NATOMC
KU Leuven Digital Soc.. @KULeuvenDigiSoc
526 Followers 67 Following The interdisciplinary KU Leuven Digital Society Institute aims for an inclusive digital society based on responsible, ethical and sustainable technologies.
Kristian Kersting @kerstingAIML
5K Followers 2K Following #AI prof @TUDarmstadt, co-director @Hessian_AI, @DFKI, @RealAAAI Councilor, @vision_claire, @ELLISforEurope, AI Columnist @WELTAMSONNTAG
Sarah Eslami @ESL_Sarah
202 Followers 588 Following PhD candidate @HPI_DE, multimodal deep learning, vision-language models
Christoph Reich @ChristophR1996
252 Followers 738 Following @ELLISforEurope Ph.D. Student @tumcvg, @visinf & @Oxford_VGG | https://t.co/yaqdM5V4IW. from @etitdarmstadt & https://t.co/VHpc5R9Fs1. from @CS_TUDarmstadt | Prev. @NECLabsAmerica & @koeppl_lab
Martha Lewis @marthaflinders
327 Followers 575 Following Lecturer at University of Bristol. Interested in concepts, compositionality, language. She/her. #BlackLivesMatter
Max Zimmer @maxzimmerberlin
78 Followers 196 Following PhD Student @ IOL Lab @ZuseInstitute / Interested in ML and Optimization
Physical Intelligence @physical_int
4K Followers 8 Following Physical Intelligence (Pi), bringing AI into the physical world.
Compounding Quality @QCompounding
365K Followers 352 Following 🏰 Quality Stocks 🧑💼 Former Professional Investor ➡️ Teaching people about investing on our website.
Guillaume Lample @GuillaumeLample
37K Followers 648 Following Cofounder & Chief Scientist https://t.co/hLfvKLkFHd (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @Polytechnique
Anorak Ventures @AnorakVentures
959 Followers 88 Following Seed-stage emerging-tech VC firm investing $250-500k in VR, AR, Computer Vision, AI, and Robotics startups including @anduriltech @flock_safety @frameworkputer
Stability AI @StabilityAI
189K Followers 31 Following We are building the foundation to activate humanity's potential.
robromijnders @robromijnders
84 Followers 168 Following PhD student @UvA with Max Welling. Previously AI residency @Google Brain
Saining Xie @sainingxie
14K Followers 1K Following researcher in #deeplearning #computervision | assistant professor at @NYU_Courant @nyuniversity | previous: research scientist @metaai (FAIR) @UCSanDiego
AI for Good 🇺🇳 .. @AIforGood
16K Followers 4K Following The @UN's 🇺🇳 leading platform to scale #AI for global impact. Organized by @ITU in partnership w/ 40 UN agencies and 🇨🇭 #AIforGood
Andrii Zadaianchuk �.. @ZadaianchukML
324 Followers 284 Following Postdoc @UvA_Amsterdam ex. PhD in @ETH Zürich and @MPI_IS, intern in @AmazonScience. Structured/causal representation learning for and by autonomous agents.
Wenhu Chen @WenhuChen
11K Followers 520 Following AI researcher @UWaterloo @GoogleAI @VectorInst. Interested in natural language processing, diffusion models. I direct TIGER-Lab at UWaterloo.
Harkirat Behl @BehlHarkirat
184 Followers 262 Following Phi models @MSFTResearch PhD @UniofOxford, BTech @IITKanpur #LLM #AI #Multimodal
Mehmet Saygın Seyfio.. @mehsaygin
802 Followers 753 Following Ph.D. candidate at @UW, working on medical AI at the intersection of vision and language. Previously 4x Research Intern @AmazonScience.
ELIAS @elias_project
117 Followers 42 Following 🌍 Network of Excellence: Pioneering Europe's leadership in #AIresearch for #SustainableInnovation & #EconomicDevelopment. Funded by @HorizonEU GA No. 101120237
Dimosthenis Karatzas @dkaratzas
616 Followers 902 Following Prof. Agregado, Universitat Autónoma de Barcelona / Associate Director at the Computer Vision Centre, Barcelona, Spain.
Liliane Momeni @LiliMomeni
743 Followers 713 Following PhD @Oxford_VGG w/ Prof Zisserman (grad. early ’24) • @Google PhD Fellowship in Perception • prev. Research Intern @Google & @Meta
Furong Huang @furongh
4K Followers 2K Following Assistant professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, #Trustworthy AI/ML, #EthicalAI, AI #Democratization, AI for ALL.
Asma Ghandeharioun @ghandeharioun
2K Followers 488 Following Research Scientist @GoogleAI working on ML interpretability & human-centered AI, PhD from @MIT
Leonid Karlinsky @leokarlin
178 Followers 126 Following Principal Research Scientist (STSM) @ MIT-IBM Lab @ IBM Research
Eli Schwartz @Eli_Schwartz
395 Followers 521 Following Ph.D.; AI Research Scientist @ IBM Research. https://t.co/ZP1C1G3xPh
Christina Sartzetaki @sargechris
21 Followers 186 Following PhD candidate @UvA_Amsterdam @ELLISforEurope
Sven Behnke @SvenBehnke
2K Followers 940 Following Professor for Autonomous Intelligent Systems, University of Bonn, Germany. Deep Learning, Cognitive Robotics.
Ying Shan @yshan2u
1K Followers 573 Following Distinguished Scientist @TencentGlobal, Founder of PCG ARC Lab, Director of AI Lab Visual Computing. Formerly @Microsoft, @MSFTResearch. Views are my own.
Daan Kolkman @dakolkman
8K Followers 2K Following Sociologist of data and algorithms. Working on responsible data science and governance of algorithms @UniUtrecht. Header by https://t.co/VbONi7vwx8
Georgios Leontidis @geleonti
655 Followers 861 Following Chair & Interdisciplinary Director of Data and AI, Professor of Machine Learning @aberdeenuni || opinions are my own || AberdeenML - formerly at @unilincoln
Opportunities for all @Oppo4all
710 Followers 5K Following Many professors or employers are looking for students while many students at the same time are looking for opportunities everyday...we bring both together!
Heleen Janssen 🚴�.. @heleenlouiseja
443 Followers 877 Following Researcher @ivir_uva and @Cambridge_CL Law & Technology. Previous government advisor law, technology and society
Ilze Amanda Auzina @AmandaIlze
100 Followers 96 Following PhD Candidate | Dynamical Systems (ODE, SDE, PDE) | Generative Modelling | Diffusion | Neural ODEs | Bayesian
Albert Gu @_albertgu
9K Followers 90 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
nick nassuphis @NNassuphis
120 Followers 5K Following
Adrian Salazar-Gomez @adriandesalazar
9 Followers 387 Following
Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Footage of magnificent cities as they were a century ago - a thread 1. Constantinople (Istanbul) capital of the Ottoman Empire, 1905🇹🇷
CV and AI have developed a culture of idolizing and wanting to be idolized. This happens in other fields too, but it gains momentum as more of the people rising to the top become increasingly arrogant, boastful, and lacking in humility - it's a self-reinforcing feedback loop.
And we celebrated the 500th promotion chaired by prof. Peter van Emde Boas. What a milestone! . Thanks from @UvA_IvI! I’m sure many here on Twitter/x had him as chair during their defense.
🚨Early preprint worth sharing! If you're using diffusion models with classifier free guidance, we have a 1 line modification to improve your results 📜: arxiv.org/abs/2404.13040 🤖: No git yet, but It's 1 line. I expect someone will add it to @huggingface diffusers at some point
Classifier-free guidance has been crucial in recent advancements in content generation, trading diversity for fidelity. However, can you get a better deal in this trade-off? With a simple modification, you can get more diversity while keeping a higher level of details!
worth revisiting the following post on 'commoditizing your complement' periodically: gwern.net/complement#2
Twitter is inventing increasingly fanciful reasons why Meta's releasing models openly while Zuck gives the super straightforward, obvious-in-retrospect reason: Meta will spend > 100B on inference compute and if people make it 10% more efficient it will have paid for itself.
Happy news! Last week, I successfully defended my PhD thesis (cum laude)😀 Many thanks to my supervisors Gijs Dubbelman and Peter de With, and committee members Bastian Leibe, @cgmsnoek, Julian Kooij, and Henk Corporaal! Next: a research visit at @RWTHVisionLab.
Check out our @CVPR paper on making caption-based Vision-Language Models do object-localization without _any_ human-supervised detection data! ⁉️ We develop a new *VLM-specific PEFT method* 🤩which is more powerful than LoRA etc. We test on non-training categories only!
How can one easily teach caption-pretrained VLMs to localize objects? We show that a small Positional Insert (PIN) can unlock object localization abilities without annotated data on frozen autoregressive VLMs. #CVPR2024 📝: arxiv.org/abs/2402.08657 🌐: quva-lab.github.io/PIN/
@maxzimmerberlin @UvA_IvI @cgmsnoek No, but if there's a lot of interest, I'll record it :)!
Recently Health Checking Urinals have begun popping up in Men's restrooms all over Shanghai. A private company is offering the urine analysis for RMB 20. Naturally I tried that out. Here's how that went.
Fourth Amsterdam Causality Meeting amscausality.github.io 🎉 Two fantastic talks: - @hpeterssengers (@amsterdamumc) ICU-acquired complications - @richardajpost (@TUeindhoven): Flexible Machine Learning Estimation of Conditional Average Treatment Effects: A Blessing and a Curse
How can one easily teach caption-pretrained VLMs to localize objects? We show that a small Positional Insert (PIN) can unlock object localization abilities without annotated data on frozen autoregressive VLMs. #CVPR2024 📝: arxiv.org/abs/2402.08657 🌐: quva-lab.github.io/PIN/
Last week I gave my lecture on Parameter-Efficient Finetuning (PEFT) at the @UvA_IvI MSc in AI - Foundation Models course! Find the slides here: dropbox.com/scl/fi/gngd55q… and the rest of our course with @cgmsnoek: uvafomo.github.io
🎉🎓Congrats Aditya @rodosingh23 and Dhruv @sridhruv for successfully defending your MS theses! As my first MS by Research students, you both have set a high bar with #CVPR papers and a nurturing lab culture, thank you!👏 Thanks @vikataravi and @rvbabuiisc for being on the panel
Another day another LLM trained with hundreds of millions of dollars on the same data as everyone else. Same capabilities. The half-life of excitement now is about 5 hours. Soon nobody will care.
Thread on the beauty of wildlife 🧵 1. When it’s cold enough to see the melody
Our #CVPR2024 paper explores low-resource tasks in computer vision and their challenges for foundation models. By collecting a new benchmark of genuinely low-resource image data we see tasks share the challenges of data scarcity, fine-grained differences and specialized domains
"7.7M GPU hours of computation on hardware of type H100-80GB (TDP of 700W)" That's 5.4GWh. That's 6 hours of an entire nuclear reactor. AN ENTIRE NUCLEAR REACTOR. And you know what, this is just the beginning. So long for frugality...
So LLaMa 3's carbon footprint is... huge? 🤯 They estimate it to be 2,290 tons of CO2eq, compared to 550t for training GPT-3 and 66t for training *all* of the BLOOM models (1B-176B) 🌬️
Trends for United States
You might like
