Deepak Pathak @pathak2206
I study topics in AI (machine learning, robotics & computer vision). cs.cmu.edu/~dpathak/ Pittsburgh, PA Joined May 2013-
Tweets582
-
Followers15K
-
Following315
-
Likes1K
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
In text-to-image generation, evaluating how well the generated image matches the prompt is a major challenge. We address this with VQAScore: a SOTA metric that significantly surpasses CLIPScore, PickScore, ImageReward, TIFA, and more! VQAScore works especially well on complex…
Very cool results by @chenwang_j !! Pleased to see the LEAP hand being adopted for such diverse and dexterous manipulation tasks. You too can make one for yourself: leaphand.com
Very cool results by @chenwang_j !! Pleased to see the LEAP hand being adopted for such diverse and dexterous manipulation tasks. You too can make one for yourself: leaphand.com
This robot can figure out how to open almost any door on its own newscientist.com/article/241559…
Introducing a simple approach to perform complex tasks in *unseen* environments by allowing the robot to practice. The result is fully autonomous mobile manipulation for opening doors, drawers, cabinets, etc in the open world. PS: door-opening is still far from being "solved" :)
Introducing a simple approach to perform complex tasks in *unseen* environments by allowing the robot to practice. The result is fully autonomous mobile manipulation for opening doors, drawers, cabinets, etc in the open world. PS: door-opening is still far from being "solved" :)
Very cool results from @HaoyuXiong1 ! Proper real-world evaluations are always the most time consuming but important part of robotics research!
Very cool results from @HaoyuXiong1 ! Proper real-world evaluations are always the most time consuming but important part of robotics research!
This mobile robot is able to open doors, drawers, and fridges in the wild, generalizing to scenes not seen during training time. The skills look less impressive than ALOHA, but they're actually fully autonomous. Core idea is simple: do RL *at test time*, use CLIP (or any…
Introducing Open-World Mobile Manipulation 🦾🌍 – A full-stack approach for operating articulated objects in open-ended unstructured environments: Unlocking doors with lever handles/ round knobs/ spring-loaded hinges 🔓🚪 Opening cabinets, drawers, and refrigerators 🗄️ 👇…
Must watch!
Adaptive Mobile Manipulation for Articulated Objects In the Open World paper page: huggingface.co/papers/2401.14… Deploying robots in open-ended unstructured environments such as homes has been a long-standing research problem. However, robots are often studied only in closed-off lab…
Cool to see how many tasks even low-cost robots can perform IF controlled by intelligent "software" (that software here is a human teleoperator)... still recall feeling this deep realization when @pabbeel made this argument in his robot learning talk almost a decade ago!! :)
Cool to see how many tasks even low-cost robots can perform IF controlled by intelligent "software" (that software here is a human teleoperator)... still recall feeling this deep realization when @pabbeel made this argument in his robot learning talk almost a decade ago!! :)
Robotic intelligence requires dexterous tool use, but generalizing across tools is hard. Our CoRL23 paper combines semantics (affordances) with low-level control (sim2real) to show functional grasping that generalizes to hammers, drills and more! dexfunc.github.io 1/n
A generative framework for learning diverse robotic skills from undirected play data!
A generative framework for learning diverse robotic skills from undirected play data!
Don’t miss tomorrow the 6th Robot Learning Workshop at #NeurIPS2023 w/ amazing lineup of speakers: @MashaItkina @_jessethomason_ @DhruvBatraDB @arjunmajum @pathak2206 @SurajNair_1 @BarnesMJ @keerthanpg Montserrat Gonzalez Arenas @xf1280 +robot demos 🤖! robot-learning.ml/2023/
Excited to present Diffusion-TTA at #NeurIPS. Current paradigm to image recognition is dominated by discriminative models (Clip or ViT) that learn a bottom up pathway to perception⤴️ (Image -> Label). Generative models on the other hand learn a top down pathway to perception ⤵️…
Excited to present Diffusion-TTA at #NeurIPS. Current paradigm to image recognition is dominated by discriminative models (Clip or ViT) that learn a bottom up pathway to perception⤴️ (Image -> Label). Generative models on the other hand learn a top down pathway to perception ⤵️… https://t.co/Gc2aErfYU2
We use generative models to improve discriminative models, by doing test-time adaptation on unlabeled images. This works especially well on a stream of OOD data! Swing by our poster (#305) today 10:45am-12:45pm if you'd like to chat!
We use generative models to improve discriminative models, by doing test-time adaptation on unlabeled images. This works especially well on a stream of OOD data! Swing by our poster (#305) today 10:45am-12:45pm if you'd like to chat!
How can robots perform a wide range of skills? At #CoRL2023, we presented PlayFusion – a language-conditioned discrete diffusion model capable of performing many different tasks! 🌐play-fusion.github.io 1/n
Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceMichael Black @Michael_J_Black
58K Followers 638 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindEugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Xiaolong Wang @xiaolonw
11K Followers 943 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_RoboticsDmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 590 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Ted Xiao @xiao_ted
11K Followers 680 Following I teach robots to be smarter @GoogleDeepMind. Tweets about robot learning, scaling, and large models. Opinions my own.yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsYuke Zhu @yukez
15K Followers 464 Following Assistant Professor @UTCompSci | Co-Leading GEAR @NVIDIAAI | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my ownChris Paxton @chris_j_paxton
8K Followers 1K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.Angjoo Kanazawa @akanazawa
14K Followers 626 Following Assist. Professor at @Berkeley_EECS, @berkeley_ai. KAIR, @nerfstudioteam, advising @WonderDynamics and @LumaLabsAI. she/her.Aakriti @Aakriti0503
156 Followers 228 Following CS PhD student at UMD working on reinforcement learning. Past: Applied Research Intern @amazon.Cookie Quantum @QuantummCookie
0 Followers 26 FollowingNiccolo Fusai @NiccoloFusai
31 Followers 274 FollowingJoey @him_joey
97 Followers 771 Followinggylns @glovepm
3 Followers 418 FollowingTawfique Elahi @tawfiquee
610 Followers 4K Following MSc Information Systems @LundUniversity • Head of Debate @UPFLund/@DebateLund • HCI x AI Research • Business Analysis 🗣️ Opinions are my ownSneha D. Goenka @gsneha261
362 Followers 862 Following (she/her) Incoming Assistant Professor @Princeton ECE 2024, PhD candidate @Stanford, computer architecture & genomics, @ForbesUnder30Ruohai Ge @Gelev97
4 Followers 45 FollowingLB @Lucas14PU
0 Followers 145 FollowingP @pepijn2233
54 Followers 514 Followingplaceholder @placeholder934
0 Followers 56 FollowingWilliam Huang @TheWillHuang
173 Followers 772 FollowingCmoose @Cmoose
212 Followers 347 Following Chief Software Architect at http://t.co/t3zAIa5Ttw, #opendata geek, effective government advocateGiulio Turrisi @valenorf
96 Followers 384 FollowingLe Gao @AutonomousBill
3 Followers 42 FollowingJulien Siems @julien_siems
106 Followers 456 Following PhD student advised by Frank Hutter working on in-context learning. Formerly Machine Learning Researcher @ Merantix Momentum, Research Intern @ AWS.Xiaoyuan Zhang @XiaoyuanZh1907
3 Followers 69 FollowingSaba Khalilnaji @saba_khalilnaji
8 Followers 108 FollowingUn Known @known_un57741
73 Followers 318 FollowingRuairi @ruairiSpain
290 Followers 2K FollowingAria @Aria3441
0 Followers 29 FollowingWill @solidwillity
117 Followers 1K FollowingAbdullah Arafa @_Abdullah_ARAFA
123 Followers 205 FollowingJim Holmes @HolmesJE
1K Followers 435 Following GOD FAMILY HUMANITY Emergency Medicine MD (retired). Waiting patiently for my CyberTruck…Daniel Méthot @DanielMthot1
221 Followers 1K Following CEO Dan Méthot Importation-Distribution Enr. & SystemeX Global World, Green Energy Solutions Provider.Aaditya ; @Aaditya26082004
493 Followers 6K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈محمد جمال @mhmdjma42640695
10 Followers 226 FollowingSpencer @Superior_Kitsch
20 Followers 5K FollowingRohan Tiwari @RohanTiwar39781
0 Followers 6 FollowingYuhang Zhang @Zhang_Yuhang1
15 Followers 294 FollowingTanav @tanav2202
247 Followers 1K Following Data Science @sliceit_, I read research papers when free, simping on LLMs and Knowledge graphsYaofeng Xie @xi_9856_xi
0 Followers 38 FollowingJishuai MIAO @JishuaiM88686
24 Followers 522 Followingmatthew hong @matthew_ho81515
37 Followers 50 FollowingEdoardo Ghignone @gnone42
60 Followers 718 Following Control Theory and ML Master student @ ETHz, Italian insidemanee_az @az_manee
42 Followers 101 FollowingThe Artificially Inte.. @theaienterprise
818 Followers 3K Following The Artificially Intelligent Enterprise is a newsletter and online conference for business users adopting artificial intelligence produced by @mrhinkle.Revathi Prasad @RevathiPrasad97
26 Followers 250 Following Technology, Mathematics, Photography, Travel and Spirituality | Master's @USC | QR @jpmorganahad @ahadj0
11 Followers 93 FollowingSergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceMichael Black @Michael_J_Black
58K Followers 638 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Xiaolong Wang @xiaolonw
11K Followers 943 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_RoboticsDmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 590 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Ted Xiao @xiao_ted
11K Followers 680 Following I teach robots to be smarter @GoogleDeepMind. Tweets about robot learning, scaling, and large models. Opinions my own.Thomas G. Dietterich @tdietterich
50K Followers 500 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityYuke Zhu @yukez
15K Followers 464 Following Assistant Professor @UTCompSci | Co-Leading GEAR @NVIDIAAI | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my ownChris Paxton @chris_j_paxton
8K Followers 1K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.Vinod Khosla @vkhosla
631K Followers 573 Following entrepreneurship zealot, grounded technology possibilist, believer in the power of ideas, passionate about sustainability & impactDavid Hall @dlwh
2K Followers 1K Following Research Engineering Lead at @StanfordCRFM . Previously co-founder at Semantic Machines ⟶ MSFT. Lead developer of Levanter, Breeze. he/him @[email protected]Center for Research o.. @StanfordCRFM
2K Followers 3 Following Making foundation models more reliable and accessible.Paul Byrne @ThePlanetaryGuy
80K Followers 770 Following Associate Professor of Earth, Environmental, and Planetary Science at Washington University in St. Louis • Planetary Evangelist • he/him/Sir • 🇮🇪 in 🇺🇸Tree of Knowledge @ToK_ScienceTree
24K Followers 356 Following 'What we know is a drop, what we don't know is an ocean.' (Isaac Newton) Follow us for a daily drop of science knowledge! 🪐🧠🧲🐋🚀ViktorM🇺🇦 @viktor_m81
1K Followers 2K Following Senior Research Scientist at @NVIDIA. Simulation, foundation models, robotics, and reinforcement learning by day, painting and piano performance by night.Bilawal Sidhu @bilawalsidhu
46K Followers 4K Following Blending reality & imagination. Ex-Google Maps & AR/VR. VFX & 3D creator with 1.4M+ subs & 360M+ views. Scout, A16z games. Host, TED AI Show. ੴ.Jim Fan @DrJimFan
228K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Kexin Shi @teenhaci
91 Followers 54 FollowingTony Z. Zhao @tonyzzhao
12K Followers 774 Following CS PhD student @Stanford. Aspiring full-stack roboticist. Prev Deepmind, Tesla, GoogleX, Berkeley.Mrinal Kalakrishnan @mkalakrishnan
680 Followers 269 Following Embodied AI Research Lead @ Meta FAIRAndrew Côté @Andercot
63K Followers 1K Following engineering physicist, space pirate, founder @hyperstition_x, scout @a16z, runs @TheAISalonSF, deep-tech, physics, energy and sci-fi 🇨🇦Sinéad Griffin @sineatrix
14K Followers 1K Following @[email protected] 100% scientist @BerkeleyLab, 50% artist and 0% arithmetician, https://t.co/9UzFO0pOr4, 🇮🇪 (she/her)Alex Kaplan @alexkaplan0
39K Followers 2K Following Coffee guy @cometeer, physics @princetonphys, bro for decarb, and your favorite source of superconductor disinformationConference on Robot L.. @corl_conf
7K Followers 38 Following Conference on Robot Learning (CoRL) is an annual international conference on robotics and machine learning. Account managed by @gmartiusTom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Jamie Shotton @Jamie_Shotton
4K Followers 673 Following Embodied AI, Vision, Autonomy, ML, and Mixed Reality. Chief Scientist at @wayve_ai. Ex-Leader of Mixed Reality & AI Labs at Microsoft.Dima Damen @dimadamen
8K Followers 643 Following Professor of Computer Vision, University of Bristol - passionate about the temporal stream in our lives.Arthur Allshire @arthurallshire
1K Followers 370 Following robotics & simulation. EngSci @UofT + @NvidiaAI. EV '23 occasionally blogs at https://t.co/0SYceEqzpR 🇮🇪 🇨🇦 🇦🇺🇨🇭🇨🇿Suraj Nair @SurajNair_1
2K Followers 438 Following Building robot foundation models at Physical Intelligence.Dorsa Sadigh @DorsaSadigh
8K Followers 390 Following CS Faculty @Stanford, @StanfordAILab 20% Research scientist @GoogleDeepMind PhD and BS from @Berkeley_EECSSaining Xie @sainingxie
14K Followers 1K Following researcher in #deeplearning #computervision | assistant professor at @NYU_Courant @nyuniversity | previous: research scientist @metaai (FAIR) @UCSanDiegoTim Rocktäschel @_rockt
29K Followers 1K Following Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, @ELLISforEurope Scholar. ex @MetaAI (FAIR), @CompSciOxford. Opinions my own.Dibya Ghosh @its_dibya
1K Followers 392 Following I do RL research @UCBerkeley | Previously @ Google Brain MontrealDanfei Xu @danfei_xu
6K Followers 1K Following Assistant Prof. at Georgia Tech @ICatGT, researcher at @NVIDIAAI | Ph.D. @StanfordAILab | Making robots smarterANYbotics @anybotics
7K Followers 2K Following An end-to-end robotic solution to automate industrial inspections. Our robots provide information to maximize equipment uptime, improve safety and reduce costs.Yi Ma @YiMaTweets
71K Followers 120 Following Chair Professor in AI, Director of IDS, Head of CS, HKU; Professor of EECS, Berkeley; Author of Book: High-Dim Data Analysis, https://t.co/gwaqMJp8av.Minas Liarokapis @minasliarokapis
426 Followers 324 Following Chief Scientist, Acumino / Chair, NZ-RAS / Director, New Dexterity Research Group / Associate Professor, The University of AucklandAI Breakfast @AiBreakfast
167K Followers 209 Following The latest rumors and developments in the world of artificial intelligence. DM to include your AI project in the newsletter.Amy Zhang @yayitsamyzhang
4K Followers 387 Following ECE prof. at UT Austin. Works in state abstractions and generalization in RL.Ananye Agarwal @anag004
566 Followers 439 FollowingJohn Schulman @johnschulman2
39K Followers 608 Following Cofounder @openai, lead post-training for ChatGPT and the API. Interested in reinforcement learning, alignment, birds, jazz musicMelissa Heikkilä @Melissahei
14K Followers 3K Following Senior reporter for AI @techreview. | Ex @POLITICOEurope & @TheEconomist | Forbes 30 under 30 | She/herThomas Kipf @tkipf
25K Followers 1K Following AI Research at @GoogleDeepMind. Ex-Physicist. Graph Neural Networks & Controllable Generative Models (e.g. GCNs, Structured World Models, Slot Attention).Antonio Loquercio @antoniloq
2K Followers 685 Following #ComputerVision and #Robotics PostDoc at @Berkeley_EECS (BAIR) with Jitendra Malik in #Berkeley, California.Jitendra MALIK @JitendraMalikCV
4K Followers 0 FollowingIn text-to-image generation, evaluating how well the generated image matches the prompt is a major challenge. We address this with VQAScore: a SOTA metric that significantly surpasses CLIPScore, PickScore, ImageReward, TIFA, and more! VQAScore works especially well on complex…
Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced
Dynamixels are truly great. It's almost similar to what Python is in software: a great abstraction layer on actuation. It allows us to focus on the robot design and learning itself.
Open-source robot arm for about $200. It uses five Dynamixel servo motors and weighs slightly over 100g (without the base). The design for a leader arm is included as well so that you can teleoperate it effectively. (Video is at 1x speed) github.com/AlexanderKoch-…
🚨Paper Alert 🚨 ➡️Paper Title:Adaptive Mobile Manipulation for Articulated Objects In the Open World 🌟Few pointers from the paper 🎯In this paper authors have introduced “Open-World Mobile Manipulation System”, a full-stack approach to tackle realistic articulated object…
We especially thank @kenny__shaw @anag004 @pathak2206 for open-sourcing the LEAP Hand project. Having a customizable and low-cost dexterous hand benefits our project a lot!
More coverage for Large World Model! :) bnnbreaking.com/world/us/uc-be…
So grateful for the unwavering support and mentorship I’ve received from my advisor @pathak2206
Wonderful to find out that our real-world robotic adaptation work got featured in Nature’s “Images of the Month” series across all areas of Science alongside case studies of plasma on the Sun’s surface, neon nerve cells, and marine life in the deep ocean: nature.com/immersive/d415…
This robot can figure out how to open almost any door on its own newscientist.com/article/241559…
LLMs are great, but their internals are less explored. I'm excited to share very interesting findings in paper “Massive Activations in Large Language Models” LLMs have very few internal activations with drastically outsized magnitudes, e.g., 100,000x larger than others. (1/n)
Sora is here! It's a diffusion transformer that can generate up to a minute of 1080p video with great coherence and quality. @_tim_brooks and I have been working on this at @OpenAI for a year, and we're pumped about pursuing AGI by simulating everything! openai.com/sora
Yesterday we announced our $202M Fund II to back early-stage startups. Today we want to thank the entire AIX Ventures team for their hard work. @pabbeel, @antgoldbloom, @shaunbjohnson, @shyammani_, @chrmanning, Christina Sfakianos, @RichardSocher, @SaraTatman
@darshilistired I started the next one two days ago!
Hi everyone yes, I left OpenAI yesterday. First of all nothing "happened" and it’s not a result of any particular event, issue or drama (but please keep the conspiracy theories coming as they are highly entertaining :)). Actually, being at OpenAI over the last ~year has been…
Am I the only one who learned today that the time unit "second" is called this way because its the second time that the unit "hours" is subdivided, the first time being minutes (meaning "small")?
Extreme Parkour was accepted at @ieee_ras_icra 2024. Won’t be possible without the joint efforts with @teenhaci @anag004 @pathak2206 !
Didn't think this is possible but we made it! Glad to finish my master with this exciting project with amazing collaborators @teenhaci, @anag004 and @pathak2206!
Very cool results from @HaoyuXiong1 ! Proper real-world evaluations are always the most time consuming but important part of robotics research!
Introducing Open-World Mobile Manipulation 🦾🌍 – A full-stack approach for operating articulated objects in open-ended unstructured environments: Unlocking doors with lever handles/ round knobs/ spring-loaded hinges 🔓🚪 Opening cabinets, drawers, and refrigerators 🗄️ 👇…
Exciting strides in robotics! 🤖 Thrilled to see the Open-World Mobile Manipulation project. lead by @HaoyuXiong1, @mendonca_rl, @kenny__shaw, and @pathak2206.
This mobile robot is able to open doors, drawers, and fridges in the wild, generalizing to scenes not seen during training time. The skills look less impressive than ALOHA, but they're actually fully autonomous. Core idea is simple: do RL *at test time*, use CLIP (or any…
Introducing Open-World Mobile Manipulation 🦾🌍 – A full-stack approach for operating articulated objects in open-ended unstructured environments: Unlocking doors with lever handles/ round knobs/ spring-loaded hinges 🔓🚪 Opening cabinets, drawers, and refrigerators 🗄️ 👇…