-
Tweets71
-
Followers1K
-
Following392
-
Likes284
Dexterous hand data collection made easy! Cut down the data collection time per demonstration from 20s to 7s🤗
Dexterous hand data collection made easy! Cut down the data collection time per demonstration from 20s to 7s🤗
Robot learning in the real world can be expensive and unsafe in human-centric environments. Solution: Construct simulation on the fly and train in it! Excited to share RialTo, led by @marceltornev on learning resilient policies via real-to-sim-to-real policy learning! A 🧵 (1/12)
Imitation learning makes it easy to learn a robot controller. But such controllers are typically not robust with a limited number of demonstrations. Check out our latest work on how to improve the robustness of imitation learning policies via a Real-to-Sim-to-Real framework!
Imitation learning makes it easy to learn a robot controller. But such controllers are typically not robust with a limited number of demonstrations. Check out our latest work on how to improve the robustness of imitation learning policies via a Real-to-Sim-to-Real framework!
Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: expressive-humanoid.github.io See how our robot performs rich, diverse,…
Teleoperation doesn't need to be cumbersome or expensive. Kudos to the impressive work from @chichengcc
Teleoperation doesn't need to be cumbersome or expensive. Kudos to the impressive work from @chichengcc
A #NeuralNetwork can direct armed robots to pick up and reorient replicas of objects, including a coffee mug, a tea pot, a truck, a duck, an elephant, and a cow. @taochenshh @pulkitology @MIT_CSAIL Learn more in Science #Robotics: scim.ag/4VF
🤖How far are we from 𝐠𝐞𝐧𝐞𝐫𝐚𝐥𝐢𝐬𝐭 𝐫𝐨𝐛𝐨𝐭𝐬? 𝐀𝐧𝐧𝐨𝐮𝐧𝐜𝐢𝐧𝐠 the 1st Workshop on "Towards Generalist Robots" at #CoRL2023! Join us to discuss how to scale up robotic skill learning, with an amazing lineup of speakers! CfP: generalist-robots.github.io Details 👇
If you are around the venue today, feel free to drop by our poster (Ballroom B, 12:15 pm) and chat about how learning: ⏲️Enables real-time feedback control in the physical world 🫳Learns state-of-the-art dexterous manipulation policies 🍀Reduces sensor/hardware requirements
If you are around the venue today, feel free to drop by our poster (Ballroom B, 12:15 pm) and chat about how learning: ⏲️Enables real-time feedback control in the physical world 🫳Learns state-of-the-art dexterous manipulation policies 🍀Reduces sensor/hardware requirements
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Xiaolong Wang @xiaolonw
11K Followers 955 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Chris Paxton @chris_j_paxton
8K Followers 1K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.
Jacky Liang @jackyliang42
4K Followers 735 Following Research Scientist @GoogleDeepMind working on foundation models for robotics. PhD @CMU_Robotics @iamlab_cmu. Prev. intern @NVIDIAAI. Writes @Last_Week_in_AI
Vikash Kumar ✈️IC.. @Vikashplus
4K Followers 407 Following Studying intelligent embodied behaviors. Ad. Prof. @CMU_Robotic | Sr. research scientist at @AIatMeta @GoogleAI @OpenAI | @berkeley_ai @UWcse #MuJoCo
Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)
Yuzhe Qin @QinYuzhe
2K Followers 559 Following Robot Learning @ UC San Diego; prev: @NVIDIA Robotics @GoogleX
Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.
Danfei Xu @danfei_xu
6K Followers 1K Following Assistant Prof. at Georgia Tech @ICatGT, researcher at @NVIDIAAI | Ph.D. @StanfordAILab | Making robots smarter
Ken Goldberg @Ken_Goldberg
16K Followers 8K Following artist, @UCBerkeley engineering prof, @AmbiRobotics chief scientist, robots, rockets, redwoods, rebels.
Fei Xia @xf1280
6K Followers 694 Following Research Scientist at @GoogleDeepMind, Robot Learning, Computer Vision. PhD from @StanfordAILab @StanfordSVL, previously @Tsinghua_Uni. #AGI through Embodiment
Anirudha Majumdar @Majumdar_Ani
4K Followers 526 Following Assistant Professor in Robotics @Princeton. Visiting researcher @GoogleDeepMind in Princeton.
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Abhishek Gupta @abhishekunique7
5K Followers 639 Following Assistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at Berkeley
Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.
Andrew Davison @AjdDavison
16K Followers 2K Following From SLAM to Spatial AI; Professor of Robot Vision, Imperial College London; Director of the Dyson Robotics Lab; Co-Founder of Slamcore. FREng, FRS.
Baoxiong Jia @BaoxiongJ
74 Followers 247 Following Research Scientist at BIGAI(https://t.co/uqFdhLmRgx) Previously Ph.D.@UCLA, B.S.@PKU1898, Intern@Amazon Alexa AI #3DSceneUnderstanding #EmbodiedAgents #ActivityUnderstanding
Sunqi Fan @Sunqi_Fan
111 Followers 586 Following a third-year undergrad @Tsinghua_Uni, studying NLP/LLM/CV. Seeking for 25 Fall Ph.D. position
Adam Raudonis @adamraudonis
763 Followers 825 Following Software @ Tesla Autopilot & Optimus. Interested in clean tech, space and AI
Poorvi @Poorvi_rh
58 Followers 228 Following CV/Robotics @ Stealth Startup | MS Computer Vision @CMU | CSE @IIT Bombay
Peter Morales @PeterMoralesX
219 Followers 2K Following Founder of funded Stealth AI Startup. Interested in AI development at the edge? DM.
Asuncion Sahara @sahara14657
77 Followers 5K Following
Zhuoqun Chen @zqchen33
44 Followers 250 Following MS in ECE @UCSD, Focus on Reinforcement Learning & Robotics Research
Mahdi Edraki @MahdiarEdraki
375 Followers 756 Following PhD candidate in @ActionLabNEU | Robotics || 🚴🏻🚴🏻
Pensé FFun @inftyCategory
100 Followers 6K Following
Elsie-mae Dickerson @DickersonM56593
84 Followers 5K Following
Jindong Gu @Jindong73504766
294 Followers 891 Following Senior Research Fellow in University of Oxford @OxfordTVG Faculty Researcher @Google #ResponsibleAI #AISafety #GenAI Homepage: https://t.co/YOSVO3jb6h
farmers market @0xFriendlyLord
55 Followers 288 Following
guodong yao @YaoGuodong66074
6 Followers 82 Following
Martin Fan @perfectoid_ai
394 Followers 8K Following
Sichao Liu @ErikLiuSe
40 Followers 289 Following
Julianne Scheperle @scheperle49431
97 Followers 5K Following
Roger Qiu @RogerQiu_42
52 Followers 58 Following Incoming PhD student at UCSD. Previously CS @ Illinois.
Jerry Wang @JerryWang298060
16 Followers 97 Following
André @andre_li999
0 Followers 92 Following
Arif Ahmad @arif_ahmad_py
273 Followers 7K Following All things AI, Computer Science and Circuits! Prev. @GoogleAI
Shondra Stonebraker @ShondraSto40397
73 Followers 5K Following
Sriyash Poddar @sriyash421
140 Followers 796 Following phd @uwcse | undergrad @iitkgp | building safer robots for humans
韩潇冰 @hnxiobng130460
7 Followers 356 Following
Lauran Biener @LBiener69089
61 Followers 5K Following
TechAI @Tech_AI_Tech
6K Followers 7K Following Inspired by AI Data, Powered by Supposition: Unchain The Potential of Tech AI. #TechAI #LearningAI #AI #Technology #GenerativeAI
Dan Haramati @DanHrmti
29 Followers 148 Following Master's Student - Technion | Reinforcement Learning
Wynter Hoheisel @hohei_wynte
30 Followers 5K Following
Frank Huang @zefang_huang
4 Followers 82 Following Undergradutate Student at Nanjing University Interested in Robotics and Reinforcement Learning
Meta @MetaMeowMeow
95 Followers 2K Following
Sympathisch Mann @sympathischmann
1 Followers 36 Following
Shengjie Wang @ShengjieWa34067
14 Followers 28 Following PhD student in Computer Science at Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University
MassRobotics @MassRobotics
6K Followers 1K Following MassRobotics Technical Career Fair on May 2, 2024 co- located with the Robotics Summit
Aayush Srivastava @aayunomics
891 Followers 3K Following Co-Founder, Solutions Center @GoogleCloud | Previous: Startup PM/BD @aws | @Columbia_Biz ‘26| @NLUD_official ‘14 |
Yufan Liu @YLiu137236
35 Followers 156 Following
Chuan Wen @ChuanWen15
133 Followers 150 Following PhD student @Tsinghua_IIIS. Visitor @berkeley_ai w/ @pabbeel .
Jiachen Luo @jiachenluo96
95 Followers 1K Following
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸
Yann LeCun @ylecun
711K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Xiaolong Wang @xiaolonw
11K Followers 955 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_Robotics
Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSci
Chris Paxton @chris_j_paxton
8K Followers 1K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.
Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.
Jacky Liang @jackyliang42
4K Followers 735 Following Research Scientist @GoogleDeepMind working on foundation models for robotics. PhD @CMU_Robotics @iamlab_cmu. Prev. intern @NVIDIAAI. Writes @Last_Week_in_AI
Deepak Pathak @pathak2206
16K Followers 316 Following I study topics in AI (machine learning, robotics & computer vision).
Vikash Kumar ✈️IC.. @Vikashplus
4K Followers 407 Following Studying intelligent embodied behaviors. Ad. Prof. @CMU_Robotic | Sr. research scientist at @AIatMeta @GoogleAI @OpenAI | @berkeley_ai @UWcse #MuJoCo
Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)
Yuke Zhu @yukez
15K Followers 464 Following Assistant Professor @UTCompSci | Co-Leading GEAR @NVIDIAAI | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my own
Frank Dellaert @fdellaert
11K Followers 1K Following CTO at Verdant Robotics, Robotics & Computer Vision Professor at Georgia Tech (on leave). Before: sabbatical at KUL, stints at Skydio, Facebook B*8, Google AI.
MIT CSAIL @MIT_CSAIL
298K Followers 22K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected]
Stephanie Zhan @stephzhan
19K Followers 2K Following GP @Sequoia. Preseed/Seed/A. Boards @linear @middeskhq @recroom Seeds: @replicatehq, https://t.co/qBx7xi7Qrd, 5 in stealth: robotics, AI agents, & more. AI, SaaS, dev tools.
Jack @JacklouisP
252 Followers 2K Following Commercial Director @opterantech, we reverse engineer insect brains. Previous 7 yrs - Founder of a robotics R&D agency. I write about robots.
Physical Intelligence @physical_int
4K Followers 8 Following Physical Intelligence (Pi), bringing AI into the physical world.
DexHand @dexhandv2
493 Followers 264 Following DexHand is the ultimate research tool for physical dexterous manipulation tasks requiring human-like dexterity. Now in Beta! Posts by @trentshumay
Eric Cousineau @eacousineau
171 Followers 281 Following
Tony Z. Zhao @tonyzzhao
12K Followers 785 Following CS PhD student @Stanford. Aspiring full-stack roboticist. Prev Deepmind, Tesla, GoogleX, Berkeley.
Chenhao Li @breadli428
2K Followers 325 Following Doctoral fellow @ETH_AI_Center | Robot learning at RSL & LAS | Prev. @MIT, @ETH_en, @MPI_IS.
Abe Murray @abemurray
5K Followers 2K Following General Partner @Alley_Corp DeepTech 🤖🦾 | Founder, builder, product & eng lead 💡📝 | Android / Google AI / Verily / k12 dropout | Stoic techno optimist 🔬📈
Han Guo @HanGuo97
2K Followers 4K Following PhD Student @LTIatCMU @SCSatCMU | Past: @MITIBMLab @UNCNLP, @SFResearch, @BaiduResearch | Machine Learning, NLP.
Antonio Loquercio @antoniloq
2K Followers 691 Following #ComputerVision and #Robotics PostDoc at @Berkeley_EECS (BAIR) with Jitendra Malik in #Berkeley, California.
Hao Su @haosu_twitr
4K Followers 351 Following Associate Professor @UCSanDiego. Computer Vision, Graphics, Embodied AI, Robotics. Co-Founder of Hillbot Inc.
HJ Terry Suh @hjterrysuh
40 Followers 83 Following Robotics PhD Student at CSAIL, MIT. Excited about achieving intelligent dexterity in contact-rich manipulation.
Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.
taylor howell @taylorhowell
773 Followers 314 Following
Brett Adcock @adcock_brett
172K Followers 14 Following Founder @Figure_robot (AI Robotics) & Archer Aviation (NYSE: ACHR)
Kevin Frans @kvfrans
2K Followers 420 Following @berkeley_ai prev mit, read my thoughts: https://t.co/7CZsOTsiH8
He Wang @HughWang19
1K Followers 149 Following Assistant Professor of Computer Science at Peking University, leading Embodied Perception and InteraCtion (EPIC) Lab. Goal: scalable 3D-aware home robots.
Erin L Scott, PhD @erin_l_scott
1K Followers 1K Following Enabling entrepreneurs | Research and teach Strategy for Startups @MITSloan | 'All information looks like noise until you break the code.'-Snow Crash
Taylor W. Killian @tw_killian
2K Followers 766 Following #ML4H research @UofT/@VectorInst interested in Decision Making & Transfer Learning, visiting @MIT // @BYU '13; @Harvard '17
Mustafa Mukadam @mukadammh
1K Followers 270 Following Research Scientist @AIatMeta (FAIR). PhD from @GTrobotics (Georgia Tech). Robotics and Machine Learning.
Maria Bauza Villalong.. @bauzavillalonga
1K Followers 260 Following I am research scientist at @DeepMind working on robotic manipulation. I just earned my PhD at @MIT working with Prof. Alberto Rodriguez.
Huanbo Sun @huanbo_sun
107 Followers 233 Following Interested in creating techniques to give robots a softer body and a better sense of touch (Haptic Sensors).
Jie Xu @xujie7979
610 Followers 98 Following Robotics Research Scientist @Nvidia | Ph.D. student @MIT_CSAIL | Interested in Robotics Control/Design & Physics-based Simulation & Machine Learning
Neural Fields @neural_fields
5K Followers 8 Following Neural fields in visual computing and beyond. Join community slack: https://t.co/dSwTv8fRH0
Sara Beery @sarameghanbeery
11K Followers 3K Following Research on computer vision and the environment 🌍 Asst Prof at @MIT_CSAIL #QueerInAI 🏳️🌈 sarabeery on threads @[email protected]
Ben Mildenhall @BenMildenhall
5K Followers 987 Following making stuff 3D. formerly research scientist at Google, phd at Berkeley.
Jeff Ichnowski @jeff_ichnowski
281 Followers 83 Following
Jonathan Kelly @domo_mr_roboto
1K Followers 631 Following Associate Professor @ University of Toronto Institute Aerospace Studies @UTIAS and Canada Research Chair in Collaborative Robotics @UofTRobotics - 🤖's rock!
/MachineLearning @slashML
121K Followers 1 Following
Guanya Shi @GuanyaShi
3K Followers 916 Following Assistant Professor @CMU_Robotics @SCSatCMU. Lead the Learning and Control for Agile Robotics Lab @LeCARLab. Ph.D. from @Caltech. Postdoc @uwcse. He/Him/His.
Wevolver @WevolverApp
45K Followers 4K Following Wevolver is the platform that provides the knowledge and connections to develop better technology.
Nathan Ratliff @robot_trainer
575 Followers 314 Following Director of Robotic Systems @NVIDIA. Isaac Cortex, cobots, geometric methods; PhD CMU, research Max Planck, TTI-C, co-founder Lula Robotics, eng Google, Amazon
Yifei Li 李一飞 @Yifei_omegaiota
2K Followers 469 Following CS PhD student at @MIT_CSAIL 💻 🐇🫖 @SCSatCMU alumni, ex-intern at @RealityLabs , @NVIDIA, @MetaAI, @Google @Activision
Todor Davchev @tdavchev
715 Followers 410 Following Research Scientist @GoogleDeepMind | views are my own
Marc Toussaint @Marc__Toussaint
763 Followers 38 Following Prof. in AI & Robotics @TUBerlin, Learning & Intelligent Systems Lab @LIS_TUBerlin, @scioi_cluster member
Soft Robotics @SoftRobotics_JN
4K Followers 2K Following Soft Robotics is the #1 robotics journal, publishing world-class peer-reviewed research on the emerging technologies of soft and deformable robots.
Nitish Srivastava @nitishsr
4K Followers 140 Following Co-Founder and CTO at Vayu Robotics; Machine Learning for Robotics and Autonomous Systems
Gabe Margolis @gabe_mrgl
666 Followers 359 Following Grad Student at @MIT_CSAIL. Robot learning, motor skills for contact-rich tasks.
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
Imitation learning works™ – but you need good data 🥹 How to get high-quality visuotactile demos from a bimanual robot with multifingered hands, and learn smooth policies? Check our new work “Learning Visuotactile Skills with Two Multifingered Hands”! 🙌 toruowo.github.io/hato/
Happy to share that our paper, Videodex, was featured on the front page of IJRR for April 2024.😀 I believe learning from human videos for robot hands will be very important especially in the era of foundation models that need a lot of data. journals.sagepub.com/toc/ijra/43/4
Today, I defended my PHD thesis! A huge thanks to my committee and everyone who made these 5 years amazing 🎉🥳
Thank you @ieeeras for the Early Academic Career Award! We have been pushing self-supervised robots that learn from real-world data for about a decade now and it is wonderful to see the support from the robotics and automation community along the way.
Congratulations to the 2024 winners of the #IEEE #RAS awards! Join us at #ICRA2024 to help celebrate their outstanding accomplishments in, and service to, #robotics and #automation as we present them their awards! For more details about the winners, visit: loom.ly/l8QzDRc
I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 wholebody-b1.github.io Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See…
I had the pleasure of visiting @CMU_Robotics over the past two days to give a VASC seminar talk and a guest lecture. Thanks @GuanyaShi for the amazing host! 🙌 The seminar talk was about our recent work on "Foundation Models for Robotic Manipulation": youtu.be/akDSG9FsoCk 🤖
Yesterday, during the GTC Keynote session, Jensen announced NVIDIA's new moonshot project, GR00T! This ambitious endeavor aims to create a general-purpose foundation model for humanoid robots, necessitating advances in and the convergence of various fields such as simulation,…
Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning. The GR00T model will enable a robot to understand multimodal…
Introduce 3D-VLA, a 3D Generative World Model! Humans use mental models to predict and plan for the future. Similarly, 3D-VLA achieves this by linking 3D perception, future prediction, and action executions through a generative world model. vis-www.cs.umass.edu/3dvla
We have seen a lot of legged robots doing navigation in the wild. But how about mobile manipulation in the wild? I have been pushing the direction of learning a unified, efficient, and dynamic 3D representation of scenes (for navigation) and objects (for manipulation) for the…
Building robot intelligence requires high-quality robot data. But far too many tools to collect data are closed and custom-built. Open Teach is fully open-sourced and is: - Calibration-free - Supports multiple arms, hands, & mobile manipulators - Costs just $500
We are now having full conversations with Figure 01, thanks to our partnership with OpenAI. Our robot can: - describe its visual experience - plan future actions - reflect on its memory - explain its reasoning verbally Technical deep-dive 🧵:
🧐Automatically breaking LLAMA2-7B, GPT-3.5, Stable Diffusion, etc with curiosity-driven exploration! Curious exploration helps test large language and vision models by generating diverse inputs/prompts that trigger unwanted responses from a target model. ⚡️Read our paper,…
🥽 Want to use your new Apple Vision Pro to control your robot? Want to record how you navigate / manipulate the world to train a policy? I developed an app for VisionOS that can stream your head / wrist / finger movements over WiFi, which you can subscribe on any machines using…
LLMs swept the world by predicting discrete tokens. But what’s the right tool to model continuous, multi-modal, and high dim behaviors? Meet Vector Quantized Behavior Transformer (VQ-BeT), beating or matching diffusion based models in speed, quality, and diversity. 🧵
Robot learning in the real world can be expensive and unsafe in human-centric environments. Solution: Construct simulation on the fly and train in it! Excited to share RialTo, led by @marceltornev on learning resilient policies via real-to-sim-to-real policy learning! A 🧵 (1/12)
Love imitation learning but need more robustness? Check out RialTo -- a pipeline for acquiring reactive visuomotor policies via real-world BC and simulation-based RL with digital twin 3D assets real-to-sim-to-real.github.io/RialTo/ Project lead by @marceltornev, details in his thread below!
How can we train robust policies with minimal human effort?🤖 We propose RialTo, a system that robustifies imitation learning policies from 15 real-world demonstrations using on-the-fly reconstructed simulations of the real world. (1/9)🧵 Project website: real-to-sim-to-real.github.io/RialTo/
Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: expressive-humanoid.github.io See how our robot performs rich, diverse,…
We tackle robotic manipulation with real-world imitation learning or sim2real approaches. But what if we merge the two? Introducing CyberDemo: a novel pipeline that leverages simulated human demos to master real-world dexterous manipulation tasks.
The plan was to collect some demos among people in university center, lead to some unexpected donations from the crowd 💵
Trends for United States
You might like
