Wenlong Huang @wenlong_huang
PhD Student @StanfordSVL @StanfordAILab. Previously @Berkeley_AI @GoogleDeepMind. Robotics, Foundation Models. wenlong.page Stanford, CA Joined May 2019-
Tweets303
-
Followers2K
-
Following819
-
Likes2K
Trying to be useful lately!
🚨Update on RADIO - a single vision foundation model to rule them all! You get CLIP, DINO, SAM features in a single pass! Like a Swiss army knife for CV. Code: github.com/NVlabs/RADIO Paper: arxiv.org/abs/2312.06709 - Accepted at CVPR2024 - Arxiv update - V2.1 model with better…
Check out robots using their entire body to increase their workspace and the force they apply. We enable explicit whole-body force control to expand the ability of mobile quadrupeds. Find details: tif-twirl-13.github.io/learning-compl… Work led by @gabe_mrgl @TifannyPortela At…
Introducing DrEureka🎓, our latest effort pushing the frontier of robot learning using LLMs! DrEureka uses LLMs to automatically design reward functions and tune physics parameters to enable sim-to-real robot learning. DrEureka can propose effective sim-to-real configurations…
MLPs are so foundational, but are there alternatives? MLPs place activation functions on neurons, but can we instead place (learnable) activation functions on weights? Yes, we KAN! We propose Kolmogorov-Arnold Networks (KAN), which are more accurate and interpretable than MLPs.🧵
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
Very incredible to see how capable VR-controlled robot hands can be. While there is a lot of debate on grippers vs hands, why not think of hands as just grippers that offer more redundancy and stability? Congrats on the great work!
Very incredible to see how capable VR-controlled robot hands can be. While there is a lot of debate on grippers vs hands, why not think of hands as just grippers that offer more redundancy and stability? Congrats on the great work!
@gdb @nvidia So appreciative of Jensen’s contribution to #AI! This was when he delivered the world’s first @nvidia DGX-1 to our lab @StanfordSVL back in 2016! 😍
@gdb @nvidia So appreciative of Jensen’s contribution to #AI! This was when he delivered the world’s first @nvidia DGX-1 to our lab @StanfordSVL back in 2016! 😍
Nice smooth hardware
Build what you need and use what you build. This is a core philosophy of my research. It shifts the focus away from publishing “papers” to what really matters — impact. This thread unpacks why I think this is a successful approach to science. 1/10 Or see: perceiving-systems.blog/en/post/build-…
This is clearly going to benefit the privileged. Even the info that this conference/track existed probably will only circulate in a small group with direct tie to academia/tech (parents etc). How about we flip this into a track for creating accessible tutorials, lectures,…
This is clearly going to benefit the privileged. Even the info that this conference/track existed probably will only circulate in a small group with direct tie to academia/tech (parents etc). How about we flip this into a track for creating accessible tutorials, lectures,…
Our computer vision textbook is released! Foundations of Computer Vision with Antonio Torralba and Bill Freeman mitpress.mit.edu/9780262048972/… It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields. 1/4
Introducing 𝐀𝐋𝐎𝐇𝐀 𝐔𝐧𝐥𝐞𝐚𝐬𝐡𝐞𝐝 🌋 - Pushing the boundaries of dexterity with low-cost robots and AI. @GoogleDeepMind Finally got to share some videos after a few months. Robots are fully autonomous filmed in one continuous shot. Enjoy!
This Google Scholar plugin is meaningfully accelerating my paper reviews. Clicking on a citation immediately pops up a helpful info box from Scholar, no more going back and forth to the references section, googling a title, reading the abstract, looping back, etc.
This Google Scholar plugin is meaningfully accelerating my paper reviews. Clicking on a citation immediately pops up a helpful info box from Scholar, no more going back and forth to the references section, googling a title, reading the abstract, looping back, etc. https://t.co/jVwKRDOQ9K
✨ Introducing Keypoint Action Tokens. 🤖 We translate visual observations and robot actions into a "language" that off-the-shelf LLMs can ingest and output. This transforms LLMs into *in-context, low-level imitation learning machines*. 🚀 Let me explain. 👇🧵
RFM-1's latest scaling update enables robots with in-context learning of grasping improvements. The video shows the self-reflective reasoning capability — after a few tries and failing, the robot has an internal dialogue, hypothesizing that its current gripper is not suited for…
Snap presents MyVLM Personalizing VLMs for User-Specific Queries Recent large-scale vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and generating textual descriptions for visual content. However, these models lack an understanding of
One year ago, we first introduced BEHAVIOR-1K, which we hope will be an important step towards human-centered robotics. After our year-long beta, we’re thrilled to announce its full release, which our team just presented at NVIDIA #GTC2024. 1/n
Introducing Yell At Your Robot (YAY Robot!) 🗣️- a fun collaboration b/w @Stanford and @UCBerkeley 🤖 We enable robots to improve on-the-fly from language corrections: robots rapidly adapt in real-time and continuously improve from human verbal feedback. YAY Robot enables…
I had the pleasure of visiting @CMU_Robotics over the past two days to give a VASC seminar talk and a guest lecture. Thanks @GuanyaShi for the amazing host! 🙌 The seminar talk was about our recent work on "Foundation Models for Robotic Manipulation": youtu.be/akDSG9FsoCk 🤖
AK @_akhaliq
311K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxJim Fan @DrJimFan
232K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pXiaolong Wang @xiaolonw
11K Followers 966 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_RoboticsTed Xiao @xiao_ted
11K Followers 682 Following I teach robots to be smarter @GoogleDeepMind. Tweets about robot learning, scaling, and large models. Opinions my own.Fei Xia @xf1280
6K Followers 697 Following Research Scientist at @GoogleDeepMind, Robot Learning, Computer Vision. PhD from @StanfordAILab @StanfordSVL, previously @Tsinghua_Uni. #AGI through EmbodimentElliott / Shangzhe Wu @elliottszwu
5K Followers 771 Following Postdoc @StanfordSVL working on unsupervised 3D perception and inverse rendering, PhD from @Oxford_VGG. Public office hours: https://t.co/iSSemSi1NQYuzhe Qin @QinYuzhe
2K Followers 562 Following Robot Learning @ UC San Diego; prev: @NVIDIA Robotics @GoogleXDeepak Pathak @pathak2206
16K Followers 316 Following I study topics in AI (machine learning, robotics & computer vision).Chris Paxton @chris_j_paxton
8K Followers 2K Following Mostly posting about robots. Embodied AI @hellorobotinc, formerly @AIatMeta, @NVIDIAAI, @zoox. All views my own.Aravind Rajeswaran @aravindr93
3K Followers 168 Following Research Scientist at FAIR (@MetaAI) Formerly at @OpenAI and @GoogleAI PhD from @uwcse and BTech from @iitmadrasAbhishek Gupta @abhishekunique7
5K Followers 640 Following Assistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at BerkeleyDanfei Xu@ICRA24 @danfei_xu
6K Followers 1K Following Assistant Prof. at Georgia Tech @ICatGT, researcher at @NVIDIAAI | Ph.D. @StanfordAILab | Making robots smarterJacky Liang @jackyliang42
4K Followers 736 Following Research Scientist @GoogleDeepMind working on foundation models for robotics. PhD @CMU_Robotics @iamlab_cmu. Prev. intern @NVIDIAAI. Writes @Last_Week_in_AIHaoyu Xiong @Haoyu_Xiong_
2K Followers 2K Following Student researcher @CMU_Robotics/ I work on robotic agents in the real world #robotlearningKen Goldberg @Ken_Goldberg
17K Followers 8K Following artist, @UCBerkeley engineering prof, @AmbiRobotics chief scientist, robots, rockets, redwoods, rebels.Tongzhou Mu 🤖 @ICL.. @tongzhou_mu
1K Followers 516 Following PhD student at UC San Diego w/ @HaoSuLabUCSD | Empowering 🤖 with data | Previously @NVIDIA @alexa99 @IntelAI @MSFTResearchZipeng Fu @zipengfu
12K Followers 1K Following Stanford AI & Robotics PhD @StanfordAILab | Creator of Mobile ALOHA, Robot Parkour | Past: Google DeepMind, CMU, UCLAAjay Sridhar @ajaysridhar0
7 Followers 108 FollowingAbhinav Kumar @Abhinav42443735
1 Followers 921 FollowingMINGLI @ming_li93434
24 Followers 176 FollowingWilbert @wpumacay7567
7 Followers 342 FollowingRay Shao @ZlS123583
6 Followers 87 FollowingNHA VIET MOI @nhavietmoi
6 Followers 191 FollowingTongzhou Wang @TongzhouWang
1K Followers 1K Following representation of type 1→2 agi @mit Ex @pytorch @MetaAI @berkeley_aiSilence147 @Silence1471
3 Followers 24 FollowingKarush Suri @karush_
507 Followers 655 Following Reinforcement Learner @RecursionPharma swimmer & comic fan Past @GoogleAI @borealisai @eceuoftTianjun Zhang @tianjun_zhang
1K Followers 776 Following Project Lead of RAFT, Gorilla, Berkeley Function Calling Leaderboard, and member of LiveCodeBench, PhD student at Berkeley-AI-ResearchFayshes @fayshes68248
0 Followers 381 FollowingSandraFowler @EaRTth5fC3x4G8K
0 Followers 238 FollowingAntony John Blinken @JacobHughe152
12 Followers 265 Following My Private account. For my Business partnership Husband, dad, (very) amateur guitarist, and the 71st Secretary of State serving under the leadership.Dongyu Luo @lewisluo49
1 Followers 20 FollowingGuanya Shi @GuanyaShi
4K Followers 942 Following Assistant Professor @CMU_Robotics @SCSatCMU. Lead the Learning and Control for Agile Robotics Lab @LeCARLab. Ph.D. from @Caltech. Postdoc @uwcse. He/Him/His.MikaStars★ @MikaStars39_
185 Followers 636 Following Second year B.A. / B.S. in @ZJU_China Prev: Bsc in @Polytechnique Devoted in Efficient LLM Architecture & Interpretability Vocal Guitar / Anime / 吹学家Bill Zheng @BillZheng155508
64 Followers 71 Following EECS Undergraduate at Berkeley | Research at Robotics AI & Learning Lab @ BAIRAaditya ; @Aaditya26082004
564 Followers 7K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈Pranav Atreya @pranav_atreya
2 Followers 46 Following CS PhD student @Berkeley_AI, prev undergrad @UTAustinShear @Shear628320
4 Followers 431 FollowingSonglin Yang @SonglinYang4
2K Followers 2K Following PhD student @MIT_CSAIL. Prev. @ShanghaiTechUni @SUSTechSZ. Working on scalable and principled methods in #ML & #NLProc. INTP | 5w4 | sx/sp | she/herDertesh @dertesh47063
8 Followers 407 FollowingQuanquan Peng @QuanquanPeng03
29 Followers 206 Following @SJTU1896 ACM Class 2025 | Incoming RA @ UW 🤖Robotics, RL/IL, Embodied AIWendy @Wendy419642709
7 Followers 415 Following文 杨 @wenyang1034488
2 Followers 110 FollowingClock @Clock_Zh
47 Followers 422 FollowingIlya Zisman @suessmannn
26 Followers 137 FollowingMikael Kukko @mikaelkukko
42 Followers 904 FollowingSakuye Entertainer�.. @SakuyeEnte16474
420 Followers 3K Following Use my promo-code ''SAKUYE'' to register on 1xbet & you'll get 300% bonus on your first deposit, goodluck.Jiahui Zhang @JiahuiZhan91479
6 Followers 58 FollowingWuao Liu @liu_wuao
203 Followers 1K Following CS PhD Student @UMassAmherst | Prev @UMRobotics @ZJU_China | Computer Vision, AI4ScienceHokin Deng @DengHokin
34 Followers 435 FollowingYouJiacheng @YouJiacheng
58 Followers 256 FollowingAditya Wagh @adityamwagh
122 Followers 1K Following Computer Vision Engineer • @nyuniversity & @bitspilaniindia alum • Interests ∈ {3D Vision, AI, Robotics}Hongyu Li @Hongyu_Lii
167 Followers 378 Following CS Ph.D. student at @BrownUniversity @BrownCSDept 🐻working on robotics and computer vision | Prev: @KhouryCollege, @rpi, @HondaMingfu Liang @LiangMingfu
166 Followers 1K Following Ph.D. Candidate at Northwestern University, exploring Incremental, Continual, and Lifelong Learning on Multi-modality Foundation ModelDexHand @dexhandv2
534 Followers 273 Following DexHand is the ultimate research tool for physical dexterous manipulation tasks requiring human-like dexterity. Now in Beta! Posts by @trentshumayWilliam Li @Williamiumli
25 Followers 139 Following Incoming Ph.D. student @UCSanDiego, M.S.E. in CS @JohnsHopkins, B.S. in CS at SCUTOpheliaRaphael @on7bSc10AZTmFq
6 Followers 368 FollowingPoorvi @Poorvi_rh
67 Followers 229 Following CV/Robotics @ Stealth Startup | MS Computer Vision @CMU | CSE @IIT BombaySophia @sopharicks
694 Followers 1K Following Former ballerina turned AI writer& communicator. OpenAI alumni. Fan of astrophysics, open-source, conversations about singularity. Founder of BuzzRobot.Michi Yasunaga @michiyasunaga
3K Followers 870 Following CS PhD @Stanford working on language models and multimodal models. Previously @Meta @GoogleDeepMind @YaleLihan Zha @LihanZha
65 Followers 66 Following Incoming PhD @Princeton working on robotics. Prev: BS @Tsinghua_uni, intern @StanfordMartin Fan @perfectoid_ai
412 Followers 7K FollowingSaman Farid @samanfarid
2K Followers 1K Following Building the worlds largest robot workforce @goformic // Previously built AI fund for Baidu and AI/ML venture studio @cometlabsAK @_akhaliq
311K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80GxJim Fan @DrJimFan
232K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Yann LeCun @ylecun
715K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Andrej Karpathy @karpathy
983K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Karol Hausman @hausman_k
23K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Google DeepMind @GoogleDeepMind
946K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pXiaolong Wang @xiaolonw
11K Followers 966 Following Assistant Professor @UCSDJacobs Postdoc @berkeley_ai PhD @CMU_RoboticsTed Xiao @xiao_ted
11K Followers 682 Following I teach robots to be smarter @GoogleDeepMind. Tweets about robot learning, scaling, and large models. Opinions my own.Danijar Hafner @danijarh
14K Followers 872 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciFrançois Chollet @fchollet
471K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Dinesh Jayaraman @dineshjayaraman
2K Followers 575 Following Assistant Professor at University of Pennsylvania. Computer vision, machine learning, robotics.Tongzhou Wang @TongzhouWang
1K Followers 1K Following representation of type 1→2 agi @mit Ex @pytorch @MetaAI @berkeley_aiSong Han @ICLR'24 @songhan_mit
6K Followers 146 Following Assoc. Prof. @MIT, Distinguished Scientist @NVIDIA, cofounder of DeePhi (now part of AMD) and OmniML (now part of NVIDIA). PhD @Stanford. Efficient AI computingTianjun Zhang @tianjun_zhang
1K Followers 776 Following Project Lead of RAFT, Gorilla, Berkeley Function Calling Leaderboard, and member of LiveCodeBench, PhD student at Berkeley-AI-ResearchSonglin Yang @SonglinYang4
2K Followers 2K Following PhD student @MIT_CSAIL. Prev. @ShanghaiTechUni @SUSTechSZ. Working on scalable and principled methods in #ML & #NLProc. INTP | 5w4 | sx/sp | she/herFu-En Yang @FuEnYang1
263 Followers 892 Following Research Scientist @NVIDIAAI | Ph.D. @ NTU | Prev. Research Intern @NVIDIAAI | Vision & Language | Multimodal AISirui Chen @eric_srchen
98 Followers 186 Following PhD in Stanford CS, Prev Undergrad at HKU. Interested in roboticsLihan Zha @LihanZha
65 Followers 66 Following Incoming PhD @Princeton working on robotics. Prev: BS @Tsinghua_uni, intern @StanfordMichi Yasunaga @michiyasunaga
3K Followers 870 Following CS PhD @Stanford working on language models and multimodal models. Previously @Meta @GoogleDeepMind @YaleAshwin Balakrishna @ashwinb96
229 Followers 142 Following Researcher @ToyotaResearch. Previously PhD at @berkeley_ai. Interested in algorithms for large-scale robot learning.Kartik Ramachandruni @kartikvrama
82 Followers 153 Following PhD Student in Robotics at the RAIL Lab, Georgia Tech. Advised by Prof. Sonia ChernovaJin Cheng @catachiii
315 Followers 1K Following Doctotal Student with @crl_ethz @ETH, working on RL, robotics, and more | Previously @MPI_IS @Tsinghua_Uni - Cells interlinked within cells, interlinked.Irmak Guzey @irmakkguzey
84 Followers 156 Following Graduate research assistant in @CILVRatNYU. Working on robot learning approaches. (she/her)Ilir @Ilir_AI
2K Followers 391 Following Robotics & AI | @micropsi | Ex-@Siemens | Host @KinematicConvos |Yu (Bryan) Zhou @yu_bryan_zhou
498 Followers 762 Following Incoming PhD @CS_UCLA, currently @StanfordSVLHeeger @GChongkai
205 Followers 354 Following PhD student of the National University of Singapore. Interested in robot learning. WeChat: 18800100036Norman Di Palo @normandipalo
781 Followers 169 Following deep learning + robots @imperialcollege, x @deepmind 👨🏻🚀Thomas Kollar @tkollar
307 Followers 465 Following Research Manager @ TRI; ex-Amazon; ex Apple. CMU / MITBalakumar Sundaraling.. @balakumar_
196 Followers 332 Following Senior Research Scientist @NVIDIA | Robotics PhD @UUtah | Robot Manipulationnoahdgoodman @noahdgoodman
2K Followers 109 Following Professor of natural and artificial intelligence @Stanford. Research Scientist at @GoogleDeepMind. (@StanfordNLP @StanfordAILab etc)Snehal Jauhri @SnehalJauhri
314 Followers 431 Following ML for Robotics | PhD candidate at PEARL lab, TU Darmstadt with @GeorgiaChal & @ias_tudarmstadt | Building AI for the Home RobotJun Yamada @junjungoal
409 Followers 971 Following DPhil student @ University of Oxford, A2I Lab (@a2i_oxford) | Robot Learning, ManipulationKatherine Liu @ ICRA .. @robo_kat
66 Followers 195 Following Research Scientist @ToyotaResearch, previously Robotics PhD @MIT_CSAIL. Excited about machine learning for embodied intelligence. Opinions my own!Shuyan Zhou @shuyanzhxyc
2K Followers 599 Following Ph.D. student @LTIatCMU working on agents | she/theyYang Zhou 🤖 @yangrobotics
241 Followers 381 Following Ph.D. candidate at NYU ARPL @nyuniversity. working on Robotics, Computer Vision. ex-@ShanghaiTechUni. ex-@Microsoft Intern. Use my name instead of pronounsSasha Rush (ICLR) @srush_nlp
52K Followers 465 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzGaurav Sukhatme @gauravsukhatme
694 Followers 306 Following Robotics & Computer Science Professor, Director of USC School of Advanced Computing, Executive Vice Dean at USC Viterbi School of Engineering. Amazon Scholar.Oliver Groth @omgroth
2K Followers 439 Following Research Scientist @GoogleDeepMind. PhD from @oxfordrobots and @Oxford_VGG. AI Researcher, Robot Trainer, Video Game Nerd. All views are my own.Donglai Xiang @DonglaiXiang
1K Followers 731 Following Research Scientist at Nvidia. Previously Ph.D. from Carnegie Mellon University; visiting researcher at Meta Reality Labs.Brandon McKinzie @mckbrando
2K Followers 2K Following Multimodal LLMs @Apple. Prev: Physics/CS @UCBerkeley.Han Xue @HanXue012
129 Followers 508 Following Ph.D. student @sjtu1896 | Interesed in Robotics & 3D VisionFanqi Lin @lfqirrrrr
16 Followers 71 Following PhD Student, IIIS, Tsinghua University. Interested in Embodied AI, Robotics. Email: [email protected]Robotic Systems Lab @leggedrobotics
12K Followers 177 Following The Robotic Systems Lab designs machines, creates actuation principles, and builds up control technologies for autonomous operation in challenging environments.Huangyuan @Huangyu58589918
67 Followers 339 Following Ph. D in Computer Science at Harvard University @AmazonScienceZheyuan Hu @real_ZheyuanHu
112 Followers 107 Following Undergrad Researcher at https://t.co/LWtGI4Qljm Applying to PhD in robot learning UCB 23 CS+Applied MathJan Leike @janleike
44K Followers 322 Following ML Researcher, co-leading Superalignment @OpenAI. Optimizing for a post-AGI future where humanity flourishes.Jensen Gao @jensen_gao
100 Followers 27 Following CS PhD Student @StanfordAILab | Previously BS/MS @Berkeley_EECShengyuan-hu @HengyuanH
227 Followers 56 FollowingAdam Raudonis @adamraudonis
1K Followers 829 Following Software @ Tesla Autopilot & Optimus. Interested in clean tech, space and AIKexin Shi @teenhaci
93 Followers 56 FollowingTakahiro Miki @ki_ki_ki1
2K Followers 763 Following PhD student at ETH Zurich RSL.スイスでロボットの研究. Reinforcement learning Locomotion. DARPA SubT Challenge winner.Yuanchen_Ju @ju_yuanchen
273 Followers 238 Following 鞠沅辰🧸|Currently RA @Tsinghua_IIIS 🌍|Advised by Prof. Huazhe Xu🍯|Interested in Multimodal learning🌵 & Robot Learning🤖️|INTJ ♒️Happy to share that UniSim universal-simulator.github.io was selected for an Outstanding Paper Award at #ICLR2024. Check out the oral presentation today at 10:30am Oral 1B and poster on Wed at 4:30-6:30pm #87. Thanks to the award committee @eunsolc, @katjahofmann, @liu_mingyu,…
Announcing the #ICLR2024 Outstanding Paper Awards: blog.iclr.cc/2024/05/06/icl… Shoutout to the awards committee: @eunsolc, @katjahofmann, @liu_mingyu, @nanjiang_cs, @guennemann, @optiML, @tkipf, @CevherLIONS
Tesla Optimus can arrange batteries in their factories, ours can do skincare (on @QinYuzhe)! We opensource Bunny-VisionPro, a teleoperation system for bimanual hand manipulation. The users can control the robot hands in real time using VisionPro, flexible like a bunny. 🐇…
Simple Predictive Sampling solves bimanual manipulation tasks in near real time. Pretty neat, no? youtu.be/aCNCKVThKIE?si…
Trying to be useful lately!
It was a great time to host @DrJimFan in Boston! Had a lot of interesting discussions, and most importantly, a visit to my Generative Boba shop!
Enjoyed the @nvidia-@MIT lunch meetup today w/ @DrJimFan! I was representing both sides for the first time today🙂. Great reconnecting w/ these wonderful colleagues at MIT too! @BoyuanChen0, @ZhutianYang_, @avivnet @NishanthJKumar1, @hyojinbahng, @haoshu_fang, @TheAndiPenguin
Thanks, John, for summarizing the takeaways from AnyGrasp! Improve data efficiency, trust in real-world data—it will pay off
AnyGrasp Paper Review: How To Teach A Robot To Grasp Anything arxiv.org/abs/2212.08333
🚨Update on RADIO - a single vision foundation model to rule them all! You get CLIP, DINO, SAM features in a single pass! Like a Swiss army knife for CV. Code: github.com/NVlabs/RADIO Paper: arxiv.org/abs/2312.06709 - Accepted at CVPR2024 - Arxiv update - V2.1 model with better…
Check out robots using their entire body to increase their workspace and the force they apply. We enable explicit whole-body force control to expand the ability of mobile quadrupeds. Find details: tif-twirl-13.github.io/learning-compl… Work led by @gabe_mrgl @TifannyPortela At…
Introducing DrEureka🎓, our latest effort pushing the frontier of robot learning using LLMs! DrEureka uses LLMs to automatically design reward functions and tune physics parameters to enable sim-to-real robot learning. DrEureka can propose effective sim-to-real configurations…
We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works. I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more…
MLPs are so foundational, but are there alternatives? MLPs place activation functions on neurons, but can we instead place (learnable) activation functions on weights? Yes, we KAN! We propose Kolmogorov-Arnold Networks (KAN), which are more accurate and interpretable than MLPs.🧵
📢 ManiSkill 3 beta is out! Simulate everything everywhere all at once 🥯 - 18K RGBD FPS on 1 GPU, 3K on Colab! - Diverse parallel GPU sim - Tons of new robots/tasks All open-sourced: github.com/haosulab/ManiS… Photo: MS3 Tasks w/ scenes from AI2THOR and ReplicaCAD 🧵(1/6)
Amazing cross-platform system for multiple end-effectors. Nice work @xuxin_cheng and super fast move!
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
Indeed, we find that hands, even when used with limited DoFs, can perform a large set of tasks & outperform grippers because of the additional stability! This also allows for smoother and more intuitive teleop (e.g. no retargeting issue), leading to much faster data collection :D
Very incredible to see how capable VR-controlled robot hands can be. While there is a lot of debate on grippers vs hands, why not think of hands as just grippers that offer more redundancy and stability? Congrats on the great work!
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
Imitation learning works™ – but you need good data 🥹 How to get high-quality visuotactile demos from a bimanual robot with multifingered hands, and learn smooth policies? Check our new work “Learning Visuotactile Skills with Two Multifingered Hands”! 🙌 toruowo.github.io/hato/
@gdb @nvidia So appreciative of Jensen’s contribution to #AI! This was when he delivered the world’s first @nvidia DGX-1 to our lab @StanfordSVL back in 2016! 😍
@nvidia CEO JensenHuang delivered the world's 1st AI supercomputer DGX-1 today to SAIL! @jcniebles @silviocinguetta
Every day I am humbled by how smart and agile and persistent animals are