Diffusion Models; Large World Model; UniSim; TRPO; SAC; Ring Attention; MAML; HER; Domain Randomization; Decision Transformer; LLM as Zero-Shot Planners; RFM-1cs.berkeley.edu/~pabbeel Berkeley, CAJoined August 2010
What separates lab robot demos and robots in production? Extremely high reliability. This requires our model to robustly handle many long-tail scenarios like the one in attached picture, where one stray barcode label can tank the 99.95% sortation accuracy requirements. (1/n)
What separates lab robot demos and robots in production? Extremely high reliability. This requires our model to robustly handle many long-tail scenarios like the one in attached picture, where one stray barcode label can tank the 99.95% sortation accuracy requirements. (1/n) https://t.co/DJlsasHu9K
resonates with my own experience:
robot demo --> INSANE PAIN --> robot creating value in production
luckily I am hopeful we have by now paid most of our dues at Covariant :)
resonates with my own experience:
robot demo --> INSANE PAIN --> robot creating value in production
luckily I am hopeful we have by now paid most of our dues at Covariant :)
RFM-1's latest scaling update enables robots with in-context learning of grasping improvements.
The video shows the self-reflective reasoning capability — after a few tries and failing, the robot has an internal dialogue, hypothesizing that its current gripper is not suited for…
Building a truly general AI for robotics must be done in the real world. To make this happen, our focus lies in addressing critical issues and delivering true value to our customers.
During the recent #NvidiaGTC2024, @peterxichen highlighted how generative AI is reshaping the…
Guess, what?! Nanni AI has now translated 1 million infant cries globally 🎉 🎉 🎉 That's a lot of "waaaahs" and a huge milestone for us.
We're giving voice to infants all over the world and empowering parents to provide better and rapid care for their little ones. Onward to…
What makes the training data for RFM-1 unique? A few properties that are distinctive from typical lab data: 1. real-world complexity: picking from extremely cluttered scenes where item occlusion presents a challenge for reliability. 2. high-speed handling: the dynamics of…
What makes the training data for RFM-1 unique? A few properties that are distinctive from typical lab data: 1. real-world complexity: picking from extremely cluttered scenes where item occlusion presents a challenge for reliability. 2. high-speed handling: the dynamics of…
This project looks super fun! And it is also wonderful to see TD-MPC2 works so well on this benchmark compared to PPO/SAC/Dreamerv3! https://t.co/AOM3TGRKv5
An awesome and refreshing benchmark by Carlo and collaborators featuring practically useful tasks like truck unloading. All open-source, built on MuJoCo and accelerated with JAX!
An awesome and refreshing benchmark by Carlo and collaborators featuring practically useful tasks like truck unloading. All open-source, built on MuJoCo and accelerated with JAX!
Era of humanoids is coming, but not always easy to afford one or run real world experiments. Luckily there are also many many research challenges that can be investigated in simulation, join the fun, try to get your AI to do well on #HumanoidBench!
Era of humanoids is coming, but not always easy to afford one or run real world experiments. Luckily there are also many many research challenges that can be investigated in simulation, join the fun, try to get your AI to do well on #HumanoidBench!
Infra behind RFM-1: Our Robotics Foundation Model is trained on several clouds; this gives us more GPUs for high experimentation velocity. Orchestration across clouds & serving entirely managed by @skypilot_org , lifting lots of infra burden off our team. More improvements soon!
This week Covariant announced the launch of RFM-1 (Robotics Foundation Model 1).
RFM-1 is the result of, among other things, a massive trove of data collected from the deployment of Covariant’s Brain AI platform.
Read more on Covariant here: tcrn.ch/3VgtD3l
Looking to hire top AI talent?
We've compiled a list of the brilliant @berkeley_ai Ph.D. Graduates of 2024 who are currently on the academic and industry job markets. (Thanks to our friends @StanfordAILab for the idea!)
Check it out here:
bair.berkeley.edu/blog/2024/03/1…
.@CovariantAI announces a truly groundbreaking achievement. With the release of RFM-1: a Robotics Foundation Model that provides robots the human-like ability to reason. 🔗 Read more on this advancement: wired.com/story/quest-ai…
185K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
58K Followers 638 FollowingDirector, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
33K Followers 966 FollowingCofounded & running @ml_collective.
Host of Deep Learning Classics & Trends.
Research at Google DeepMind.
DEI/DIA Chair of ICLR & NeurIPS.
Writing https://t.co/IbycyGfnDR
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
45K Followers 2K FollowingML / AI researcher, emphasis on theory.
Research Director and Canada CIFAR AI Chair, @VectorInst
Professor, @UofT (Statistics/CS)
21K Followers 1K FollowingFoundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSci
1K Followers 1K FollowingI'm a small dynamical system, trying to make sense of a bigger dynamical system. Previously Phd student with @srdjan_ostojic, in search of a new home.
2K Followers 5K FollowingI love composite indexes, algorithms, finance, PR, data visualization, AI and marketing strategy. Building marketing agency @greenflagdigtl. e/acc curious.
52K Followers 1K FollowingSnowflake delivers the #DataCloud — a global network where thousands of organizations mobilize data with near-unlimited scale, concurrency, and performance.
639 Followers 5K FollowingGustave Mousa Manager principal publiques conseiller pédagogique économiques chef partie Géopolitique Républicaines de Rénovations laïque Des esprits LTD
109 Followers 453 FollowingExploring the latest in AI tools and technologies. Join me on a journey into the future of innovation and automation. #AI #chatgpt #TechEnthusiast
3 Followers 89 FollowingA UK based media company using 3D scanning technologies (#3DGS, NERF, LiDAR, Photogrammetry) to put people in the Metaverse.
AKA @Scannerian1
185K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
21K Followers 1K FollowingFoundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSci
50K Followers 505 FollowingDistinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. Sustainability
94K Followers 148 FollowingWorking on AI safety, past on robotics, applied research @OpenAI; Writing ML blogs to help myself & others to learn; Ideas my own.
18K Followers 1K FollowingComputer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.
97K Followers 658 FollowingI research intelligence to understand what we are, and to harness it wisely. I lead a wonderfully creative AI team at @GoogleDeepMind who inspire me everyday.
11K Followers 1K FollowingCTO at Verdant Robotics, Robotics & Computer Vision Professor at Georgia Tech (on leave). Before: sabbatical at KUL, stints at Skydio, Facebook B*8, Google AI.
859 Followers 30 FollowingMatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: https://t.co/E3XexKHUSM
410 Followers 647 FollowingCEO at https://t.co/nK8MqpL4Il (formerly: X2 AI Tess) | free 24/7 AI mental health support | de-escalated 3.5k suicides see: https://t.co/reu4kZM3kt
12K Followers 263 FollowingFounder @leptonai. @UCBerkeley alumni. ex @google & @facebook. ex vp @AlibabaGroup. Open source work on caffe, @pytorch, @tensorflow, & @onnxai.
229K Followers 3K Following@NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
39K Followers 1K FollowingCTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
12K Followers 953 FollowingGP, Head Growth Fund @a16z | 👨👩👧👦 | “The key is not the will to win...everybody has that. It is the will to prepare to win that is important.”-Bob Knight
382 Followers 82 FollowingAssistant Professor at Yonsei | Postdoc @UCBerkeley with @pabbeel | PhD @USC with @JosephLim_AI | Reinforcement Learning and Robot Learning