Tyler Lum @tylerlum23

CS PhD student @Stanford | Robotics & AI | Prev NVIDIA, Tesla, UBC tylerlum.github.io Palo Alto, CA Joined October 2016

Tweets

32
Followers

386
Following

320
Likes

97

Nathan Ratliff @robot_trainer

3 months ago

The Dex team at NVIDIA is defining the bleeding edge of sim2real dexterity. Take a look below 🧵 There's a lot happening at NVIDIA in robotics, and we’re looking for good people! Reach out if you're interested. We have some big things brewing (and scaling :)

4 51 340 28K 143

Download Video

Tyler Lum @tylerlum23

3 months ago

We find keypoint trajectories to be a powerful interface between VLM planning & RL control VLM: Generates object + hand motion plan from a task prompt & RGB-D image (perception + commonsense) RL policy: Conditioned on the plan, learns low-level dexterous control (0-shot sim2real)

Vincent de Bakker @v_debakker

3 months ago

1 14 63 18K 38

Download Video

1 2 33 4K 17

Kushal @kushalk_

3 months ago

Teleoperation is slow, expensive, and difficult to scale. So how can we train our robots instead? Introducing X-Sim: a real-to-sim-to-real framework that trains image-based policies 1) learned entirely in simulation 2) using rewards from human videos. portal-cornell.github.io/X-Sim

4 42 114 9K 62

Download Video

The Humanoid Hub @TheHumanoidHub

5 months ago

Boston Dynamics collaborated with NVIDIA to demonstrate DextrAH-RGB, a workflow for dexterous grasping from stereo RGB input. The end-to-end policy for Atlas robot, trained entirely in NVIDIA Isaac Lab, transfers zero-shot from simulation to the real robot.