Republican and Democratic voters share common ground when it comes to the University of California: Both sides express widespread support for UC, its research, medical centers and ability to elevate the lives of students, a statewide poll shows. (via @latimes)…
Inherent biases and imbalances in robot data can make training steerable VLA policies challenging. We introduce CAST, a method to augment datasets with counterfactuals to induce better language following
cast-vla.github.io ← paper, code, data, and more available here! 🧵
They say the best time to tweet about your research was 1 year ago, the second best time is now. With RAI formerly known as Boston Dynamics AI Institute, we present DiffuseCloC - the first guidable physics-based diffusion model. diffusecloc.github.io/website/
🤖 Initial code release is up for VideoMimic Real2Sim!
github.com/hongsukchoi/Vi…
VideoMimic is a real-to-sim-to-real pipeline for deploying humanoids in the real world.
It supports:
- Human motion capture from video
- Environment reconstruction for simulation from video
-…
🤖 Initial code release is up for VideoMimic Real2Sim!
github.com/hongsukchoi/Vi…
VideoMimic is a real-to-sim-to-real pipeline for deploying humanoids in the real world.
It supports:
- Human motion capture from video
- Environment reconstruction for simulation from video
-…
For everyone interested in precise 📷camera control 📷 in transformers [e.g., video / world model etc]
Stop settling for Plücker raymaps -- use camera-aware relative PE in your attention layers, like RoPE (for LLMs) but for cameras!
Paper & code: liruilong.cn/prope/
Artifacts in your attention maps? Forgot to train with registers? Use 𝙩𝙚𝙨𝙩-𝙩𝙞𝙢𝙚 𝙧𝙚𝙜𝙞𝙨𝙩𝙚𝙧𝙨! We find a sparse set of activations set artifact positions. We can shift them anywhere ("Shifted") — even outside the image into an untrained token. Clean maps, no retrain.
Excited to present VideoMimic this week at #CVPR2025! 🎥🤖
📌 POETs Workshop "Embodied Humans" Spotlight Talk | June 12, Thu, -10:10 | Room 101B
📌 Agents in Interaction: From Humans to Robots Poster #182-#201 | June 12, Thu, -12:15 | ExHall D
Come by and chat!…
At @theworldlabs, we built a new Gaussian splatting web renderer with all the bells and whistles we needed to make splats a first-class citizen of the incredible @threejs ecosystem. Today, we're open sourcing Forge under the MIT license.
Excited to introduce PyRoki ("Python Robot Kinematics"): easier IK, trajectory optimization, motion retargeting... with an open-source toolkit on both CPU and GPU
RDM is now published at Nature Methods! This was a 3 year effort and my introduction to academic research. I’m fortunate to have been mentored by one of the smartest people I’ve ever met @the_legitamit!
RDM is now published at Nature Methods! This was a 3 year effort and my introduction to academic research. I’m fortunate to have been mentored by one of the smartest people I’ve ever met @the_legitamit!
Introducing St4RTrack!🖖
Simultaneous 4D Reconstruction and Tracking in the world coordinate feed-forwardly, just by changing the meaning of two pointmaps!
st4rtrack.github.io
169 Followers 630 FollowingCS PhD @umdcs, Research Associate II @MBZUAI. Prev: Intern at INK Lab @CSatUSC; undergraduate @IITDelhi. Working on Machine Learning.
10K Followers 2K Followingpostdoc @Oxford_VGG 🇬🇧 | 3D Gen AI | PhD alum @KaustVision 🇸🇦@TU_Muenchen 🇩🇪 | @fihmai founder | my @tedX talk about AI inequality: https://t.co/Y24DtOsASJ
4K Followers 917 FollowingAssistant Professor at UPenn. Research interests: Neural Scene Representation, Neural Rendering, Human Performance Modeling and Capture.
32K Followers 3K FollowingFocused on machine learning & society. Previously @Salesforce Research via @MetaMindIO. @Harvard '14, @Sydney_Uni '11. 🇦🇺 in SF.
Also @ https://t.co/IamBQbjRiN
4K Followers 917 FollowingAssistant Professor at UPenn. Research interests: Neural Scene Representation, Neural Rendering, Human Performance Modeling and Capture.
19K Followers 3K FollowingMostly posting about robots.
currently AI @agilityrobotics
prev embodied AI @AIatMeta, @NVIDIAAI. All views my own.
writing: https://t.co/iNLA4djfZo
16K Followers 5K FollowingFull of childlike wonder. Teaching robots manners. UT Austin PhD candidate. 🆕 RL Intern @ Apptronik. Past: Boston Dynamics AI Institute, NASA JPL, MIT ‘20.
23K Followers 380 FollowingCo-Founder & CEO @SkildAI, Faculty @CarnegieMellon.
PhD @UCBerkeley.
I study topics in AI (machine learning, robotics & computer vision).