Peter Chen @peterxichen
Covariant CEO and Co-Founder. Previously @OpenAI, @UCBerkeley PhD. Joined December 2017-
Tweets121
-
Followers3K
-
Following1K
-
Likes1K
AI winter? No. Even if GPT-5 plateaus. Robotics hasn’t even started to scale yet. Embodied intelligence in the physical world will be a powerhouse for economic value. Friendly reminder to everyone that LLM is not all of AI. It is just one piece of a bigger puzzle.
AI winter? No. Even if GPT-5 plateaus. Robotics hasn’t even started to scale yet. Embodied intelligence in the physical world will be a powerhouse for economic value. Friendly reminder to everyone that LLM is not all of AI. It is just one piece of a bigger puzzle.
Synthetic data is the future! The advantage of synthetic data is the ability to control the data distribution, but not avoid real world data... you still require real world data to augment or train the generation engine.
Synthetic data is the future! The advantage of synthetic data is the ability to control the data distribution, but not avoid real world data... you still require real world data to augment or train the generation engine.
.@CovariantAI's RFM-1 model: The robot fails to suction grasp the socks. Then, thru internal dialogue, it devises a strategy of picking up the socks by the paper label. This adaptive behavior is hard to program with code, let alone scale it to more bots, objects & situations.
resonates with my own experience: robot demo --> INSANE PAIN --> robot creating value in production luckily I am hopeful we have by now paid most of our dues at Covariant :)
resonates with my own experience: robot demo --> INSANE PAIN --> robot creating value in production luckily I am hopeful we have by now paid most of our dues at Covariant :)
“We believe there will be a huge breadth of robotic form factors. Different types of hardware for different use cases— this all depends on frequency, speed, cost of installation, etc." - @peterxichen at @NVIDIAGTC
What makes the training data for RFM-1 unique? A few properties that are distinctive from typical lab data: 1. real-world complexity: picking from extremely cluttered scenes where item occlusion presents a challenge for reliability. 2. high-speed handling: the dynamics of…
What makes the training data for RFM-1 unique? A few properties that are distinctive from typical lab data: 1. real-world complexity: picking from extremely cluttered scenes where item occlusion presents a challenge for reliability. 2. high-speed handling: the dynamics of…
I often get asked "What's different about the current wave of #EGI - Embodied General Intelligence" 🟢 Agent making contacts, not avoiding them! There is a subtle but important nuance in what makes robotics hard, it's not the #contacts, it's the #contact_switches
Wednesday at @NVIDIAGTC: The impact of generative AI on robotics with @peterxichen and a panel of experts. Discover key insights on overcoming technical hurdles, seizing opportunities, and strategies for commercial success. nvidia.com/gtc/session-ca…
This is an amazing effort to collect more robotics data. I especially love that they have both structured data like multi-view stereo and more modern modality like text annotations. The key gap in robotics is data and it’s great to see the progress. Congrats @SashaKhazatsky
This is an amazing effort to collect more robotics data. I especially love that they have both structured data like multi-view stereo and more modern modality like text annotations. The key gap in robotics is data and it’s great to see the progress. Congrats @SashaKhazatsky
Infra behind RFM-1: Our Robotics Foundation Model is trained on several clouds; this gives us more GPUs for high experimentation velocity. Orchestration across clouds & serving entirely managed by @skypilot_org , lifting lots of infra burden off our team. More improvements soon!
We are unlikely to create an “ImageNet for Robotics”. In retrospect, ImageNet is such a homogeneous dataset. Labeled images w/ boxes. Generalist robot models will be fueled by the Data Pyramid, blending diverse data sources from web and synthetic data to real-world experiences.
Fully agree. There’s a lot of talk about *models*, but *data* access, governance, safety, attribution, multimodality, engineering, research and production is where the AI action is happening. More education on this is needed because it’s a big part of the safe and responsible…
Fully agree. There’s a lot of talk about *models*, but *data* access, governance, safety, attribution, multimodality, engineering, research and production is where the AI action is happening. More education on this is needed because it’s a big part of the safe and responsible…
Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pDanijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciShane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Rosanne Liu @savvyRL
33K Followers 968 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRAbhishek Gupta @abhishekunique7
5K Followers 639 Following Assistant Professor at University of Washington. I like robots, and reinforcement learning. Previously: post-doc at MIT, PhD at BerkeleyGary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Durk Kingma @dpkingma
35K Followers 348 Following Deep learning, mostly generative models. Prev. Google Brain/DeepMind, founding team @OpenAI. Inventor of the VAE, Adam optimizer, among other things. ML PhD.Yuke Zhu @yukez
15K Followers 464 Following Assistant Professor @UTCompSci | Co-Leading GEAR @NVIDIAAI | CS PhD @Stanford | Building generalist robot autonomy in the wild | Opinions are my ownKeerthana Gopalakrish.. @keerthanpg
13K Followers 824 Following Building Embodied AGI. Research @DeepMind. Opinions my own.yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsMax Jaderberg @maxjaderberg
12K Followers 1K Following Advancing AI. Chief AI Scientist @IsomorphicLabs. Prev: research scientist @DeepMind, co-founder Vision Factory (acq. Google 2014), PhD @Oxford_VGG lab.Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpressDolcie Posusta @DolcieP12699
36 Followers 5K FollowingLaura Liu @lauraqq
20 Followers 412 FollowingCompoSecure @CompoSecure
2K Followers 3K Following CompoSecure, Inc. (Nasdaq: CMPO) is a leader in metal payment cards, security, and authentication solutions.ivy smith @ivy_smith1987
3 Followers 35 Following I am Vietnamese-American, came to the US in 1999, and am currently the founder and owner of a company specializing in selling household appliances.Darrin Lucky88 @rightpointNS
5K Followers 4K Following Tesla for Humanity 🌎Surfing perfect points for my sanity 🌊Ashtanga Yoga for my eight limbs🧘Tesla driver forever🖥️Outremer 55’ future owner 🏴☠️🇨🇦Vanesa Galacio @VaneGalaci
98 Followers 5K FollowingEmilia Thielbar @EThielbar23699
78 Followers 5K Followingivy smith @smith_ivy1987
596 Followers 640 Following I am Vietnamese-American, came to the US in 1999, and am currently the founder and owner of a company specializing in selling household appliances.Max @eddylong33
79 Followers 217 Following Sign Shop Owner in Canada doing 5MM of revenue. Interested in entrepreneurship through acquisition, robotics, and geneticsRuibo Liu @RuiboLiu
2K Followers 1K Following Research Scientist @GoogleDeepMind. AI Research with Humans in Mind.Ulrich Möller @CobotUli
303 Followers 985 Following Robotics and Automation enthusiasts with +100k followers at LinkedIn - Consulting & Marketing #Intralogistics #Robotics #Automation #AI #drones #technologyEmberly Helf @HelEmberl
87 Followers 5K Following➕ SILVERSURFER.ETH .. @7SURFER7SILVER7
26K Followers 203 Following the destroyer. https://t.co/n2d5419R6Y…Dmitry Alimov @dmitryalimov
6K Followers 7K Following Tech VC and entrepreneur. Curious. Investing and building in AI. Built companies in media and tech. Founder @frontiervc. Learned things @harvard, @stanfordDmitri Kharlamov @dmkharlamov
205 Followers 5K FollowingMarge Rudnick @MargeRudni78359
83 Followers 5K FollowingST010-1.. @st01014
592 Followers 5K Following Code synthesizing Carbon-Silicon based lifeform 🖥️🧬 #Coding #Math #Physics #HPC & #AI #RetroTech #Aerospace #AESTHETICS Random #Nerdiness & #ShitpostingGaurav Agarwal @agarwalgaurav
67 Followers 183 Following Founder B2B AI SaaS (In stealth) | 15+ years heading AI development @ Ola, NVIDIA, Texas InstumentsAaliyah Daymude @AaliyaDaym
89 Followers 5K FollowingJordan "JT" Taylor @JTTaylor650
467 Followers 1K Following All-American Tech guy | Howard U Alumni | Nupe♦️| Bay Area born & raised | my views are my ownbizika @bizika7
22 Followers 380 FollowingBirhan Aschalew @birhan_aschalew
117 Followers 776 Following Entrepreneur | Software engineer | Django developer|Mulesoft Developer | #business #technology #digital_marketing #website_development #EntrepreneurJing Chen @ziadghale
237 Followers 2K Following I am a trader and my main job is to actively participate in the financial markets, buying and selling various financial instruments such as stocks, Crypto, optiKhan Bhebhura @Bhebhurakhan
77 Followers 701 Following Passionate nerd🔭 | AI consultant | founder and CEO of CloudyAI the tech startup democratizing access to quality healthcare in Africa using AI 💻TangDha @TangDha
7 Followers 27 FollowingDominic Marco @dickywarren
204 Followers 613 Following Social Worker | 🏳️🌈 | @austinkhale is my person. Strider & Aztlán are our party doodles. 🐾 🐾Bella-rose Undercoffl.. @bella_rose60054
49 Followers 5K FollowingXiong Zeng @XiongZeng111
316 Followers 2K Following Marathon & trail runner, Ph.D. candidate @UMichECE, interested in machine coffee, optimization, control theory, statistical learning theory, robotics, etc.Haku @DKP85D
110 Followers 280 Following I just speak for my dog (name Haku), he likes tech, and he hopes to make some good friends on X here.Ratnesh Madaan @ratneshmadaan
268 Followers 2K Following ML Engineer, Gather AI. Previously, Research Engineer at MSFT Autonomous Systems group, MS Robotics at CMU.Mufasa(); @___Mufasaa
2K Followers 5K Following Roboticist. ROSCON diversity scholar (New orleans) U.S.A | ROS Dev day presenter 2023 . Major focused on SLAM and Navigation . #COYG .Yusen DAI | 戴雨森 @yusen
1K Followers 1K Following Entrepreneur, investor, Managing Partner @ Zhenfund. Cofounder of NYSE:JMEI, Stanford dropout, Tsinghua, Googlemackey @djhitconfirmwin
11 Followers 98 FollowingPraise Mathew Johnson.. @1337u53r
504 Followers 2K Following 👨🏾💻 : Passionate about PropTech, Startups, Technology, Innovation & Investing.Leon Voland @leonvol_
56 Followers 154 FollowingJ H @Fubar_1
0 Followers 70 FollowingRoye Skornik @RoyeSkornik
332 Followers 6K Following Research into #Mechatronics #SpatialComputing #SimulationSoftware #Data #Aerospace #Biotech #Agtech #Nanotech #EnvironmentalEngineering #Physics #Design #AI.Mathias Mantelli @MathiasMantelli
219 Followers 632 Following Robotics software developer I program autonomous robots to perceive the environment Some stuff here doesn't make sense. WelcomeBorislav Zhezhev @BorislavZhezhev
79 Followers 246 FollowingPoorvi @Poorvi_rh
58 Followers 228 Following CV/Robotics @ Stealth Startup | MS Computer Vision @CMU | CSE @IIT Bombayjuicy @mindchaosmind
2 Followers 90 FollowingAramis Mendoza @aramismendoza
485 Followers 5K Following Cloud Engineer & SRE | DevSecOps practicionerJacob Valdez @jvboid
2K Followers 8K Following surfing a 2nd order phase transition | building @HumanRobotsAI | [email protected] | +1.469.968.9490 | https://t.co/V5Odmcls1FHaz @hazgarland
5 Followers 59 Following I am passionate about AI, psychology, and moral philosophy.Billy @Jookair933
347 Followers 5K FollowingAndrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Yann LeCun @ylecun
712K Followers 719 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.François Chollet @fchollet
470K Followers 769 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Sergey Levine @svlevine
80K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceKarol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pDanijar Hafner @danijarh
14K Followers 869 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindSoumith Chintala @soumithchintala
186K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.AI at Meta @AIatMeta
532K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciShane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Heinrich Kuttler @HeinrichKuttler
2K Followers 698 Following Member of Founding Team @InflectionAI. Ex @FacebookAI, @DeepMind, @Google, @LMU_Muenchen, PhD math-ph. Opinions my own. (Can be yours for a small fee.)Nicolas Mejia Petit @mejia_petit
680 Followers 109 Following Machine learning researcher// Made Tested python 22k and 143k datasets, created the first Mixtral 22b MOE to dense model conversion Mistral-22b//Ge Yang @EpisodeYang
3K Followers 2K Following I am planting acorns one at a time with policy gradient.Luca Carlone @lucacarlone1
8K Followers 508 Following Associate Professor at MIT, SPARK Lab Director, Roboticist, interested in how machines see and understand the world (he/his/him)Ruibo Liu @RuiboLiu
2K Followers 1K Following Research Scientist @GoogleDeepMind. AI Research with Humans in Mind.Bilawal Sidhu @bilawalsidhu
46K Followers 4K Following Blending reality & imagination. Ex-@Google Maps & AR/VR. VFX & 3D creator with 1.4M+ subs & 360M+ views. Scout @a16z. Host @TEDTalks AI Show. ੴ.Booster Robotics @boosterobotics
186 Followers 0 FollowingVivek Raghunathan @vivek7ue
4K Followers 2K Following * AI + search at @snowflakedb. * Co-founder @Neeva (acquired by @snowflakedb). #NeevaAI = AI search engine with LLMs. * Ex-VP of Engineering @GoogleReazon Human Interact.. @REAZON_HI_Lab
474 Followers 3 Following Creating new normals. Research: #robotics #robotarms #speechrecognition #gazetracking 研究分野: #音声認識 #視線認識 #ロボットアームXin Wang @xinw_ai
4K Followers 991 Following Senior Researcher @MSFTResearch. PhD from @Berkeley_EECS. #artificialintelligence #LLM #multimodalKyle Corbitt @corbtt
6K Followers 134 Following Currently building @OpenPipeAI. Formerly @ycombinator, @google. I am always down to go on a quest.Alex Clemmer 🔥🔥.. @hausdorff_space
4K Followers 1K Following Brexit, Britney Spears, and Buffalo Wild Wings. if there aint no ring on my finger you aint goin on my gram wasq'u descendent.Christoph Kohstall @CKohstall
3K Followers 376 Following Creating #humanoid #robots at Kind Humanoid. We will deliver intelligent robots providing additional labor to build a better tomorrow.The Logan Bartlett Sh.. @loganbartshow
5K Followers 7 Following Podcast: untold stories from tech's inner circle - hosted by @loganbartlettMatt Freed @_mattfreed
2K Followers 592 Following To live in the future, we first have to build it | making lil’ things like embodied AGI @kscalelabs | MechE & AI 🇺🇸K-Scale Labs @kscalelabs
4K Followers 3 Following Moving humanity up the Kardashev scale. Discord: https://t.co/ZMTqwwa9hiUmer Adil @UmerHAdil
706 Followers 314 Following Learning & providing value to OSS AI | Contributor @huggingface @diffuserslib, @LangChainAI, gpt engineer | https://t.co/BOR9cWbN8oAston Zhang @astonzhangAZ
5K Followers 92 Following Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.Rerun @rerundotio
3K Followers 138 Following Rerun is an open-source SDK for visualizing streams of multimodal data. ⭐ GitHub https://t.co/yf1KZN7DBI 👾 Discord https://t.co/7PIlvsZO9nMike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.Brad Stone @BradStone
86K Followers 4K Following Editor, Bloomberg Businessweek. Author of the books Amazon Unbound, The Upstarts, and The Everything Store. Retweets are usually mistaken clicks.Hugo Laurençon @HugoLaurencon
566 Followers 182 Following ML research engineer @huggingface Les yeux rivés sur la lossXintao Wang @xinntao
614 Followers 170 Following Senior Staff Researcher at Tencent ARC Lab and Tencent AI Lab. PhD from MMLab, CUHK.Stone Tao @Stone_Tao
2K Followers 863 Following PhD @UCSanDiego @HaoSuLabUCSD working on scalable robot learning and embodied AI. Co-founded @LuxAIChallenge to build AI competitions. @NSF GRFP fellowAdam Karvonen @a_karvonen
1K Followers 299 Following Interested in ML and software. I prefer email to DM.Palmer Luckey @PalmerLuckey
219K Followers 2K Following I am a technology enthusiast, writer, and modder. Founder of ModRetro, @Oculus VR, and @Anduriltech. Keeping American superheroes safe with autonomous systems.Dennis Hong @DennisHongRobot
13K Followers 145 Following Professor, Mechanical & Aerospace Engineering, UCLA. Director, RoMeLa: Robotics & Mechanisms LaboratoryTim Zaman @tim_zaman
20K Followers 102 Following AI at Google DeepMind. callsign PD4TA. Previously Tesla, X/Twitter (head of AI Infra), NVIDIA.Pollen Robotics @pollenrobotics
2K Followers 217 Following French Robotics company. Doing open source robots made by open minded humans, to explore real-world applications.Simon Guo 🦝 @simonguozirui
1K Followers 4K Following Incoming CS PhD student @Stanford and curr training models at @cohere | 🎓 @Berkeley_EECS | prev built things at @ @anyscalecompute @nvidiaKilian Haefeli @khshind
234 Followers 343 Following Exploring crevasses of Deep Learning at ETH Zurich & UofT | Previously: @Aleph__Alpha, @Logitech, and exfounder at AiricaHongyu Ren @ren_hongyu
3K Followers 595 Following Research Scientist @openai. CS PhD @stanford. Previously @apple, @googleai and @nvidiaai. I train language models.Agility Robotics @agilityrobotics
20K Followers 2K Following Advancing manufacturing and logistics automation with the world's best human-centric robotics solution. #MadeForWork #DigitJiahui Yu @jhyuxm
2K Followers 777 Following Member of Technical Staff @OpenAI; previously Research Scientist at Google Brain/DeepMind.Dan Hendrycks @DanHendrycks
17K Followers 81 Following • Director of the Center for AI Safety (https://t.co/ahs3LYCpqv) • GELU/ImageNet-C/MMLU/safety groundwork • PhD in AI from UC Berkeley https://t.co/rgXHAnYAsQ https://t.co/YtGtDh1aAVNikita Bier @nikitabier
322K Followers 2K Following I make apps grow really fast. founder @gasappteam (acq by discord), ex-founder @thetbhapp (acq by facebook), ex-new products @metaAndy Jassy @ajassy
173K Followers 292 Following Lead Amazon, married and father of two kids, big sports/music/film fan, experienced buffalo wings eater. Go Kraken!Aaditya Singh @Aaditya6284
446 Followers 247 Following PhD student at @GatsbyUCL working with @SaxeLab, @FelixHill84 on learning dynamics, ICL, concepts, LLMs. Prev. at: @GoogleDeepMind, @AIatMeta (LLaMa 3), @MITDavid Ding @DavidDingAI
2K Followers 122 Following CEO and co-founder of @udiomusic. ex Google DeepMindaw~ Thanks <3 The current teleop process uses shared memory lock, which might not be necessary. Vuer is able to stream 2K Stereo Video at 60 fps when the Vuer thread is not being blocked by other things. See this opensource example: docs.vuer.ai/en/latest/exam…
Spent 4 hours setting up on my Vision Pro and palying around this. For 720P streaming, there is a 2~3s deplay. For lower resolution (376, 762), the delay is under 0.2s! I really love the vuer+VR experience! Great open-source by @xuxin_cheng @EpisodeYang and the team! Check…
"the only useful robot is a reliable robot"
Forbes asked me about Tesla’s claim they’ll sell humanoid robots to customers next year. My take: The only useful robot is a reliable robot. For humanoids to be ready for real work we can’t just be impressed by them, we need to be able to count on them. forbes.com/sites/robertha…
A peek on what are we working on lately for humanoid robot system. ☑️ Control bimanual hands from VisionPro real-time. ☑️An active camera is installed on the robot head, following human head motion, streaming ego-centric view observations in real time to VisionPro. Interfacing…
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
 🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code: github.com/OpenTeleVision…
Our newest update demonstrates the Scaling Law in action, with RFM-1 now generating images at 400% higher resolution than previously. This higher resolution leads to more accurate AI predictions and fewer hallucinations. Check out RFM-1's enhanced ability to predict how a scene…
It has been one year since we announced GAIA-1 and six months since we shared our first scaled-up version. The diversity and realism of synthetic video from generative AI is still astounding to me... but now I'm getting excited about what we're seeing next...
@Thom_Wolf The 3 key elements of a good dataset: 1. quality 2. diversity 3. quantity You can only easily measure the last one but the performance is a sensitive function of all three. Super interesting topic ty for #longread :)!
Excited to announce we've raised 62.7M$ at 1.04B$ valuation, led by Daniel Gross, along with Stan Druckenmiller, NVIDIA, Jeff Bezos, Tobi Lutke, Garry Tan, Andrej Karpathy, Dylan Field, Elad Gil, Nat Friedman, IVP, NEA, Jakob Uszkoreit, Naval Ravikant, Brad Gerstner, and Lip-Bu…
We’re excited to announce that we’ve raised $62.7 million in a Series B1 funding led by Daniel Gross. The round also includes Stanley Druckenmiller, NVIDIA, Jeff Bezos, Tobi Lutke, Garry Tan, Andrej Karpathy, Dylan Field, Elad Gil, Nat Friedman, IVP, NEA, Jakob Uszkoreit, Naval…
AI winter? No. Even if GPT-5 plateaus. Robotics hasn’t even started to scale yet. Embodied intelligence in the physical world will be a powerhouse for economic value. Friendly reminder to everyone that LLM is not all of AI. It is just one piece of a bigger puzzle.
Zuck on Dwarkesh TLDR: AI winter is here. Zuck is a realist, and believes progress will be incremental from here on. No AGI for you in 2025. 1) Zuck is essentially an real world growth pessimist. He thinks the bottlenecks start appearing soon for energy and they will be take…
Maybe there are little flat spots along the way, but AI in 5 years will be ridiculously capable compared to AI today.
"This was too fun" Turn on volume to hear it. 🥰☺️🤗🤩 Follow to see what's next. #KindHumanoid #humanoid
Llama 3 is trained with over 10 Million human-annotated examples - that's also my guess of how many diverse trajectories you need to collect to get a generalist GPT for robotics after large-scale pretraining.
🔥llm.c update: Our single file of 2,000 ~clean lines of C/CUDA code now trains GPT-2 (124M) on GPU at speeds ~matching PyTorch (fp32, no flash attention) github.com/karpathy/llm.c… On my A100 I'm seeing 78ms/iter for llm.c and 80ms/iter for PyTorch. Keeping in mind this is fp32,…
Congrats to @AIatMeta on Llama 3 release!! 🎉 ai.meta.com/blog/meta-llam… Notes: Releasing 8B and 70B (both base and finetuned) models, strong-performing in their model class (but we'll see when the rankings come in @ @lmsysorg :)) 400B is still training, but already encroaching…
Jensen attended the AI forum at Oregon State University on Sunday, where he was asked about his vision for humanoid robots. He described the "Aha!" moment that convinced him of the potential for generalized robotics.
We promise this is not a person in a bodysuit. bit.ly/3w5XRvH
This video is a first look at Lingo-2, an AI simultaneously chatting and autonomously driving through busy central London. This is not a LLM strapped to our driving AI, rather an AI model jointly trained on vision, language and action. 💬🚗
🚙💬Meet Lingo-2, a groundbreaking AI model that navigates roads and narrates its journey. Watch this video taken from a LINGO-2 drive through Central London 🇬🇧 The same deep learning model generates real-time driving commentary and drives the car.
Introducing 𝐀𝐋𝐎𝐇𝐀 𝐔𝐧𝐥𝐞𝐚𝐬𝐡𝐞𝐝 🌋 - Pushing the boundaries of dexterity with low-cost robots and AI. @GoogleDeepMind Finally got to share some videos after a few months. Robots are fully autonomous filmed in one continuous shot. Enjoy!
research is an immensely taxing endeavour. hours spend doing IC work, debugging and what not. a paper is a canvas for researchers to express themselves after all the hard work, at the end of the day. it's my art. at least let me paint the way i want to paint. The reason why i am…
In retrospect, UL2 was a wild paper. «Yeah so this just sort of cooked, turns out it's more optimal than Chinchilla, idk check it out». This almost farcically casual tone makes me suspect that Yi was thinking in detail about founding Reka at the moment. arxiv.org/abs/2205.05131