Rob Fergus @rob_fergus
Research Scientist @DeepMind, NYU Faculty Joined January 2020-
Tweets8
-
Followers3K
-
Following56
-
Likes37
@ylecun @ylecun @AravSrinivas recent Proto-RL (arxiv.org/pdf/2102.11271…) that uses ideas from both CURL and DrQ gets us closer to the LeCake, as it's contrastively learned representations are **fully detached** from RL, besides they can be learned with just the MaxEnt objective.
Happy to share my new work -- Proto-RL, a task-agnostic pre-training scheme that reconciles exploration and representation learning in image-based RL! with: @rob_fergus, Alessandro Lazaric, and @LerrelPinto. paper: arxiv.org/pdf/2102.11271… code: github.com/denisyarats/pr… [1/N]
Excited to share an update to our work on evolutionary-scale modeling (ESM)! Over the past year, we rewrote our paper with better pretraining and downstream models, leading to state-of-the-art results across multiple benchmarks. (1/8) biorxiv.org/content/10.110…
Very excited to be joining @DeepMind in NYC!
Excited to share our new paper “Automatic Data Augmentation for Generalization in Deep Reinforcement Learning” w/ @maxagoldstein8, @denisyarats, @ikostrikov, and @rob_fergus! Paper: arxiv.org/pdf/2006.12862… Code: github.com/rraileanu/auto… Website: sites.google.com/view/ucb-drac
Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Soumith Chintala @soumithchintala
185K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pEdward Grefenstette @egrefen
36K Followers 774 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Dhruv Batra @DhruvBatraDB
14K Followers 321 Following Senior Director (FAIR @MetaAI). Professor (@GeorgiaTech). Co-founded CaliperAI. Researcher in AI. @CarnegieMellon alum.Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Noam Brown @polynoamial
34K Followers 611 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMUyobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsMax Jaderberg @maxjaderberg
12K Followers 1K Following Advancing AI. Chief AI Scientist @IsomorphicLabs. Prev: research scientist @DeepMind, co-founder Vision Factory (acq. Google 2014), PhD @Oxford_VGG lab.Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Petar Veličković @PetarV_93
30K Followers 556 Following Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Associate @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦Julian Togelius @togelius
18K Followers 1K Following AI and games researcher. Associate professor at NYU; director of @NYUGameLab; co-founder of https://t.co/FnakJLkAXW.Frank Dellaert @fdellaert
11K Followers 1K Following CTO at Verdant Robotics, Robotics & Computer Vision Professor at Georgia Tech (on leave). Before: sabbatical at KUL, stints at Skydio, Facebook B*8, Google AI.Durk Kingma @dpkingma
35K Followers 347 Following Deep learning, mostly generative models. Prev. Google Brain/DeepMind, founding team @OpenAI. Inventor of the VAE, Adam optimizer, among other things. ML PhD.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Hang @Hang2076148h
35 Followers 253 FollowingFoot2Hand @FootToHand
1 Followers 13 FollowingXiang Fu @thisisxfu
41 Followers 2K Following Researcher @BUSPH | @BU_CDS | Founder of @ModularNLP | Deep Learning | Data Science |Abhimanyu Suthar @abhimanyu_25s
66 Followers 279 Following MS in Robotics student @NYUTandon https://t.co/QSaYFI1CVOTyler @RuiTyler
2 Followers 20 FollowingEd H. Chi @edchi
12K Followers 4K Following Distinguished Scientist @ GoogleDeepMind. ResearchPlatform Lead for LaMDA/Bard, Neural Recommender, RobustML, AutoML, Chip Design & Reasoning. ACM Fellow.Curious_GS @Curious_G5
13 Followers 57 FollowingJatin Prakash @bicycleman15
32 Followers 431 Following Research Fellow at Microsoft Research | previously @iitdelhife4w @Fe4wk0ps
190 Followers 118 FollowingYedid Hoshen @YHoshen
73 Followers 65 Following Assistant Prof., CS @ Hebrew University of JerusalemRobbin Fretz @fr_robb
78 Followers 5K FollowingLawana Bigham @BighLawa
47 Followers 5K FollowingDionne Zawislak @DionneZawi19369
77 Followers 5K FollowingOttilie Kosowski @o_kosows
17 Followers 2K FollowingPia Lukach @LukachLuk
25 Followers 5K FollowingNeeraj Mohan S @NeerajmohanS
32 Followers 627 FollowingKathirmani Sukumar @skathirmani
189 Followers 251 Following Co-Founder at Quelit(@quelitindia). Passionate about programming & teaching. I regularly read and tweet about #datascience #textmining #dataviz #machinelearningAshutosh Mehra @ashutoshmehra
1K Followers 5K Following Senior Principal Scientist at Adobe. Working on Acrobat AI Assistant, LLMs, and document ML.Pranav Doma @Pranavreddy0323
76 Followers 778 Following NYU. Here to connect! (because I couldn't tolerate linkedIn) ML/Autonomous systems / roboticsfabregastic @fabregastically
21 Followers 552 FollowingSergio (🌈)🕊️#.. @sguada
3K Followers 2K Following Deep Learning Researcher. Computer Vision, NLP and Reinforcement Learning. @TensorFlow #TFAgents #feminist #AntiRacist he/himJanhavee Shinde @SJanhavee
54 Followers 2K FollowingGrace Isford @graceisford
7K Followers 2K Following Partner @Lux_Capital investing in the future 🚀 | board @ecorner (STVP) previously @canvasvc @stanfordwib @joinhandshake @stanfordLiyuan Geng @liyuan_geng
20 Followers 20 Following NYU Undergrad Research Interest: Computer Vision, AI4Science, Roboticsfuszti @fuszti
68 Followers 110 Following AI Engineer at https://t.co/jLGmOmknmp. Lecturer at @BME_hu Former Bosch Deep Learning Engineer.Josh @JoshPurtell
731 Followers 2K Following ML Researcher. Ex: Cyber microexit, Yale Math. Hiring in ML Ars longaVincent Lordier @vlordier
562 Followers 4K Followingj4ntnyfo55 @j4ntny
447 Followers 4K Following 🐒just for fun 🧠ai ⛓️web3 🌎economics 😭mainly epic fails🛡🌈🔺️☀️👻Aaditya ; @Aaditya26082004
517 Followers 7K Following CS'26 • Machine Learning • Open-Source • Web Dev. • Algorithms • Jai Shree Krishna 🦚🪈lins @LiniMuc
1 Followers 666 FollowingSarah Catanzaro @sarahcat21
12K Followers 1K Following “All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)Jiraphon Yenphraphai @JYenphraphai
22 Followers 66 FollowingEliott (e/acc) @Eliott45ei
322 Followers 712 Following Trying to solve the final riddle with either AGI or nanotech (LLMs + protein design).John cole @zlx8719
116 Followers 290 FollowingJeetendra K Sharma @Jeetkarsh
148 Followers 5K Following Data Science Manager @United Airlines | Career Coach @Almabetter | Top Rated Plus @Upwork | ODSC '19 Speaker | Ex @TCS A&I |Celebi2020 @Celebi20201
1 Followers 91 FollowingSangwoo Mo @sangwoomo
550 Followers 694 Following Postdoc @UMich. Past: PhD @kaist_ai, Intern @AIatMeta, @NVIDIAAI. Work on foundation models for vision, language, and robotics.Jainil Rana @JainilR_133
8 Followers 118 FollowingYug Oswal @Yug_Oswal
4 Followers 112 FollowingJason Yim @json_yim
1K Followers 224 Following PhD student @MIT_CSAIL. Generative models, protein design.Yann LeCun @ylecun
709K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Google DeepMind @GoogleDeepMind
942K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Soumith Chintala @soumithchintala
185K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Alfredo Canziani @alfcnz
86K Followers 269 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityAI at Meta @AIatMeta
530K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.NeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Edward Grefenstette @egrefen
36K Followers 774 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Max Jaderberg @maxjaderberg
12K Followers 1K Following Advancing AI. Chief AI Scientist @IsomorphicLabs. Prev: research scientist @DeepMind, co-founder Vision Factory (acq. Google 2014), PhD @Oxford_VGG lab.Christopher Manning @chrmanning
126K Followers 114 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Roberta Raileanu @robertarail
4K Followers 1K Following Research Scientist @Meta & Honorary Lecturer @UCL. ex @DeepMind | @MSFTResearch | @NYU | @Princeton. Llama-3, Toolformer, Rainbow Teaming.Demis Hassabis @demishassabis
356K Followers 124 Following Co-founder & CEO @GoogleDeepMind - working on AGI. Trying to understand the fundamental nature of reality. Also revolutionising drug discovery @IsomorphicLabsJeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)Robert Palgrave @Robert_Palgrave
7K Followers 1K Following Professor of Inorganic and Materials Chemistry at UCL. Director of UK National XPS Service @harwellxpsMetro-North Railroad @MetroNorth
112K Followers 107 Following Purchase tickets, plan your trip, and chat with us: https://t.co/8uJdMZUjAT For real-time updates, sign up for MTA Service Alerts: https://t.co/d6t8Eo7c90NJ TRANSIT @NJTRANSIT
268K Followers 130 Following NJ’s statewide transit provider. Monitored 6AM-10PM M-F, 10AM-6PM Sat/Sun. Equal employment opportunity employer.Institute for Protein.. @UWproteindesign
15K Followers 664 Following We create proteins that solve challenges in medicine, technology & sustainability // Co-developers of @Foldit // @UWMedicine | https://t.co/1PR2DtKdeBAaron Hertzmann @AaronHertzmann
3K Followers 482 Following Tweets express my own opinions, and not of institutions I'm affiliated with. he/him.Kevin K. Yang 楊凱�.. @KevinKaichuang
16K Followers 5K Following Senior Researcher in BioML @MSFTResearch (@MSRNE). He/him/他. 🇹🇼Sergey Ovchinnikov �.. @sokrypton
12K Followers 3K Following Scientist, Assistant Professor @MITBiology, #FirstGen, ProteinBERTologistNYC Private Schools @privateschools
18K Followers 18K Following For parents of children already in or applying to NYC Private SchoolsMayor Eric Adams @NYCMayor
1.6M Followers 1K Following Delivering a fairer, safer, and brighter future for Every New Yorker. Official account of the 110th Mayor of NYC. He/Him/HisNYPD NEWS @NYPDnews
814K Followers 432 Following The official X of the New York City Police Dept. Call 911 for emergencies, 311 for non-emergencies. Account not monitored 24/7. https://t.co/dbME9x6GVvChristopher Marte @ChrisMarteNYC
4K Followers 2K Following City Council Member of District 1 l Community OrganizerNASA Webb Telescope @NASAWebb
3.3M Followers 65 Following The world's most powerful space telescope. Launched: Dec. 25, 2021. First images revealed: July 12, 2022. Verification: https://t.co/ChOEslj1j5Speyer School @SpeyerSchool
475 Followers 521 Following Inspiring the next generation of bright minds. The only K-8 independent school specifically designed for gifted learners in NYC.カメラ専門店 �.. @mapcamera
38K Followers 6 Following 平素よりマップカメラをご利用いただき誠にありがとうございます。 ご利用頂く全てのお客様への感謝をお伝えできればと思います。 よろしくお願いいたします。Lerrel Pinto @LerrelPinto
5K Followers 181 Following Assistant Professor of CS @nyuniversity. I like robots!Mengye Ren @mengyer
4K Followers 699 Following Assistant Professor of Comp Sci. and Data Sci. at NYU. Machine Learning, Computer Vision, Human-like AI.SIGMA GLOBAL VISION @SIGMA_sgv
2K Followers 12 Following The official Twitter account for SIGMA Corporation. Youtube : https://t.co/GoxWJOS6ou Instagram : https://t.co/NUEVwP1jNb Contact:https://t.co/a36xSAFZhA Policy:https://t.co/2Wgy8eMolVSIGMA Japan @Sigma_Japan
33K Followers 4 Following カメラ・レンズメーカーSIGMAの日本公式アカウントとして製品やサービス、イベント、企業活動に関する情報を発信します。製品サポートや個別のご質問等は以下【お問い合わせ】までお願い致します。 【運営ポリシー】 https://t.co/cIvrxqFNlw 【お問合せ】 https://t.co/J4b5xww3ucwill grathwohl @wgrathwohl
4K Followers 238 Following Lover of raccoons and machine learning. Research Scientist at @GoogleDeepMind in NYC. Ph.D. from @UofTCompSciArnold @Schwarzenegger
5.2M Followers 468 Following TV Dad, Bodybuilder, Conan, Terminator, and former Governor of California. I killed the Predator. I told you I'd be back. I’m here to pump you up.Jason Weston @jaseweston
9K Followers 568 Following Research @MetaAI+NYU. Pretrain+FT: NLP from Scratch (2011). Multilayer attention+position embed+LLM: MemNets (2015). Recent (2023+):Sys 2 Attn, Self-Rewarding..Tim Rocktäschel @_rockt
29K Followers 1K Following Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, @ELLISforEurope Scholar. ex @MetaAI (FAIR), @CompSciOxford. Opinions my own.Sainbayar Sukhbaatar @tesatory
2K Followers 284 Following Researcher Scientist at FAIR @MetaAI Research: Memory Networks, Asymmetric Self-Play, CommNet, Adaptive-Span, System2Attention, ...Olaf Ronneberger @ORonneberger
3K Followers 122 Following Research scientist at @DeepMind, London, and adjunct professor for computer science at University of Freiburg, Germany.Siddharth Karamcheti @siddkaramcheti
3K Followers 794 Following PhD student @stanfordnlp & @StanfordAILab. I like language, robots, and people. ML/Robotics Intern @ToyotaResearch.Joshua Meier @joshim5
3K Followers 1K FollowingBrandon Amos @brandondamos
14K Followers 2K Following research scientist @MetaAI (FAIR) | optimization, machine learning, control, and reinforcement learning | PhD from @SCSatCMUZeming Lin @ebetica
2K Followers 363 Following PhD @ NYU. ESMFold / PyTorch. Climbs all day. Definitely not s̶k̶y̶n̶e̶t̶GPT5. Unsupervised learner but sometimes still gets a few rewards.Ilya Kostrikov @ikostrikov
8K Followers 615 Following Researcher @OpenAI, previously @Postdoc at UC Berkeley @berkeley_ai, PhD in CS @CILVRatNYURuss Salakhutdinov @rsalakhu
100K Followers 140 Following UPMC Professor of Computer Science at Carnegie Mellon University, ex-Director of AI research at @Apple, co-founder Perceptual Machines (acquired by Apple)Nando de Freitas 🏳.. @NandoDF
97K Followers 658 Following I research intelligence to understand what we are, and to harness it wisely. I lead a wonderfully creative AI team at @GoogleDeepMind who inspire me everyday.Hugo Larochelle @hugo_larochelle
113K Followers 625 Following Google DeepMind researcher, machine learning professor, ex-Twitter Cortex, father of 4, wine/music/comedy enthusiastAfter spending 1.5 years as a postdoc at UC Berkeley, I have recently started working at @OpenAI, specifically in the ChatGPT team's RL subteam. I am thrilled to be a part of this team, and I can't wait to dive into the exciting projects and challenges!
Today we're releasing the structures of over 600M metagenomic proteins—the least understood proteins on earth. A view into the dark matter of the protein universe. Explore the ESM Metagenomic Atlas here: esmatlas.com
Really cool to see that CLIP + Neural Fields can allow for open-ended query solving by robots without any human labels!
How can we train data-efficient robots that can respond to open-ended queries like “warm up my lunch” or “find a blue book”? Introducing CLIP-Field, a semantic neural field trained w/ NO human labels & only w/ web-data pretrained detectors, VLMs, and LLMs mahis.life/clip-fields
ESM-2 language models are now public!
We've released the ESM2 protein language models up to 15B parameters today. Available now at the FAIR/@metaai Protein Team ESM repo: github.com/facebookresear…
We've released the ESM2 protein language models up to 15B parameters today. Available now at the FAIR/@metaai Protein Team ESM repo: github.com/facebookresear…
RL is supposed to be slow and inefficient, right? Turns out that carefully implemented model-free RL can learn to walk from scratch in the real world in under 20 minutes! We took our robot for a "walk in the park" to test out our implementation. sites.google.com/berkeley.edu/w… thread->
Almost a year to the day, @PrescientDesign joined @genentech, a fledgling journey that I've been fortunate to be a part of. Today, as the next step, Prescient has officially launched our NY HQ at 149 5th Ave in the Flatiron! Stop by if you're in the area and want to chat with us!
I just officially started my appointment @PrincetonCS and couldn't be more excited! Current status: wandering around Princeton figuring out how to buy GPUs #newPI
We just released ROT, a new imitation learning algorithm that can learn vision-based robotic policies with just 1 demonstration, 1 hour of interactive learning and without any pre-training! Project: rot-robot.github.io w/ @haldar_siddhant,@Vaibhavheretoo,@denisyarats (1/N)
I got tenure! I’m very grateful to my students, collaborators, mentors, colleagues, letter writers, research sponsors, friends and family. It’s been an exciting journey, and your support and encouragement means a lot. I’m looking forward to the next chapter!
only now i just recalled that i actually did talk about proteins in my job talk from 2014 (!?) drive.google.com/file/d/0B16RwC…
Major firmware update for the SIGMA fp L | Ver.2.00 sigma-global.com/en/news/2022/0… #SIGMA #SIGMAfpL
I lost my fellow officers in the line of duty. I remember my mother’s fear for her sons when we went to work every day. Tonight, we lost a 22 year old son, husband and police officer. Another is fighting for his life. Our hearts go out to their families.
Pleased to say this has been accepted to AISTATS 2022! All credit to my amazing collaborators (especially @EliWeinstein6) who did everything. I learned so much from you all working on this and I’m happy for this outcome!
New paper: 'Optimal Design of Stochastic DNA Synthesis Protocols based on Generative Sequence Models' led by @EliWeinstein6 biorxiv.org/content/10.110…
It's slowly starting to hit me... I just defended my Ph.D. from @MIT!!!
#NASAWebb is fully deployed! 🎉 With the successful deployment & latching of our last mirror wing, that's: 50 major deployments, complete. 178 pins, released. 20+ years of work, realized. Next to #UnfoldTheUniverse: traveling out to our orbital destination of Lagrange point 2!
I am super excited to announce that I will be joining Microsoft Research (MSR) as a distinguished scientist on September 1, 2021.
Our work on “Decoupling Value and Policy for Generalization in Reinforcement Learning” w/ @rob_fergus will be presented as a long talk @icmlconf 2021. Come check it out in Poster Session 1 (Tuesday, 12 - 2pm ET / 5 - 7pm BST): icml.cc/virtual/2021/o….