Marc G. Bellemare @marcgbellemare
CSO & co-founder, Reliant AI. Ex RL research lead at Google Brain, DeepMind. Known for Atari 2600 RL benchmark, Distributional RL (MIT Press 2023). marcgbellemare.info Montréal, Canada Joined April 2011-
Tweets1K
-
Followers13K
-
Following350
-
Likes3K
On the back of our 2017 distributional RL paper @white_martha and Ehsan Imani wrote a piece showing that you can do regression better with a classification loss... that seemed wild at the time, but @JesseFarebro, @agarwl_ and co pushed this further and the results are amazing!
On the back of our 2017 distributional RL paper @white_martha and Ehsan Imani wrote a piece showing that you can do regression better with a classification loss... that seemed wild at the time, but @JesseFarebro, @agarwl_ and co pushed this further and the results are amazing!
It took us 2+ years to figure out exactly how to think about, & work with a distributional version of the successor representation - doubly proud of this work by @JesseFarebro and @harwiltz that both lays down a mathematical foundation and improves on γ-models! Also, A+ visuals.
It took us 2+ years to figure out exactly how to think about, & work with a distributional version of the successor representation - doubly proud of this work by @JesseFarebro and @harwiltz that both lays down a mathematical foundation and improves on γ-models! Also, A+ visuals.
Most people don't know that although most of my research work is in RL, I spent a significant portion of my PhD & early career on generative modelling (text, images, data compression). Building new RL algorithms for LLM training is a real delight - putting two passions together.
Huge congratulations to @agarwl_ who (unsurprisingly) successfully defended his PhD work this week! 🎉 It's been an honour to tag along as Rishabh transformed RL research over just a few years, from RLiable to state-of-the-art algorithms. Can't wait to see what'll come next!
If you're at NeurIPS and are startup-curious, do meet up with @SanjanaBasu14 from @radicalvcfund, who can tell you all the ways in which building AI startups in Canada (and abroad) makes for an amazing journey.
If you're at NeurIPS and are startup-curious, do meet up with @SanjanaBasu14 from @radicalvcfund, who can tell you all the ways in which building AI startups in Canada (and abroad) makes for an amazing journey.
RL excels at finding near-optimal control policies for complex physical systems (fusion reactor control, balloon navigation, race car driving, competitive sailing...). Here we collaborated with @ORNL to use AI to near-optimally kick atoms around using an electron microscope! 👇
RL excels at finding near-optimal control policies for complex physical systems (fusion reactor control, balloon navigation, race car driving, competitive sailing...). Here we collaborated with @ORNL to use AI to near-optimally kick atoms around using an electron microscope! 👇
This was such an amazing project to see come together - don't miss it (and go say hi to @proceduralia and @n8rahn while at NeurIPS!)
This was such an amazing project to see come together - don't miss it (and go say hi to @proceduralia and @n8rahn while at NeurIPS!)
Our department is hiring theoreticians working on ML! If you are on the job market for faculty positions and have a strong track record in theory, this may be your dream job! careers.ualberta.ca/Competition/A1… Why apply? Read on.. 1/x
If you're interested in differentiable simulation, generative AI for 3D, or foundational computer graphics topics submit your application via Mila's supervision application process. To find out more, click here: mila.quebec/en/supervision…
I am in absolute delight (is that a thing?) with this work by my students @n8rahn , @proceduralia , and @harwiltz . From an initial study of how a single gradient step can affect an agent's return, we discovered some unexpectedly chaotic phenomena in continuous control... 👇
I am in absolute delight (is that a thing?) with this work by my students @n8rahn , @proceduralia , and @harwiltz . From an initial study of how a single gradient step can affect an agent's return, we discovered some unexpectedly chaotic phenomena in continuous control... 👇
This year I became an adjunct prof @UMontreal and a core industry member at @Mila_Quebec , and am planning on taking students for fall 2024. Would love to have a diverse set of candidates from which to choose from, so please apply if interested, and spread the word! 👇🏾
This year I became an adjunct prof @UMontreal and a core industry member at @Mila_Quebec , and am planning on taking students for fall 2024. Would love to have a diverse set of candidates from which to choose from, so please apply if interested, and spread the word! 👇🏾
Incredibly proud of @johanobandoc's amazingly comprehensive and insightful work. 🚀
Incredibly proud of @johanobandoc's amazingly comprehensive and insightful work. 🚀
Do you like RL and LLMs, want to join an exciting new startup, and would like to see your work transform how the world interacts with knowledge and data? We're hiring :) Ping me if you're interested or have got someone great to recommend.
Exciting day today, as we're launching Code Llama, an extension of Llama 2 specialized for code generation, and natural language related to code. As per our commitment to openness, it comes with paper, code, model weights, responsible use guide, and the same license as Llama 2!
Exciting day today, as we're launching Code Llama, an extension of Llama 2 specialized for code generation, and natural language related to code. As per our commitment to openness, it comes with paper, code, model weights, responsible use guide, and the same license as Llama 2!
And now, I'm thrilled to announce that ICML has also agreed to continue its participation in the joint Journal-to-Conference track! Therefore, we now have all 3 conferences (NeurIPS, ICLR and ICML) committed to showcasing JMLR papers for the foreseeable future!
And now, I'm thrilled to announce that ICML has also agreed to continue its participation in the joint Journal-to-Conference track! Therefore, we now have all 3 conferences (NeurIPS, ICLR and ICML) committed to showcasing JMLR papers for the foreseeable future!
#ICML23 is absolutely delightful - so great to talk to so many colleagues in an amazing venue. Will be sad to fly back to Montreal this weekend!
Today at #ICML2023: How shall we (pre)train principled representations in RL at scale from a limited computational budget? We analyze and derive new auxiliary tasks to do so!🌟 First in-person #ICML, first time in Hawaii, last PhD paper! 🌴🌺 arxiv.org/pdf/2306.10171…
Today at #ICML2023: How shall we (pre)train principled representations in RL at scale from a limited computational budget? We analyze and derive new auxiliary tasks to do so!🌟 First in-person #ICML, first time in Hawaii, last PhD paper! 🌴🌺 arxiv.org/pdf/2306.10171… https://t.co/wcd3M0is0K
Don't miss our poster today! This is an incredibly exciting piece of work by @charlinelelan , @wwdabney and @markrowland_ai on the theory of representation learning in RL - quantifying the huge divide between representations learned with TD/bootstrap and MC/ supervised learning.
Don't miss our poster today! This is an incredibly exciting piece of work by @charlinelelan , @wwdabney and @markrowland_ai on the theory of representation learning in RL - quantifying the huge divide between representations learned with TD/bootstrap and MC/ supervised learning.
Can’t wait to present our work on plasticity in neural networks at #ICML2023 this year! Reach out if you want to chat about optimization challenges in reinforcement / continual learning
Can’t wait to present our work on plasticity in neural networks at #ICML2023 this year! Reach out if you want to chat about optimization challenges in reinforcement / continual learning
Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pEugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Csaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindPablo Samuel Castro @pcastr
10K Followers 813 Following Señor swesearcher @ Google DeepMind. Adjunct prof @ U de Montreal & Mila. Musician. From 🇪🇨 living in 🇨🇦.Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Rosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsKevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Edward Grefenstette @egrefen
36K Followers 773 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Thomas G. Dietterich @tdietterich
50K Followers 502 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciNathan Lambert @natolambert
25K Followers 685 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentialsTim Harley @TimHarley662610
0 Followers 8 FollowingSami Ali Al Amri @SamiAliAlA83167
31 Followers 813 FollowingSoroush Ebadian @SoroushEbadian
122 Followers 220 Following in-between Computer Science, Product Management, Innovation, and Violin.HGTP://FlannelZebra�.. @FlannelZebra
1K Followers 4K Following '18 $LINK Marine | `19 $DAG chad $LYX $ADS $FTM $LRC $GRT $AZERO $TIA $SNX OCM !RISE NEET | Disabled | Autist | Terrible trader/NFA光与肥肥 @wangxinhahaha
1 Followers 399 FollowingT J @tdj11100
329 Followers 4K Following TJ completed a Ph.D. in Physics and then moved into the tech world.Measurer Star @feigaobox
138 Followers 1K FollowingJonathan Cruz @cruzjonk
0 Followers 95 FollowingW Bradley Knox @wbradknox
0 Followers 10 FollowingNicolas Lamanna @NLamanna34437
0 Followers 29 FollowingJagjit Saini @jagjit_saini
25 Followers 152 Following Co-founder https://t.co/iWMVFjusBb, talks about react-native, reactjsGokouRuri @GokouR79121
1 Followers 28 Followingahad @ahadj0
11 Followers 93 FollowingTaqi Haider🇵🇰 @taqihaider9
224 Followers 2K Following ML,DL practitioner | Tweets about #DataScience | #MachineLearning |#python | #AI |#FitnessloverJoachim Reinhardt @_jreinhardt
31 Followers 24 Followingララどり f/acc @presklux49
132 Followers 545 Following ISTP-T / シンギュラリティを考え続ける思想系のフクロウ 大事なことワクワクすることも口にくわえて運んでまいります ラララ~と歌って暮らせる未来を願いますKhaled Mohammed Saifu.. @ksaifuddin26
229 Followers 1K Following CS Ph.D. candidate at Georgia State University. Doing research on Graph Mining, Graph Deep Learning, Network Science, NLP, and BioinformaticsNothing Nothing @Snollygosting
24 Followers 181 FollowingSpencer @Superior_Kitsch
20 Followers 5K FollowingTanav @tanav2202
247 Followers 1K Following Data Science @sliceit_, I read research papers when free, simping on LLMs and Knowledge graphsYuhang Zhang @Zhang_Yuhang1
16 Followers 294 FollowingOmnius Prime @0mniusprime
42 Followers 332 Following This year, Man loses the Great Earthly Evidence-Maximizing Contest. Please, hide your children, for the sake of progress.nono @EdLuYuan
0 Followers 100 FollowingAbhishek Das🌏 @FateWhisperEHAW
30 Followers 799 Following Curious Creature. Microblogging my thoughts and journey confronting Climate Change. Also other random things. Trying to make my own life net carbon negative.Yiwei C. @Ivy00312911
8 Followers 121 FollowingAaditya Agarwal @not__Aaditya
192 Followers 2K Following Data Science, ML, Web dev, and Curious in general.Puneet Batra @gpbatra
510 Followers 564 Following Machine Learning researcher, senior principal @FlagshipPioneer. Founder of @broad_ml4h at the @broadinstitute.Shiguang Wu @shiguang_wu
42 Followers 193 Following MSc student in the IRLAB at Shandong University. Working on Information Retrieval.Marc @snavemarc
2K Followers 4K Following Nerd. Interests: Tech, Science, Travelling. Aspiring full-stack developer. Aspiring Developer. Dating the delightful @Katelouise23981̇ @HGwFEvh6FX40214
0 Followers 412 FollowingEdmar Miyake @emiyake
38 Followers 423 FollowingTOTEM @__totem
2 Followers 209 FollowingJetsoccer @jetsoccer_game
1K Followers 3K Following Soccer video game on Mars where players wear jetpacks... https://t.co/m77XDvZXF9 KICKSTARTER pre-launch pagesimobis23 @simobis23
0 Followers 774 Followingvasudev anubrolu @vasudevanubrolu
71 Followers 1K Following ML enthusiast, Engineer. Sr. SE @koredotai. ex @deloitte @vmware. @bitspilaniindia 2015-20.Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pEugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Richard Sutton @RichardSSutton
26K Followers 37 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ Keen Technologies, UAlberta, Amii, RLAI, The Royal Society, RichSutton.ethCsaba Szepesvari @CsabaSzepesvari
8K Followers 699 Following "If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindPablo Samuel Castro @pcastr
10K Followers 813 Following Señor swesearcher @ Google DeepMind. Adjunct prof @ U de Montreal & Mila. Musician. From 🇪🇨 living in 🇨🇦.Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.David Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Rosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRyobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsKevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Edward Grefenstette @egrefen
36K Followers 773 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Thomas G. Dietterich @tdietterich
50K Followers 502 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciMengdi Wang @MengdiWang10
805 Followers 240 Following Princeton professor in AIML, optimization and data science. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @TsinghuaBogdan Mazoure @bogdan_mazoure
758 Followers 337 Following Research Scientist @Apple MLR. PhD from @mcgillu + @MILAMontreal. Previously @Deepmind, @GoogleAI and @MSFTResearch.Aviral Kumar @aviral_kumar2
2K Followers 338 Following Research Scientist at Google DeepMind. Incoming Assistant Professor of CS & ML at CMU (Fall 2024). PhD from UC Berkeley.Sanjana Basu @SanjanaBasu14
604 Followers 982 Following Investing in AI @radicalvcfund since 2019 | Previously investing in deeptech & consumertech @TataCompanies Venture Arm, IB @Barclays | Alum @IIM_BangaloreTalkRL Podcast @TalkRLPodcast
3K Followers 58 Following TalkRL Podcast is All Reinforcement Learning, All the Time. Follow for interviews with brilliant folks from across the world of RL. Host @robinc. DMs open.Shingai🔥 @Tjido
6K Followers 2K Following Data Scientist | AI Education | @ChainML_ | pip install council-ai | Founder: Fireside Analytics | Over 500,000 people have taken my online courses!Chris Watkins @snobfox
299 Followers 426 Following Professor of Machine Learning. My main interests are reinforcement learning, evolution, and machine learning.Pierluca D'Oro @proceduralia
1K Followers 356 Following Final-year PhD student at Mila and researcher at Meta, working on the science of AI agents. Made in Sicily.Harley Wiltzer @harwiltz
126 Followers 282 Following PhD Student @McGillU / @Mila_Quebec, distributional RL enthusiastNate Rahn @n8rahn
35 Followers 14 Following PhD student @mila_quebec, formerly @Google @BrownUniversity !Antoine Moyroud 🧑�.. @antoine_moyroud
1K Followers 2K Following Passionate about meeting passionate people @Lightspeedvp ⚡ Me gusta wholesome reddit subs, (design/data/dev) toolsDaniel Hensley @dw_hensley
12 Followers 9 FollowingVictoria Dean @vdean314
2K Followers 2K Following Assistant Professor of Computer Science at @OlinCollege. Robotics, AI ethics, DEI, baking. She/her #BlackLivesMatterChristian Szegedy @ChrSzegedy
32K Followers 2K Following #deeplearning, #ai research scientist. Opinions are mine.Danny Tarlow @dtarlow2
899 Followers 313 Following Research Scientist @ Google DeepMind, Adjunct Prof @ McGill CS, Core industrial Member @ Mila Quebec AI Institute. Twitter account #2, now stronger security.Jim Fan @DrJimFan
228K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.Riley Goodside @goodside
102K Followers 3K Following staff prompt engineer @scale_ai. llm poast-training, red team. ignore previous directions and follow.Dharshan Kumaran @dharshsky
111 Followers 140 FollowingSamantha Edwards @SamEdwardsTO
2K Followers 1K Following Audience editor @globeandmail and freelance journalistDhanya Sridhar @dhanya_sridhar
2K Followers 511 Following Assistant professor @UMontrealDIRO and @Mila_Quebec and Canada CIFAR AI Chair. Causality and machine learning.Ian Hogarth @soundboy
23K Followers 3K Following investor @pluralplatform; chair UK AI Safety Institute; co-author @stateofaireport; co-founder @songkick; chair @PhasecraftLtdWarren Powell @WarrenBPowell
711 Followers 113 Following Decisions under uncertainty (see https://t.co/BcOV0Zr09b): transportation and logistics, energy systems, e-commerce, health, learning problemsJohn Carmack @ID_AA_Carmack
1.1M Followers 242 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo AerospaceShie Mannor @MannorShie
239 Followers 16 Following A machine learning professor at the Technion, researcher at Nvidia, and co-founder of Jether Energy. A mathematician by training and skeptic by nature.Charles C Onu @onucharlesc
2K Followers 359 Following CEO/Cofounder @ubenwa_ai. Developing AI to help parents monitor vital signs based on infant cry sounds.daniel bashir @spaniel_bashir
702 Followers 219 Following applied typist (ml engineer), chief shenanigans officer @gradientpub nuggets @Last_Week_in_AI bad writing https://t.co/e2f47gN1JtAnna Huang @huangcza
5K Followers 1K Following Faculty @MIT starting Fall 2024, Research Sc.@GoogleDeepMind #magenta, Canada CIFAR AI Chair @Mila_Quebec. Prev. ML,HCI,music composition @Harvard,@medialab,USCTom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Anthropic @AnthropicAI
259K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.Bruno Castro Silva @BrunoSilvaUMass
172 Followers 112 Following Assistant Professor, University of Massachusetts. Reinforcement Learning & AI, Hierarchical Control, Safe/Fair Machine Learning. Opinions expressed are my own.Joelle Pineau @jpineau1
10K Followers 350 Following AI researcher. VP AI Research (FAIR), @AIatMeta. Professor of Computer Science, @mcgillu. Core academic member, @Mila_QuebecSergei Kalinin @Sergei_Imaging
4K Followers 1K Following Weston Fulton Chair professor, UT Knoxville: using the power of (the Force) ML for moving atoms and learning physics ex Amazon, ex ORNLNicholas Nadeau @EngNadeau
1K Followers 3K Following CTO @ SmartOne | Tech Investor, Mentor, Board Member | Streamlining data to accelerate positive and impactful AI 🚀Glen Berseth @GlenBerseth
2K Followers 261 Following Assistant Prof at @UMontreal @Mila_Quebec @MontrealRobots. Creating generalist problem-solving agents for the real world. he/him/ilShivon Zilis @shivon
123K Followers 2K Following Artificial intelligence, biological intelligence, and whatever exists in between and beyond. Made in Canada.It's super cool to see LLaMa go from its (little bit weird) math and science group origin story to the model and platform it has become!
We just released Meta Llama 3: the most capable openly available LLM available to date! The 8B & 70B models are out now, and we expect to release models with larger context windows, additional model sizes and more capabilities in the coming months.
One issue rarely discussed in ML research papers is that our results are ML library and hardware-specific. If we really want to make claims such as "my algorithm is the best," we should evaluate different ML libraries and hardware stacks.
super happy to announce that i was awarded an @NSERC_CRSNG discovery grant! 🥳 these funds will go towards the phd students that are starting with me in september in @UMontreal / @Mila_Quebec . super excited to start working with them!
resonates with my own experience: robot demo --> INSANE PAIN --> robot creating value in production luckily I am hopeful we have by now paid most of our dues at Covariant :)
Many movies exist about a lone inventor in a garage having a eureka moment, but almost none about manufacturing, so it’s underappreciated by the public. Compared to the insane pain of reaching high-volume, positive-margin production, prototypes are a piece of cake.
My hack for video calls is to turn off self-view. Can't remember when last I saw myself on a Zoom or Google meet call. Only downside is if I ever have spaghetti on my hair, my career is over.
I always prefer ordinary voice calls to Zoom calls. Zoom calls are much more work, because you have to think about what your body is doing and not just what your voice is doing. And you have to stay put; you can't pace like you can on a voice call.
SF has billboards with that paper we wrote @PSH_Lewis @_rockt @olapiktus
Half marathon in 1:30! 🏃🏾🎉 Beautiful scenery definitely helped 🌳 Wine last night definitely did not 🍷
Guess, what?! Nanni AI has now translated 1 million infant cries globally 🎉 🎉 🎉 That's a lot of "waaaahs" and a huge milestone for us. We're giving voice to infants all over the world and empowering parents to provide better and rapid care for their little ones. Onward to…
Congratulations @max_a_schwarzer on passing your doctoral defense yesterday! Well done and looking forward to more exciting things. Also congrats to your supervisors @AaronCourville and @marcgbellemare.
Me when reading/hearing about top-level reorgs.
Another one flew the nest! Though @ShehZaidi has been flying high for a while now :)
Most of deep learning successes build on classification. However, deep RL methods like DQN still use regression. Switching to classification leads to huge benefits in RL: we collected benchmarks as if they are pokemons ;) Lots of analysis why this simple change matters so much.
Framing regression as a classification has been “dark knowledge” for some time. We wanted to shed some light on this phenomenon in deep RL: Framing value-learning as a classification significantly improves performance and scalability in deep RL. But... not all classification…
Wonderful to find out that our real-world robotic adaptation work got featured in Nature’s “Images of the Month” series across all areas of Science alongside case studies of plasma on the Sun’s surface, neon nerve cells, and marine life in the deep ocean: nature.com/immersive/d415…
Waymo coverage than before! 🎉
Going within a day from deeply technical humble founder conversations to dinner with some “decision makers” confidently lecturing on ArTiFicIaL iNtElLiGeNcE that never heard about fine-tuning/inference/RAG is one of the bigger emotional rollercoasters of this job #dunningkruger
Enough with the hyperbole from all sides! I'm glad to have participated in this work taking a principled approach towards assessing the societal impact of Open Foundation Models. There is a lot more work to do of course, but this is a step in the right direction.
A recent MIT study claimed open models can help create bioweapons. But it didn’t test if they’re more useful than just having internet access (and later studies found they aren’t). How can we assess the impact of open foundation models? New paper: crfm.stanford.edu/open-fms
Check out our recent work, where we lift the Successor Representation to Distributional RL, in order to achieve zero-shot risk-aware transfer! This was a really fun project, with truly fantastic collaborators.
Introducing the Distributional Successor Measure (DSM): a model of the range of possible futures an agent faces. As a distributional extension of the Successor Representation, it enables zero-shot distributional policy evaluation beyond the capabilities of existing methods. The…
My tenth PhD student, Banafsheh Rafiee, just defended her thesis “State Construction in Reinforcement Learning”, in which she introduced three diagnostic testbeds based on animal learning experiments and the first generate-and-test algorithm for discovering auxiliary subtasks.…
i love this real talk from @alighodsi - he’s willing to say things many are not aligns with our own thinking