Research Scientist, Google Brain now DeepMind
where cognitive science and machine learning meetcs.colorado.edu/~mozer San Francisco, CAJoined January 2022
🌟To appear in the MechInterp Workshop @ #NeurIPS2025 🌟
Paper: arxiv.org/abs/2509.04466
How do language models (LMs) form representation of new tasks, during in-context learning? We study different types of task representations, and find that they evolve in distinct ways.
🧵1/7
[📜1/9] Does machine unlearning truly erase data influence? Our new paper reveals a critical insight: 'forgotten' information often isn't gone—it's merely dormant, and easily recovered by fine-tuning on just the retain set.
We are announcing the launch of Airial Travel’s open-to-all beta version for desktop today. Airial is your personal travel agent with AI superpowers which makes planning and booking trips as easy as dreaming them up. airial.travel
Me and Sanjeev co-founded Airial…
Excited to present "Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery" at #NeurIPS2024!
TL;DR: Our model, SynCx, greatly simplifies the inductive biases and training procedures of current state-of-the-art synchrony models. Thread 👇 1/x.
The ability to properly contextualize is a core competency of LLMs, yet even the best models sometimes struggle. In a new preprint, we use #MechanisticInterpretability techniques to propose an explanation for contextualization errors: the LLM Race Conditions Hypothesis. [1/9]
🔍 New LLM Research 🔍
Conventional wisdom says that deep neural networks suffer from catastrophic forgetting as we train them on a sequence of data points with distribution shifts. But conventions are meant to be challenged!
In our recent paper led by @YanlaiYang, we discovered…
Nature Comms paper: Subtle adversarial image manipulations influence both human and machine perception! We show that adversarial attacks against computer vision models also transfer (weakly) to humans, even when the attack magnitude is small. nature.com/articles/s4146…
1/ Today we are excited to introduce Phenaki: phenaki.github.io, short-link-to-paper, a model for generating videos from text, with prompts that can change over time, and that is able to generate videos that can be as long as multiple minutes!
Two important breakthroughs from @GoogleAI this week - Imagen Video, a new text-conditioned video diffusion model that generates 1280x768 24fps HD video. And Phenaki, a model which generates long coherent videos for a sequence of text prompts. imagen.research.google/video/
We are excited to make the jump to complex real-world data with this class of models — and about the potential that slot-based models have for reducing the need for detailed human supervision when learning about the physical world.
6/7
Excited to share our work on self-supervised video object representation learning:
We introduce SAVi++, a slot-based video model that — for the first time — scales to Waymo Open driving scenes w/o direct supervision.
🖥️ slot-attention-video.github.io/savi++
📜 arxiv.org/abs/2206.07764
1/7
Overcoming temptation: Incentive design for intertemporal choice
arxiv.org/abs/2203.05782
We use AI models to help individuals adhere to long-term goals (e.g., retirement savings, weight loss) and avoid giving in to temptation.
78K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
50K Followers 9K FollowingI lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
10K Followers 855 FollowingI want to understand things deeply and explain them well. Building friendly AI @AnthropicAI Give me anonymous feedback: https://t.co/7aBNrpbad8
15K Followers 218 FollowingAssociate Professor @ SFU (Research Chair), Research Scientist @ Google DeepMind, Associate Professor (status only) @ UofT. Opinions are my own.
28K Followers 1K FollowingResearch at @GoogleDeepMind. Controllable World Simulators (GNNs, Structured World Models, Neural Assets). Veo Team (Ingredients to Video Co-Lead)
49K Followers 673 FollowingProfessor, Santa Fe Institute. Mostly posting on https://t.co/4NpA2IL5Va (at-melaniemitchell). More thoughts at https://t.co/nC43NHRozX.
121K Followers 639 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
7K Followers 1K FollowingStaff Research Scientist at Google DeepMind. Interested in the science of deep learning. Current focus: Pushing boundaries of LLMs capabilities
716 Followers 6K FollowingIt’s not for nothing that Bernhard is also called the Grim and Grisly, Gruesome Griswold. He lives for a sigh, he dies for a kiss, he lusts for the laugh.
18K Followers 4K FollowingAI professor.
Deep Learning, AI alignment, ethics, policy, & safety.
Formerly Cambridge, Mila, Oxford, DeepMind, ElementAI, UK AISI.
AI is a really big deal.
6K Followers 5K FollowingTechnical design at @exoultcom; @expedia (@vrbo) & @mckinsey alumni. Bibliophile. Dog mom. Urban homesteader 👩🌾🍃 Views are my own
468 Followers 471 FollowingML PhD student @ml_tuberlin & @bifoldberlin. Diffusion post-training. Aiming to solve intelligence and use that for everything else. Views aren’t my employer’s.
419 Followers 583 FollowingSenior ML scientist@AWS AI working on multi-model models. PolygonRNN, 3DOP, PC training, TubeR. PhD (ABD) at University of Toronto ML group
78K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre physicist at @nyuniversity (@CILVRatNYU) & @PrescientDesign
46K Followers 1K Following(On mat leave.) Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS.
50K Followers 9K FollowingI lead @Cohere_Labs. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, ML reliability. Changing spaces where breakthroughs happen.
50K Followers 404 Following@AnthropicAI. Prev. @Google Brain/DeepMind, founding team @OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD.
10K Followers 855 FollowingI want to understand things deeply and explain them well. Building friendly AI @AnthropicAI Give me anonymous feedback: https://t.co/7aBNrpbad8
368K Followers 6K FollowingChief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
28K Followers 1K FollowingResearch at @GoogleDeepMind. Controllable World Simulators (GNNs, Structured World Models, Neural Assets). Veo Team (Ingredients to Video Co-Lead)
121K Followers 639 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
7K Followers 1K FollowingStaff Research Scientist at Google DeepMind. Interested in the science of deep learning. Current focus: Pushing boundaries of LLMs capabilities
2K Followers 598 FollowingML/AI Research Engineer @GoogleAI. Working on Expressive ML and approaches in Human-AI Interactions. Opinions are my own. Formerly: @GoogleBrain, @GoogleMagenta
453 Followers 531 FollowingPhD student at Brown interested in deep learning + cog sci, but more interested in playing guitar. @NSF GRFP Fellow, @GoogleDeepMind Intern. He/Him.
38K Followers 9 FollowingProfessor of machine learning at the University of Cambridge. Opinions are my own. Author of "The Atomic Human"
Mainly found on @lawrennd.bsky.social
26K Followers 720 FollowingMember of the technical staff @ Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.
6K Followers 762 FollowingSenior Research Scientist @GoogleDeepMind. I ∈ Optimization ∩ Machine Learning. Fan of @IronMaiden🤘.Here to discuss research 🤓
2K Followers 1K FollowingProf@KAIST, Chief Dreamer of Machine Learning & Mind Lab https://t.co/ato9yodtm5 Previously, professor at Rutgers, postdoc at Mila, and PhD at UC Irvine
1K Followers 440 FollowingResearch Scientist @GoogleDeepMind,
pre-training and architecture research in Gemini, Gemma.
On leave from PhD with @AaronCourville.
Opinions are my own.
2K Followers 673 FollowingResearch scientist at Google DeepMind. Ph.D. in Machine Learning from the University of Toronto / Vector Institute. @[email protected]
5K Followers 661 Following🇨🇦 Assistant Professor of Comp Sci. and Data Sci. at NYU. Machine Learning, Human-like AI. @agentic_ai_lab
Follow me on @mengyer.bsky.social
5K Followers 1K FollowingGenAI for *human* creativity in music + more. Assistant prof at CMU CSD, 🎼 G-CLef lab. Part time Google DeepMind, Magenta (views my own)
3K Followers 2K FollowingMachine learning / AI Safety at @AnthropicAI and University of Toronto / Vector Institute. Prev. @google (Blueshift Team) and @nvidia.