I'm really excited about this new work from @jmes_harrison@jwilles_. Quite good uncertainty without much overhead by integrating out the last layer using variational inference.
I'm really excited about this new work from @jmes_harrison@jwilles_. Quite good uncertainty without much overhead by integrating out the last layer using variational inference.
I've been enjoying Penzai the new Jax lib. It's very opinionated, but close to my ideal NN library.
To test it out I ported the Tensor Puzzles to use NamedArrays. Feels so clean without the [:, None]'s
srush.github.io/Tensor-Puzzles…
Excited to share Penzai, a JAX research toolkit from @GoogleDeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere.
Check it out on GitHub: github.com/google-deepmin…
Want a really simple (and cheap!) way to improve neural net calibration and get practical epistemic uncertainty estimates?
At ICLR this year: Variational Bayesian Last Layers
Try it out:
1. pip install vbll
2. a couple one line changes to your current training pipeline
🧵
It seems Global Warming is already fact. Indeed we should spend serious €€ to minimize & mitigate consequences. Instead we will wait until chaos ensues and then we will vote right wing power hungry opportunists with simple solutions to power. And we all know what happens next.
It seems Global Warming is already fact. Indeed we should spend serious €€ to minimize & mitigate consequences. Instead we will wait until chaos ensues and then we will vote right wing power hungry opportunists with simple solutions to power. And we all know what happens next.
I'm delighted to present that our AutoBNN library is out. We show how to define a meaningful prior over functions, based on sums and products of base GP kernels, and convert it to a mathematically equivalent (in the limit) neural net architecture. This gives strong OOD…
New paper: How can you tell when a model is hallucinating? Let it cheat! An expert doesn't need to cheat, so if your model learns to cheat, there must be something it doesn't know.
Our general new approach for measuring uncertainty: arxiv.org/abs/2402.08733
Hey @AnthropicAI, @MrinankSharma took his PhD defense from your office. After passing (w flying colors), he said he was going back to work. Make him celebrate or something! 🎉. Congrats Mrinank!
📢 Seeking ICML ethics reviewers!
Please DM me if you have relevant experience and would like to serve. I can’t promise glory but you will certainly have my gratitude if you do.
Want to do some really cool science and apply LLMs to data that's biased and messy, but not in the same way that human language is? We have tons of data, bunches of compute, and an ambitious problem to tackle that just might help save lives 🧬
-> bioptimus.com/careers
Want to do some really cool science and apply LLMs to data that's biased and messy, but not in the same way that human language is? We have tons of data, bunches of compute, and an ambitious problem to tackle that just might help save lives 🧬
-> bioptimus.com/careers
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
45K Followers 2K FollowingML / AI researcher, emphasis on theory.
Research Director and Canada CIFAR AI Chair, @VectorInst
Professor, @UofT (Statistics/CS)
185K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
40K Followers 1K FollowingSecular Bayesian.
Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey
Alum of @Twitter, Magic Pony and @Balderton
33K Followers 966 FollowingCofounded & running @ml_collective.
Host of Deep Learning Classics & Trends.
Research at Google DeepMind.
DEI/DIA Chair of ICLR & NeurIPS.
Writing https://t.co/IbycyGfnDR
39K Followers 7K FollowingI lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
22K Followers 1K FollowingKnowledge manifests itself in radiant dreams that shimmer like the wild sun
Views are my own
pfau at sigmoid dot social on 🦣
https://t.co/xqtVHHVI17 on 🦋
12K Followers 2K FollowingPrincipal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
50K Followers 2K FollowingResearch Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
24K Followers 615 FollowingVP Research, Google DeepMind, ex-head of Google Brain. Professor at University of Cambridge. Machine Learning Researcher. ex-Chief Scientist & VP of AI, Uber.
296K Followers 6K FollowingChief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
2K Followers 3K FollowingPM who loves to write a bit of code, into 3d printing and some other stuff. @yandex alumni (12 years, head of blog search service, tech marketing, taxi)
955 Followers 1K FollowingEVO64 is an authentic Commodore 64 remake that fully-integrates the best mods & upgrades, for a deeply pleasing Audio & Video experience packed with surprises
291 Followers 4K FollowingCS PhD student at UoB in the United Kingdom. Research interests: Automated Machine Learning, Online Learning, and Reinforcement Learning 🏳️🌈
20K Followers 3K FollowingBuilding Multimodal Models for eCommerce @ https://t.co/jQ0lYh57MP, 2x founder 9-figure exit, YPO, FC Most Creative, Emmy Nom
324 Followers 2K FollowingMom, Life long learner of applied ML, DS, AI, Analytics, Python, R, NLP, Science and Tech. Not a Product Manager. Opinions are mine. Likes=Bookmarks.
945 Followers 5K FollowingProgram Manager @Google: Health AI, AI for Social Good, Impact-Driven Research, Innovation, Moonshots. @UChicago grad, cancer survivor, @UeliRutishauser's wife.
18 Followers 771 FollowingBoost all aspects of your business with our bespoke B2B AI solutions in prompt engineering, personas and automation. #AI #Automation #GenerativeAI🚀
61K Followers 2K Followinga combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
45K Followers 2K FollowingML / AI researcher, emphasis on theory.
Research Director and Canada CIFAR AI Chair, @VectorInst
Professor, @UofT (Statistics/CS)
185K Followers 877 FollowingCofounded and lead @PyTorch at Meta.
Also dabble in robotics at NYU.
AI is delicious when it is accessible and open-source.
40K Followers 1K FollowingSecular Bayesian.
Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey
Alum of @Twitter, Magic Pony and @Balderton
58K Followers 638 FollowingDirector, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.
33K Followers 966 FollowingCofounded & running @ml_collective.
Host of Deep Learning Classics & Trends.
Research at Google DeepMind.
DEI/DIA Chair of ICLR & NeurIPS.
Writing https://t.co/IbycyGfnDR
39K Followers 7K FollowingI lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
111K Followers 35 FollowingNew Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
50K Followers 2K FollowingResearch Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).
24K Followers 615 FollowingVP Research, Google DeepMind, ex-head of Google Brain. Professor at University of Cambridge. Machine Learning Researcher. ex-Chief Scientist & VP of AI, Uber.
296K Followers 6K FollowingChief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
16K Followers 685 FollowingChief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAI
59K Followers 2K Following✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHub
1K Followers 2K FollowingPostgraduate researcher (PhD) at Imperial College London and visiting researcher at the University of Oxford. Working on probabilistic machine learning.
2K Followers 571 FollowingResearcher at @GoogleDeepMind. PhD student at @VectorInst / @UofT. Building tools to study neural nets and find out what they know. He/him.
1K Followers 1K Followingcomputational biology and machine learning. assistant professor at @UF. tsinghua (phd) → stanford (postdoc with @SnyderShot) → ufl (pi). views are my own.
1K Followers 210 FollowingPhD student @oatml_oxford supervised by @yaringal | previously interned at deepmind, google brain | former professional chess player
496 Followers 390 FollowingSenior Scientist for ML in Biologics Engineering at @AstraZeneca.
Previously PhD student and @Gates_Cambridge scholar at @CambridgeMLG.
Views are my own.
4K Followers 562 FollowingResearch scientist at FAIR NY + collab w/ Vector Institute. ❤️ Machine Learning + Information Theory. Previously, PhD at UoAmsterdam, intern at DeepMind + MSRC.
2K Followers 685 FollowingFaculty Fellow at NYU. Trustworthy (safe x transparent x fair) ML.
I'm on the faculty job market.
Prev: PhD Student & Rhodes Scholar at University of Oxford.
8K Followers 703 Following"If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
25K Followers 1K FollowingSenior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.
5K Followers 304 FollowingSenior research fellow (faculty) in machine learning at the University of Oxford,
Head of RainML Research Lab (https://t.co/uuBwQ2WdMN)
604 Followers 422 FollowingResearch Scientist at @GoogleDeepMind. PhD in Machine Learning at @OxfordStats. Google PhD Fellow in ML & Aker Scholar. Prev. math @UniofOxford @Cambridge_Uni.