Michael Dillon @micdillon
Applied Scientist @ Amazon / Math Nerd Seattle, WA Joined March 2009-
Tweets236
-
Followers33
-
Following179
-
Likes136
Releasing the Sparse Transformer, a network which sets records at predicting what comes next in a sequence — whether text, images, or sound. Improvements to neural 'attention' let it extract patterns from sequences 30x longer than possible previously: openai.com/blog/sparse-tr…
1. Compute matters, specially for RL agents, but neither convnets nor LSTMs were invented when focusing on scale.
Rich Sutton has a new blog post entitled “The Bitter Lesson” (incompleteideas.net/IncIdeas/Bitte…) that I strongly disagree with. In it, he argues that the history of AI teaches us that leveraging computation always eventually wins out over leveraging human knowledge.
One could argue for these loops being genuine topological features of the underlying ImageNet data, since neural nets are a continuous map and t-sne/umap try to preserve neighborhood structure. (Counter argument: be cautious to draw conclusions from t-sne/umap layouts!)
Our new paper is out! We proposed a Gaussian-like distribution on hyperbolic space whose density can be evaluated and differentiated analytically. Our Hyperbolic VAEs capture hierarchical structure well. w/ @guguchi_yama, @mooopan, @Masomatics. arxiv.org/abs/1902.02992
Working on a little differential geometry notebook with @TensorFlow 2.0 and @matplotlib's pleasant 3d interface.
Very nice disambiguation of statistical notation, thanks to @avehtari
Interesting in quickly experimenting with BNNs, GPs, and flows? Check out Bayesian Layers, a simple layer API for designing and scaling up architectures. #NeurIPS2018 Bayesian Deep Learning, Happening now.
A fun way to describe Nesterov's momentum:
We just open-sourced a suite of ODE solvers in PyTorch: github.com/rtqichen/torch… Everything happens on the GPU and is differentiable. Now you can use ODEs in your deep learning models! Credit to @rtqichen.
So far we used ODEs for image classification, time series models, and density estimation: arxiv.org/abs/1806.07366. We implemented backprop using the adjoint method, which has constant memory cost. This let us scale ODE-based normalizing flows to SOTA: arxiv.org/abs/1810.01367
"Simple, Distributed, and Accelerated Probabilistic Programming". The #NIPS2018 paper for Edward2. Scaling probabilistic programs to 512 TPUv2 cores and 100+ million parameter models. arxiv.org/abs/1811.02091 github.com/google-researc…
#SundayClassicPaper📜: A Decision-based View of Causality. Lots of work going on in causality, so useful to reflect on this view defining causation in terms of unresponsiveness, and on Howard-form influence diagrams (aistats95). 🍂🎃 citeseerx.ist.psu.edu/viewdoc/downlo…
The videos from the 3 lectures I gave at #MLSS2018 are online🌱. If you watch any part of the 4.5 hours leave me some feedback: what's missing, should be left out, reordered, etc Video 1: youtu.be/BgZ_UFsjCD4 Video 2: youtu.be/YdwbVgEsg2M Video 3: youtu.be/B_F8PtU2XMU
The attendees at #mlss2018 Madrid were one of the most engaged I've ever had: so many questions and thoughts😻. I gave 3 lectures on 'Planting the Seeds of Probabilistic Thinking'. 🌱🎲 See the slides here: shakirm.com/slides/MLSS201…
Thought he’d just focus on Kavanaugh. Instead he gave best response on rape culture I’ve ever heard from a man! I aspire to be this reflective. Damn! #CancelKavanaugh #StopKanavaugh
Yordan Zaykov at #PROBPROG: "Infer.NET is now open-source." That's incredible news for the probabilistic programming community! github.com/dotnet/infer
Taming VAEs: A theoretical analysis of their properties and behaviour in the high-capacity regime. We also argue for a different way of training these models for robust control of key properties. It was fun thinking about this with @fabiointheuk arxiv.org/abs/1810.00597
New book on probabilistic programming on arXiv. I’m sure the authors @hyang144 @jwvdm @frankdonaldwood will welcome feedback. arxiv.org/abs/1809.10756
Classification and Regression Trees (CART) defines structured recursive classification and regression functions. O(n*log(n)) time global optimization (despite the exponential number of models) is achieved by dynamic programming. en.wikipedia.org/wiki/Decision_…
'Mathematics is the part of physics where experiments are cheap.' -- V. I. Arnold
Reproducing Kernel Hilbert spaces define norms on functions so that solutions of regularized fitting problems are linear sum of kernel functions. Defines non-parametric methods (complexity scales with input) in ML and imaging. en.wikipedia.org/wiki/Reproduci… numerical-tours.com/matlab/ml_2_re…
Shiwei Liu @Shiwei_Liu66
2K Followers 629 Following Hi, I am a PI at @ELLISInst_Tue & @MPI_IS. Was RS NIF @UniofOxford, JRF @SomervilleOx, postdoc @UTAustin, and PhD @Data_AI_TUe.
Aria_US_ @us_aria74874
31 Followers 1K Following
Deane @Deane98603
17 Followers 2K Following There are no difficulties that cannot be overcome, there are only people who cannot overcome them.
Statistics Dept - U o... @StatsUMan
1K Followers 3K Following Official twitter account for the Department of Statistics at the University of Manitoba.
Antonio Pizzutelli @AntonioPizzute1
2 Followers 18 Following
Christian @Christi44575393
69 Followers 1K Following I'm Looking for good and kind man,loyal, caring,thoughtful, creative, compassionate,imaginative, serious, sensual and passionate..
Terryl Smith @TerrylLSmith
223 Followers 1K Following
Henry Stone @henrylstone68
33 Followers 511 Following
John Goffney Jr. @JAG98118
6 Followers 121 Following
Ezra Penland @EzraPenland
72K Followers 81K Following Ezra Penland Actuarial Recruitment works with actuaries (actuary), actuarial analysts, catastrophe risk modelers, predictive modelers and executive roles.
kingdom christian @KINGDOMCC
71 Followers 256 Following
Angus Forbes @angusforbes
498 Followers 923 Following
Truffledig @truffledig
67 Followers 375 Following Truffledig’s gift-by-phone platform helps local businesses win new customers. Your store visitors gift your bestsellers instantly by Facebook or email to others
doge can kiss my ass @justinbneal
209 Followers 256 Following And also fuck 🖕🏻Elon Musk🖕🏾and this white supremacist website.
Guguchu @guguchu
3K Followers 1K Following Direct-to-fan sales and marketing platform for bands, band managers and labels.
Truck America @TruckAmerica
212 Followers 464 Following
Allyson Bates @allpirates941
60 Followers 367 Following
Exploited Records @exploitedrec
4K Followers 805 Following A la-la-land of quality dance-floor tunes; a psychedelic paradise of booty-funk, krunked-up disco, freaky house and foreign languages.
Aimee Janetta @janettaai
37 Followers 316 Following
Hopewell @wellhope
642 Followers 638 Following one band, spanning time, exploring the outer reaches so you don't have to.
Mad SubCulture @madsubculture
424 Followers 338 Following Welcome to the sublime, ridiculous and totally crazy world of MAD SubCulture. / http://t.co/QdhV4cMPE5 /
Cybrationz Live @cybrationz
318 Followers 1K Following Presenting the best hardcore event of the year.
Just Listen Music @Just_ListnMusic
435 Followers 2K Following Do you occasionally drink water? Then we have something in common. https://t.co/bp3ndJxMuu
Jennifer Bassett @Jabers
1K Followers 806 Following Executive Producer & Development @iHeartMedia for Bleep! with Ana Navarro & other shows
Vivian Nesbitt @VivianNesbitt
652 Followers 494 Following Actor, writer, musically inclined. Loves a lot of things deeply. Caffe Lena School of Music coordinator. Dangerous in the kitchen.
Megan Thomas @BunnyRa
91 Followers 267 Following
Soumith Chintala @soumithchintala
330K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Delip Rao @deliprao
73K Followers 5K Following AI researcher @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter. alt: 道元, improv, running 🌈
Lucas Beyer (bl16) @giffmana
156K Followers 656 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Eric Jang @ericjang11
146K Followers 4K Following
Aran Komatsuzaki @arankomatsuzaki
198K Followers 446 Following Sharing AI research. Early work on AI (GPT-J, scaling, MoE). Ex ML PhD (GT) & Google.
Eugene Vinitsky 🦋 @EugeneVinitsky
24K Followers 2K Following This account only exists so no on else can occupy it. Please contact through other means. Lab website: https://t.co/vrtbcqR11P
Jim Fan @DrJimFan
602K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Thomas Simonini @ThomasSimonini
10K Followers 841 Following Solo Indie Game Dev Making The Lighthouse Investigation: a detective game where you solve a 1907 cold case.
Danijar Hafner @danijarh
34K Followers 1K Following Building general agents for the physical world. Prev @GoogleDeepMind @UCBerkeley @UofT
Nathan Lambert @natolambert
107K Followers 957 Following Open model research, founder, director @trillium_labs. Prev. co-led Olmo at Ai2. Writes @interconnectsai, wrote https://t.co/alRXKINTwE
Keller Jordan @kellerjordan0
20K Followers 480 Following CIFAR-10 fanatic Pretraining @OpenAI OpCo LLC. Personal opinion poster
Tri Dao @tri_dao
46K Followers 671 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
DeepSeek @deepseek_ai
1.2M Followers 1 Following Unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
Shiwei Liu @Shiwei_Liu66
2K Followers 629 Following Hi, I am a PI at @ELLISInst_Tue & @MPI_IS. Was RS NIF @UniofOxford, JRF @SomervilleOx, postdoc @UTAustin, and PhD @Data_AI_TUe.
Ron Carter @RonCarterBass
28K Followers 217 Following My responsibility as a bassist and band leader is using every opportunity to create spectacular music. Recorded on 2200 albums … and counting.
David Duvenaud @DavidDuvenaud
36K Followers 4K Following Machine learning prof @UofT. Former team lead at Anthropic. Working on generative models, inference, & latent structure.
Zoubin Ghahramani @ZoubinGhahrama1
37K Followers 744 Following VP Research, Google DeepMind, ex-head of Google Brain. Professor at University of Cambridge. Machine Learning Researcher. ex-Chief Scientist & VP of AI, Uber.
Kevin Patrick Murphy @sirbayes
76K Followers 774 Following Research Scientist at Google DeepMind. Interested in Bayesian Machine Learning.
Steven Brunton @eigensteve
57K Followers 978 Following Teaches math to engineers: https://t.co/TJ5i3Pg678 Professor @UW researching #MachineLearning for #Dynamics and #Control, especially for #FluidDynamics.
Richard Sutton @RichardSSutton
73K Followers 63 Following Student of mind and nature, libertarian, chess player, cancer survivor. @ https://t.co/pioQVVjSXz, UAlberta, amii, https://t.co/vPRUv44glx, The Royal Society, Turing Award
Jascha Sohl-Dickstein @jaschasd
32K Followers 849 Following Member of the technical staff. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.
New Submissions to TM... @TmlrSub
2K Followers 3 Following Submissions to Transactions of Machine Learning Research
Picard Tips @PicardTips
145K Followers 2 Following No longer permitted to post here. Never requested a checkmark. (Created by @JoeSondow) Mastodon: @[email protected] Bluesky: @PicardTips.bsky.social
Zachary Lipton @zacharylipton
69K Followers 2K Following Professor: CMU/@acmi_lab, Cofounder: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷
Yi Ma @YiMaTweets
129K Followers 838 Following Chair Professor of AI, Hong Kong University Pursuing a Mathematical Theory of Intelligence: https://t.co/leZlkUQDhL
Elias Bareinboim @eliasbareinboim
15K Followers 608 Following Professor of Causal Inference, Machine Learning, and Artificial Intelligence. Director, CausalAI Lab @ Columbia University.
#CVPR2026 @CVPR
53K Followers 329 Following Official account for IEEE/CVF Conference on Computer Vision & Pattern Recognition. Hosted by @CSProfKGD @deblinaforAI @YVinker @anfurnari @_vztu
Mike Sowden @Mikeachim
35K Followers 2K Following Writer (on science, travel & curiosity), Yorkshireman, tedious enthusiast, professional overthinker, Megathreader. Now: Scotland. Writes Everything Is Amazing.
ICLR @iclr_conf
63K Followers 57 Following International Conference on Learning Representations #ICLR2027. SPC is @jacobandreas and GC is @BharathHarihar3
AI Conference DL Coun... @DlCountdown
22K Followers 11 Following Bot. I daily tweet progress towards machine learning and computer vision conference deadlines. Maintained by @chriswolfvision.
Women in Statistics a... @WomenInStat
18K Followers 341 Following Weekly RoCur (Rotating Curator) @AmstatNews Committee on Women in Statistics #WSDS Learn & sign up: https://t.co/aV1Fcdxd5c This week:
Daniela Witten @daniela_witten
63K Followers 679 Following dorothy gilford endowed chair and prof of stat/biostat @uw. all views my own.
Jeffrey Rosenthal @ProbabilityProf
3K Followers 210 Following Professor, University of Toronto; author of "Struck by Lightning". Info at: https://t.co/zXmNLhgj8X Now at: https://t.co/1HYlGmVSoQ
Frank Nielsen @FrnkNlsn
44K Followers 2K Following AI Science is Real! Information Geometry, Information Theory, Geometric Science of Information, HPC @SonyCSL
Nisheeth Vishnoi @NisheethVishnoi
4K Followers 25 Following A. Bartlett Giamatti Prof. of CS @ Yale | Algorithms, AI & society Newsletter: The Intelligence Loop https://t.co/OUtL9mZXtP Views my own
Penrose @UsePenrose
2K Followers 14 Following create beautiful diagrams just by typing mathematical notation in plain text
Michael Bronstein @mmbronstein
60K Followers 8K Following #DeepMind Professor of #AI @UniofOxford / Director #AITHYRA / Chief Scientist @proximabio / https://t.co/kZpGpDzYeV (opinions are mine) 🤖🧪🧬🎶🐎
Bernhard Schölkopf @bschoelkopf
15K Followers 63 Following
Geometry Collective @GeomCollective
3K Followers 12 Following We are a group of researchers @CarnegieMellon @SCSatCMU studying the interaction between geometry and computer science. (Threads & Insta: geometry.collective)
Symposium on Geometry... @GeometryProcess
2K Followers 300 Following Symposium on Geometry Processing 2022, Graduate School: July 2-3 Conference: July 4-6 Schedule: https://t.co/r0FVFiQAGL
Taco Cohen @TacoCohen
31K Followers 4K Following Slop janitor & post-trainologer at Meta / FAIR. Into codegen, RL, equivariance. Spent time at Qualcomm, Scyfer (acquired), UvA, Deepmind, OpenAI.
Max Welling @wellingmax
43K Followers 475 Following
Constantine Caramanis @cmcaram
1K Followers 537 Following Professor at UT Austin, Research in Machine Learning/AI and Optimization. Always rethinking teaching (English & Greek). Aspiring accordion street musician.
Amin Karbasi @aminkarbasi
15K Followers 3K Following VP & Chief AI Scientist @Cisco. (adjunct) Prof at @Stanford, ex Chief Scientist at Robust Intelligence (acquired by Cisco). ex Prof @Yale, ex @Google. My views.You might like
