Pierre Nyquist @PierreNyq
Assoc. prof. in mathematics @chalmersuniv and @goteborgsuni. Mainly probability, analysis and computational methods, however I like to visit most areas of math pierrenyq.github.io Gothenburg, Sweden Joined July 2017-
Tweets1K
-
Followers567
-
Following492
-
Likes1K
Interested in operations research and data science? In Nov we are organising a workshop on data-driven methods in OR, as part of the DDQC-series, at EURANDOM in Eindhoven: see ddqc.io. Registration is open, any questions are of course welcome!
Always nice to be back in Eindhoven, this time for a celebratory occasion. In hindsight, EURANDOM played a very important role in my development as a young researcher. Happy anniversary!
This is spot on! Writing is hard and takes a lot of work for most of us. I know I annoy students with this but it is such an important part of becoming a researcher.
This is spot on! Writing is hard and takes a lot of work for most of us. I know I annoy students with this but it is such an important part of becoming a researcher.
Side note on this: for various reasons we wanted to make the arXiv deadline on Wednesday and were scrambling to do so. I am sorry, but if this is how I felt for a "deadline" we set *for ourselves*, how do people live with the stress of conference deadlines? I would be a wreck.
Side note on this: for various reasons we wanted to make the arXiv deadline on Wednesday and were scrambling to do so. I am sorry, but if this is how I felt for a "deadline" we set *for ourselves*, how do people live with the stress of conference deadlines? I would be a wreck.
This is such great advice and something I have always been surprised not being emphasized more, from undergrad to grad school. Ed Witten came and gave a talk when I was in undergrad and it was precisely like Neal describes.
This is such great advice and something I have always been surprised not being emphasized more, from undergrad to grad school. Ed Witten came and gave a talk when I was in undergrad and it was precisely like Neal describes.
Because I was traveling to Warwick last week, I did not see this great piece of work by @sp_monte_carlo and co until waiting at the airport in Amsterdam. Then got the benefit of having Andi give an in-person summary—people should be reading this! arxiv.org/abs/2402.13678
Stepping into the lion’s den that is Warwick’s stats dept to talk about MCMC.
Reminds me of ’15, when there was a record amount of snow in Boston, and (I think) in Providence as well. I lived just off campus on George St and people were skiing & snowboarding from campus to downtown. That is also when I learned about “snow days”.
Reminds me of ’15, when there was a record amount of snow in Boston, and (I think) in Providence as well. I lived just off campus on George St and people were skiing & snowboarding from campus to downtown. That is also when I learned about “snow days”.
Sam Power @sp_monte_carlo
17K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)
Clément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6
Michael Kinyon @ProfKinyon
17K Followers 1K Following No longer here (thanks Elon). Mathematics professor @UofDenver. Quasigroups, Semigroups, Automated Deduction. He/Him. Same username on other social media.
Pierre Alquier @PierreAlquier
8K Followers 5K Following Professor of Statistics @ESSEC_AP 🇸🇬 // Previously @RIKEN_AIP 🇯🇵 @ENSAEparis 🇫🇷 @ucddublin 🇮🇪 🇪🇺 // random posts about research & birds photos // 🌈
Shubhendu Trivedi @_onionesque
7K Followers 853 Following Cultivated Abandon. Twitter interests: Machine learning research, applied mathematics, mathematical miscellany, ML for Physics/Chemistry, books.
Daniel Litt @littmath
37K Followers 871 Following Assistant professor (of mathematics) at the University of Toronto. Algebraic geometry, number theory, forever distracted and confused, etc. He/him.
Alex Kontorovich @AlexKontorovich
24K Followers 804 Following Mathematician (Distinguished Professor of #Math at @RutgersU). Here to learn about research, education, and community. Let’s build something together.
Massimiliano Tamborri.. @tamborrino_m
650 Followers 210 Following Associate Professor in Statistics at @warwickstats | Inference for Stochastic processes | Stochastic Modelling | Stochastic Numerics | Neuroscience
Arthur Charpentier �.. @freakonometrics
27K Followers 15K Following Dad & born-again mathematician. Statistician, fellow actuary & data addict. Professor & researcher, full of 'satiable curtiosity.
Simon Pepin Lehalleur @plain_simon
3K Followers 5K Following Mathematician (algebraic geometry, motives & friends, singularity theory and ML). 'Geometry is successful magic' (R. Thom) University of Amsterdam. He/Him
Bert Zwart @BertZwart1
1K Followers 249 Following prof @ CWI & TU/e stochastic OR - probability - rare events - energy systems father - husband - has-been draughtsplayer - wannabe runner
Zhaoyang Wang @wangwan83764204
357 Followers 4K Following CS PhD student at Uni of Birmingham in the United Kingdom. Research interests: Automated Machine Learning (BayesianOp), and Reinforcement Learning🏳️🌈
Machine Learning: Sci.. @MLSTjournal
9K Followers 10K Following A multidisciplinary, #openaccess journal devoted to the application and development of #machinelearning for the sciences. Published by @IOPPublishing.
Lucas ⏚ @lucasgautheron
7K Followers 4K Following PhD candidate in science studies (IZWT) and @Cognition_ENS member. Ex @univ_paris_cite and @ENS_ParisSaclay. Former publication director @LeMediaTV
Charles Vorbach @charles_vorbach
104 Followers 2K Following Converting electricity into heat. AV as a byproduct?
Maile Digrande @DigrandMail
65 Followers 5K Following
Hilbert Spaess @HilbertSpaess
76 Followers 388 Following Born to do algebra. Forced to care about floating points. Ex cog-sci. Current ML-sci.
Cassandra Fox @cassandra_71556
109 Followers 5K Following
Felipe Nuti @NutiFelipe
190 Followers 1K Following CS @ Uni of Oxford | Research @ VGG Prev QR intern @ CitSec | Prev. ML Intern @ QuantCo Interested in Generative Modeling and Reinforcement Learning
Gabrielle Macchiarell.. @GabrielleM31697
83 Followers 5K Following
Ara Noud @ara_noud66704
41 Followers 5K Following
Fiona Skerman @fionnaz
87 Followers 711 Following
Belief @belief60814
6 Followers 663 Following
Braghadeesh Lakshmina.. @braghadeesh
78 Followers 304 Following Doctoral Student @ KTH |M Tech @ IISc | B Tech @ NIT Trichy. Interested in #controltheory #machinelearning #optimization
Mohammed Nasser ☣�.. @__Mohammed23
5 Followers 882 Following Garbage always took itself out♻️-- Software Development Engineer 💻 Boxing player 🥊 Runner 🏃 Earn it just to burn it.⚡
↑↓ Lionel Yelibi .. @Spiindoctor
2K Followers 3K Following Lead ML Researcher @discover, PhD candidate @statsuct: Statistical Physics, Clustering, Manifold Learning, Networks, ABMs. Here for the memes 😊 | 🇨🇮🇿🇦🇺🇸
Guanyang Wang @GuanyangW
355 Followers 275 Following Assistant professor of statistics @RutgersU, former Ph.D of math @Stanford, undergrad of math @USTC.
Pierre-Alex Mattei @p.. @pamattei
678 Followers 1K Following Research scientist @inria, member of the @inriaMaasai team, statistical machine learning
Stephan Mescher @FullMescher
507 Followers 2K Following Mathematiker an der Uni Halle. Vorher Leipzig, London, Bochum, Bielefeld, Vechta. Manchmal etwas altmodischer Geek mit vielen Interessen.
Ann without an E @NewAcc010111
0 Followers 75 Following I am looking for friends 🫂. This is my 3rd account. The 1st ended with the outbreak of war with 🇺🇦. The 2nd - when I disappointed someone important💔. 🏃🐶🙃
Zhengang Zhong @Zhengang_Z
70 Followers 227 Following PhD student in data-driven control @ImperialCollege
Lin Deng @CLDDD009
3 Followers 179 Following
Vishal Tiwari @nonlinearvishal
105 Followers 616 Following Runner | PhD Student @ https://t.co/FV9YrYgTas | Alumni @IITguwahati
WangYing @rigel_falcon
11 Followers 162 Following A PhD student working on modeling nonlinearity of neural dynamics with EEG/iEEG data.
Jhon Roly @JhonRoly5
247 Followers 3K Following Economy / Research / Econometrics / Math / Statistic / Interested in Data Analysis
أسماء @itranslate456
103 Followers 582 Following To tweet or to delete; that’s the question. Free Palestine 🇵🇸 𓂆 - "تحريرها كلها ممكن .. تحريرها كلها بدأ" #lingtwt #langtwt #literarytranslation
MognMogn @steeziewondah
73 Followers 500 Following
Atul Raj @AtulRaj58392564
7 Followers 113 Following
Ed Blyden @EdBlyden
124 Followers 2K Following I'm pretty good at breathing while sleeping. Zionism = Nazism = Genocide Let's not be afraid of distinct ideas, but rather the lack of them.
Meng Li @limengnlp
15 Followers 527 Following PhD student @unipotsdam, supervised by @davidschlangen. Working on NLP, ML and CogSci. Prev @LstSaar. Former NLP engineer.
cadete de la poesía .. @Un_Santajaro
592 Followers 1K Following matemático aplicado | trabajo con datos | leo poesía. Machetero y vendedor de amor. Filósofo de barrio. Estoy en un año sabático desde el 90 y pico.
Minas Karamanis @MinasKaramanis
482 Followers 2K Following Physicist - Postdoc @UCBerkeley - Astrostatistics, Computational Statistics, Machine Learning, Bayesian Inference - Views are my own
iddikage @achivasmcwana
82 Followers 688 Following MPhil Computational Nuclear Science & Engineering @UnivofGh
Steve Shen @SteveSh00938072
1 Followers 2K Following
Max @MaxMLang
13 Followers 241 Following Incoming DPhil @Oxford_NDPH MSc @OxfordStats, previously @StatsatLMU Interested in Bayesian Statistics and Disease Modelling 🐘:[email protected]
neonmochi @fran_diaz_rio
42 Followers 747 Following
Rafael Scatena @RafaelScatena1
27 Followers 319 Following doutorando física med. FFCLRP-USP (@ffclrppos) (@usprp)
__vaibhav__ @Sillychap101
102 Followers 3K Following Computer Science and Mathematics undergrad | IIITD
Ibrahim Ahmad @Ibrahim63433664
84 Followers 3K Following
Sam Power @sp_monte_carlo
17K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)
Clément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]
Gabriel Peyré @gabrielpeyre
92K Followers 450 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6
Steven Strogatz @stevenstrogatz
157K Followers 3K Following Mathematician, writer, Cornell professor. All cards on the table, face up, all the time.
Aryeh Kontorovich @aryehazan
4K Followers 472 Following probability, statistics, metric spaces, Markov chains, freedom (social & academic), Israel, Jew stuff. opinions represent my employer & all other groups I'm in
Peyman Milanfar @docmilanfar
67K Followers 264 Following Distinguished Scientist at Google Research. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Ben Recht @beenwrekt
26K Followers 365 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Michael Kinyon @ProfKinyon
17K Followers 1K Following No longer here (thanks Elon). Mathematics professor @UofDenver. Quasigroups, Semigroups, Automated Deduction. He/Him. Same username on other social media.
Lénaïc Chizat @LenaicChizat
2K Followers 242 Following Assistant professor @epfl (previously @cnrs researcher). Interested by what's simple, beyond the obvious.
Ben Golub 🇺🇦 @ben_golub
49K Followers 2K Following econ prof @NorthwesternU visiting Stanford 23-24 social and economic networks from Ukraine past: @Harvard | @Stanford'12 | @Caltech '07
Kevin Patrick Murphy @sirbayes
43K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.
Boaz Barak @boazbaraktcs
17K Followers 422 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.
Gautam Kamath @thegautamkamath
44K Followers 508 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.
Jelani Nelson @minilek
22K Followers 184 Following Professor @Berkeley_EECS. Research Scientist (part-time) @GoogleAI. Founder @addiscoder. 🇻🇮🇺🇸🇪🇹
Timothy Gowers @wtgow.. @wtgowers
45K Followers 188 Following Mathematician. Professeur titulaire de la chaire Combinatoire au Collège de France. Also fellow of Trinity College Cambridge.
🔥Kareem Carr | Sta.. @kareem_carr
172K Followers 407 Following Stats PhD student @Harvard • Follow me if you’re curious about statistics and data science.
Yann LeCun @ylecun
713K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Stefano Sarao Mannell.. @stefsmlab
415 Followers 125 Following Postdoc in theoretical ML and neuroscience @GatsbyUCL @SWC_neuro @UCL | previously @UniofOxford and @CEAParisSaclay | Starting in Sept @chalmersuniv as PI
Fiona Skerman @fionnaz
87 Followers 711 Following
Marylou Gabrié @marylougab
607 Followers 176 Following Assistant Prof @Polytechnique working on Statistical Mechanics & Machine Learning.
Anthea Monod @AntheaMonod
459 Followers 94 Following Asst. Prof. (Lecturer) @imperialcollege. Data Scientist. Topological data analyst. Algebraic statistician. Language enthusiast. Sourdough baker. Mom.
Lawrence Murray @lawmurray
2K Followers 533 Following Machine learning, Monte Carlo methods, GPU computing, C++, open source & a dose of creative things. On Mastodon at https://t.co/dejfadOKO2
Sébastien Darses @DarsesSebastien
3K Followers 3K Following Assoc. Prof. (he/him 🏳️🌈), Visiting @CRM_Montreal @CNRS_INSMI @CNRS 📚 Probability, Statistics, Analytic Number Theory 👨🎓Teaching project @highkholle
Jun Yang @new2_yj
377 Followers 495 Following Interested in computational statistics and machine learning.
A Cambridge Diary @acambridgediary
54K Followers 74 Following The original Cambridge Diary. 5,000 continuous daily pictures of #cambridge New book 'Town & Gown' available now at https://t.co/JmfzBlMROL
Keith Devlin @profkeithdevlin
17K Followers 729 Following Mathematician (Emeritus Stanford), author, blogger, formerly "The Math Guy" on NPR. Co-founder of https://t.co/RYZrne81qU. On Mastodon: @[email protected].
uzu lim @cutezu_
1K Followers 506 Following Math postdoc in Oxford. I work on geometry of data 🍩 한국인🌶️ Trans🏳️⚧️ Also interested in number theory, physics, art, music
Mufan (Bill) Li @mufan_li
813 Followers 494 Following Postdoc @Princeton ORFE | Prev: PhD @UofTStatSci @VectorInst
Petar Jovanovski @pjovanovski1
67 Followers 119 Following PhD student in Mathematical Statistics @StatsChalmersGU | Stochastic Differential Equations, Sequential Monte Carlo, ABC.
Hannah Lawrence @HLawrenceCS
517 Followers 398 Following PhD @ MIT CSAIL. Geometric deep learning, especially learning with symmetries (equivariance). https://t.co/0XcSE5V8S2
Leonard Wong @wongtkleonard
353 Followers 284 Following Assistant Professor @UofTStatSci and @UTSC. I work on mathematical finance, probability, optimal transport, information geometry, and their applications.
Dan Kessler (he/him) @dankessler
1K Followers 3K Following Current: Postdoc @UWStat. Future: Faculty @UNCSTOR & UNCSDSS. Past: PhD Student @UMichStatistics.
Jonathan N. Katz @Jonathan_N_Katz
1K Followers 4K Following Professor @Caltech, social sciences and statistics. Mastadon: @[email protected].
Göteborgs universite.. @goteborgsuni
15K Followers 146 Following Göteborgs universitet på svenska och engelska. University of Gothenburg in Swedish and English.
Neal Parikh @npparikh
3K Followers 850 Following Teaching AI policy at Columbia. Previously Director of AI for NYC. PhD from Stanford AI Lab. https://t.co/IWui2szqUu
Marc Lelarge 🌻 @marc_lelarge
5K Followers 595 Following Researcher in mathematics and machine learning @Inria and @ENS_ULM. Tweeting about maths and AI.
Ethan Epperly @ethanepperly
1K Followers 470 Following PhD candidate in applied math @Caltech and @doecsgf fellow interested in computational linear algebra he/him
Fredrik Hellström @FrHellstrom
277 Followers 335 Following Postdoc @ai_ucl & @WASP_Research generalization, online/active learning, information theory, etc ⚽
Rasmus Pagh @RasmusPagh1
2K Followers 374 Following Professor of computer science at @barcdk, University of Copenhagen. Interested in random things and their applications.
David Dennis Jr. @DavidDTSS
44K Followers 2K Following Indie Bestselling Author of The Movement Made Us - Available Now! Senior Writer @Andscape Speaking Inquiries: [email protected]
Gabriele Corso @GabriCorso
4K Followers 637 Following PhD student @MIT • Research on Generative Models and Geometric Deep Learning for Biophysics • BA @CambridgeUni • Former @TwitterResearch, @DEShawGroup and @IBM
Ronen Eldan @EldanRonen
2K Followers 115 Following Previously doing maths at @WeizmannScience, currently AI researcher at @MSFTResearch. Pretty good at loading a dishwasher.
Kasper Green Larsen @kasperglarsen
1K Followers 234 Following Professor and Head of Algorithms, Data Structures and Foundations of Machine Learning at Computer Science, Aarhus University
Stefan Neumann @StefanResearch
460 Followers 396 Following Assistant professor @tu_wien. Previously @KTHuniversity, @univienna. Interested in social network analysis & graph algorithms. Connecting theory 🤝 practice.
Matias Altamirano Mon.. @matialtamiranom
142 Followers 398 Following PhD Student Statistical Science @UCL | MSc Applied Mathematics @uchile
Mahdi Haghifam @HaghifamMahdi
863 Followers 637 Following Researcher in ML and Privacy. Distinguished Postdoc at @KhouryCollege. PhD @UofT & @VectorInst. Prev. Research Intern @GoogleDeepMind,@ServiceNowRSRCH
Jonathan Ullman @thejonullman
2K Followers 233 Following Associate Professor of Computer Science @KhouryCollege @Northeastern. Probably an impostor. Still questioning his decision to join Twitter.
Joaquin Cavieres @jcavieresg
239 Followers 697 Following Postdoctoral researcher: Chair of Spatial Data Science and Statistical Learning, Universität Göttingen, Germany.
Vincent Goodwill @VinceGoodwill
47K Followers 2K Following Host of the “Good Word” podcast on Yahoo Sports’ Ball Don’t Lie channel; NBA writer @YahooSports; host, @SiriusXMNBA
Gordo Byrn @feelthebyrn1
16K Followers 947 Following Ultraman Hawaii Champion │ Building SuperVet Fitness. Tweets about endurance training and high-performance habits
SueYeon Chung @s_y_chung
5K Followers 1K Following Assistant Professor @NYU_CNS & @FlatironCCN. Computational Neuroscience, Neural Network Theory, Neural Manifolds, Statistical Physics of Learning
Samir Bhatt @ProfSamirBhatt
2K Followers 506 Following Professor of Machine Learning, Statistics, and Public Health University of Copenhagen • Imperial College London • https://t.co/5QAD76GdDT
Dr. Frank Leon Robert.. @DrFrankRoberts
21K Followers 2K Following English Professor at Amherst College. Exec. Director of The Baldwin Hansberry Project. Co-Host of the Apple Podcast "Finding James Baldwin: The Magpie Years."
Elias Jarlebring @ejarlebring
459 Followers 295 Following Prof. in Appl. Mathematics. Science enthusiast based in Europe. Tweeting about science, mathematical elegance, nerdy stuff and numerical linear algebra.
Jonas Latz @latzplacian
802 Followers 545 Following Intrigued by inverse problems & uncertainties. Lecturer in Applied Mathematics @OfficialUoM (views are my own; he/him) | also: #analogphotography
Franck Iutzeler @FranckIutzeler
515 Followers 273 Following Prof. @UT3PaulSabatier @Univ_Toulouse Applied Maths, Optimization, Machine Learning & Trail Running!
Michael P.H. Stumpf @theosysbio
4K Followers 613 Following Life Scientist & Mathematician. I use mathematics, inference, and systems biology to study cell fate decision making. IncreasingIy: @[email protected]
Isabella Deutsch @BayesianBella
508 Followers 630 Following Looking for data-focused opportunities. PhD Student in Statistics @EdinburghUni, previously @UniofOxford and @univienna.
Alexandre Andorra @alex_andorra
4K Followers 1K Following Cofounder @pymc_labs 📊 Creator of @LearnBayesStats podcast 🎙️ Stats Online Courses @IntuitiveBayes 👨🏫 @pymc_devs & @arviz_devs 👨💻
Josh Alman @firebat03
1K Followers 483 Following Theoretical Computer Scientist at Columbia. Formerly at Harvard, MIT and Stanford.
des_linden @des_linden
107K Followers 464 Following 201∞ Boston Marathon Champion. 2xUS Olympian. Coffee aficionado @coffeebylt. Whiskey connoisseur. Music junkie. Book nerd. Travel enthusiast.@PierreNyq I actually miss Brown quite a bit. A bit weird because I spent much less time there than what I should have spent -- I was mostly commuting to Cambridge -- although I lived in Providence.
As most of us wait for the @icmlconf decisions on our papers submissions: no matter whether our papers get accepted or not, there's tons of exciting research ahead :-)
This will hit arxiv tomorrow night, but you can get the pdf right now: maxim.ece.illinois.edu/pubs/variation…
Just had my boomer breakfast at Hartford Airport Dunkin’: old fashioned donut, small black coffee. AMA.
book-in-progress, >500 pages (!): www-labs.iro.umontreal.ca/~lecuyer/ift65… 'Stochastic Simulation and Monte Carlo Methods' - Pierre L’Ecuyer
I’ll be speaking at this thing later this week: yalefds.swoogo.com/infotheory
Congratulations Alison Etheridge of @UniofOxford, newly inducted NAS international member! #NAS161 #NASmember #mathematics
fun: youtu.be/Nw0z-diiVh4?si… 'Randomized algorithms for linear algebraic computations' - Per-Gunnar Martinsson
RIP Daniel Dennett, my first contact with a great living philosopher during freshman yr at Tufts, & the source of endless late night conversations about brains in vats. Dennett was a brilliant philosopher of mind, an engaging public intellectual, & such a fucking great writer ❤️
nice! arxiv.org/abs/2404.08792 'Convergence of coordinate ascent variational inference for log-concave measures via optimal transport' - Manuel Arnese, Daniel Lacker
@PierreAlquier Thank you Pierre! I am glad you are enjoying it. There are some results and reflections that are not published. And the aim was to be pedagogical :). I will write more about it after I defend the thesis on April 23rd :).
Made it on time for Chang-Han Rhee's talk. Adding truncated heavy-tailed noise to sgd helps!
On my way to the Alan Turing institute in London for a one-month program on heavy tails in machine learning. We do not only need good algorithms for heavy-tailed data but also need to understand how the algorithms sometimes cause heavy-tailed behavior!
On my way to the Alan Turing institute in London for a one-month program on heavy tails in machine learning. We do not only need good algorithms for heavy-tailed data but also need to understand how the algorithms sometimes cause heavy-tailed behavior!
@jasondeanlee But then you lose it WITH a diagram! 🤪 hahaha. But I think the habit of representing NNs like that came from both the original neuro motivation, and also because the diagrams were used while writing gradients. Plus without one, it's really hard to grasp the local error stuff.
For some friendly pushback, and there was a comment below as well. You do need diagrams like this if you need to derive backprop manually without losing your marbles. The updates are written using individual neurons, and you will easily lose track without shubhendu-trivedi.org/files/CMSC-DLc…
speculation, but my sense is that compared to a few years ago, people are more sympathetic to the view that these diagrams are not particularly useful / do not particularly emphasise the salient features of the models in question. if accurate, i think that this is probably good.
My recollection is that if one digs down through a few references, one finds that the passage from the left image to the right image is at least partially facilitated by the use of parallel tempering methods to sample more efficiently.
here's M87 supermassive black hole imaged in 2019 vs. imaged in 2023 with the same data and you think your model is slow to converge
Generalization Bounds: Perspectives from Information Theory and PAC-Bayes ift.tt/uK3aiSQ
Trends for United States
You might like
