Lenka Zdeborova @zdeborova
Professor at EPFL. Une mathémaphysinformaticienne. Passionate mushroom hunter. Tamer of two little dragons. Switzerland Joined October 2012-
Tweets1K
-
Followers13K
-
Following420
-
Likes4K
Presidential Lecture 5/1: Lenka Zdeborová (@zdeborova) on "Statistical Physics of Machine Learning." NYC, 6pm. Free to attend but registration is required: simonsfoundation.org/event/statisti…
Starting tomorrow: If you are around MIT join for the Simons Lectures Series 2024 math.mit.edu
Dynamical phase transitions in graph cellular automata, Freya Behrens, Barbora Hudcová, and Lenka Zdeborová #Networks #ComplexSystems #PhaseTransitions @zdeborova @EPFL_en go.aps.org/4b1DoHu
Talking to many junior faculty members and students in AI lately. Many seem to be somewhat lost with all the seemingly fast progresses made by the industry. My suggestion to them is: It is industry's job to find how to do better, but academia is to find out how to do it right.
Doesn’t everyone feel like that? Those who do not either don’t care about AI or fake it.
Doesn’t everyone feel like that? Those who do not either don’t care about AI or fake it.
Dear Twitter, there was recently a paper showing that different diffusion models generate very similar images when starting with the same initial noise. I did not note the reference. Somebody, please, has it?
Hello Twitter, were the accepted ICML 2024 workshops announced already?
Almost everyone confuses knowledge with intelligence. There’s fundamental difference between absorbing existing knowledge and discovering new one, like the difference between a student and a scientist. That is the reason why existing AI systems require good data to begin with.
My favorite quote by Talagrand reflects well discussions between physicists & probabilists: "When asked why this is the case, @marc_mezard answered: But what else could happen? The more I think about this argument, the more I find it convincing. Yet, it is not fully mathematical"
My favorite quote by Talagrand reflects well discussions between physicists & probabilists: "When asked why this is the case, @marc_mezard answered: But what else could happen? The more I think about this argument, the more I find it convincing. Yet, it is not fully mathematical"
Zdeborová will also participate in a @CornellCIS AI Lunchtime Seminar, “On Generalization and Uncertainty in Learning with Neural Networks,” Friday, March 15 at noon in 122 Gates Hall, with Zoom available in 700 Clark Hall.
This week, I am visiting Cornell. Honoured to give the Bethe lecture series physics.cornell.edu/bethe-lectures. This gave me an occasion to revisit the influence one of Bethe's papers had on how I view the interaction between physics and computer science. A sneak-peak below.
Consider a weak low-rank signal added to a random matrix, the components of the sum are observed through a non-linear function. The exact trade-off between the signal strengths and the non-linearity allowing signal recovery is a topic of our new paper arxiv.org/abs/2403.04234
Clément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Frank Nielsen @FrnkNlsn
23K Followers 1K Following Machine Learning & AI, Information Sciences & Information Geometry, Distances & Statistical models, HPC. "Geometry defines the architecture of spaces" @SonyCSLMichael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVKyle Cranmer @KyleCranmer
16K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bskyKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingSam Power @sp_monte_carlo
17K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. (he / him)Amin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6Max Welling @wellingmax
32K Followers 429 FollowingBoaz Barak @boazbaraktcs
17K Followers 419 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsGiuseppe Carleo @gppcarleo
5K Followers 1K Following Associate professor of computational quantum science (@EPFL_en @cqs_lab). ML for quantum; quantum computing; growing the @NetKetOrg.Jason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learningUlugbek S. Kamilov @ukmlv
4K Followers 2K Following Visiting Prof at ENS Paris. Associate Prof of EE/CS at WashU. Ex Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.Peter Richtarik @peter_richtarik
6K Followers 593 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦Krzakala Florent @KrzakalaF
3K Followers 380 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.Aynaz @aynazjavani
0 Followers 239 Followingmoralbots @moralbots
14 Followers 14 FollowingMuqeeth @Muqeeth10
117 Followers 275 Following Interested in research challenges that arise in continual model development. Researcher @MITIBMLab | MS @unccs | RA @iitdelhi | BTech @iitmadrasMatheus Palmero @MathPalmero
76 Followers 517 Following PhD in Physics. Chaos and non-linear dynamical systems. (he/him)Deepesh Singh @Deepesh__Singh
248 Followers 2K Following (Reason/Literature/Music) PhD Candidate in Quantum Computation @ The University of QueenslandRushi @RushiOnFire_
43 Followers 420 Following AI Engineer | ML | Deep Learning Research | NLP | Chess | Cricket | The dream is to meet Geoffrey Hinton, Ian Goodfellow, Yann LeCun, Yoshua BengioLea Duncker @leaduncker
2K Followers 649 Following incoming assistant prof at Columbia neuro theory center starting July 2024. previously at Stanford and Gatsby Unit. she/herHimbo Mathématique @lhmccabe
462 Followers 1K Following cs phd student | data scientist | likes, follows, etc. not representative of personal viewsIvan Bulygin @blufzzz
17 Followers 141 Followingwavesingularity @37373727722747d
17 Followers 139 FollowingSailesh Kumar @saileshtalks
2K Followers 4K Following Design industry leading semiconductor solutions and help advance the industry. CEO at @bayasystems. ex- Intel Fellow and Founder at NetSpeed Systems.Pamavoc @pamavoc__
356 Followers 4K Following developer & designer @gobelins_paris web, 3D and unreal enthusiast.Krystof Mitka @krystof_mitka
121 Followers 510 Following Currently completing undergraduate double degree in Applied Mathematics and Computer Science in 🇳🇱Sathish Kasilingam @sathishisak
167 Followers 2K Following Interests lie in manufacturing, software, quality, CNC Machine analytics, Data analytics, product management and startupsHonam Wong @MH2023ML
128 Followers 472 Following Junior Undergrad @HKUST🇭🇰 | Spring Exchange @EPFL_en🇨🇭 | Deep Learning Theoryxzx217 @SwitchXzx
7 Followers 242 FollowingNandi @NandiSchoots
47 Followers 132 Following PhD student in AI studying the science of deep learning.Julia Kempe @KempeLab
4 Followers 17 Following Silver Professor at NYU Courant and CDS, Visiting Prof. ENS Paris, Visiting Senior Researcher at FAIR Research in Machine Learning, past in Quantum ComputingAmit_kumar @Dasein_amit
305 Followers 3K Following |Neuroscience @Phd_PMRF.|Philosophy @MA|Psychology @MA.|Biomedical @MTech|Electrical @BTech|Working @cognitivestress,@meditation,@emotion,@morality| NGO @TSF|Lucia Domenichelli @workerplacemint
6 Followers 124 Following Research fellow @italiaNLP_lab(ILC-CNR) All things physics and music :) (and #langtwt)Helbert Paat @hellohelbert
76 Followers 602 Following he/his, MPhil CSE @HKUST, interested in 3D vision, optimization, statistics and theoretical ML.zzzzzzoo00oo @zzzzzzoo00oo
255 Followers 4K Followingkagakusha @scicroq
11 Followers 64 Following Dedicated scientist studying biological science and #RocketPunch 👊Xiaolong Yang @yang_appstats
390 Followers 3K Following AM student of political methodology @HarvardGSAS. 東大教養の人間だった。因果推論。A Little Night Musing @aLilNightMusing
1K Followers 4K Following Phizer Pham Have mask, will travel. Opsimath renegade full of thoughts. Half of what I say is meaningless. Obidox Jew, Lives in the wildnorth. she/her.Robert @bertran_yorro
186 Followers 102 Following Posts about machine learning, physics, blockchain. Currently R&D at @eigenlayerJerry Chen @jerchenn
36 Followers 353 Following Post-doc & PhD @Cambridge_Uni @QueensCam. Working on spatial economics, causal inference & machine learning. 🪩🤖Tahmas @Tahmas82099299
21 Followers 196 FollowingMpaba_Lenka @Mpaba_ML
1 Followers 25 FollowingI @bebefrenica
525 Followers 5K Followingun homme @Bk_bnm
2 Followers 32 Followinglyftium.eth @lyftium
764 Followers 5K Following Explorer l’inconnu et pousser les limites de l’impossible. e/acc. ResearcherSamyak Jha @leaveitinthesun
1 Followers 128 Followingxenjoyer007 @xenjoyer007
1 Followers 132 FollowingGuneet Singh Kohli @guneetsk99
455 Followers 3K Following AI Engineer @ GreyOrange, Building Indian LLMs with Odia GenAI Independent Researcher working on variety of random problems.Factorial Biomechanic.. @Biomechanics_
388 Followers 3K Following Making Biomechanical Analytics Accessible for a Healthier WorldHadi Zadeh-Haghighi @hadizadehagh
7 Followers 133 Following Quantum, Quantum Biology, Quantum Chemistry, Quantum Computing, Neuroscience, AIProgrammatic 101 @101Programmatic
2K Followers 5K Following Exploring the world of #programmatic advertising and #adtechClément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Dan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVKyle Cranmer @KyleCranmer
16K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bskyBen Recht @beenwrekt
26K Followers 365 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.Behnam Neyshabur @bneyshabur
18K Followers 690 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingAmin Karbasi @aminkarbasi
8K Followers 2K Following Associate Professor at Yale University, staff research scientist at Google.Maxim Raginsky @mraginsky
8K Followers 2K Following father, academic, raconteur, aging wannabe hipster blog: https://t.co/akk6LCvKw6NeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Max Welling @wellingmax
32K Followers 429 FollowingBoaz Barak @boazbaraktcs
17K Followers 419 Following Computer Scientist. See also https://t.co/EXWR5k634w, https://t.co/SEVX6it6z3 ( @[email protected] , boaz.barak in threads ). Opinions my own.Giuseppe Carleo @gppcarleo
5K Followers 1K Following Associate professor of computational quantum science (@EPFL_en @cqs_lab). ML for quantum; quantum computing; growing the @NetKetOrg.Jason Lee @jasondeanlee
10K Followers 3K Following Associate Professor at Princeton and Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learningUlugbek S. Kamilov @ukmlv
4K Followers 2K Following Visiting Prof at ENS Paris. Associate Prof of EE/CS at WashU. Ex Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.Peter Richtarik @peter_richtarik
6K Followers 593 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦Krzakala Florent @KrzakalaF
3K Followers 380 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.Taco Cohen @TacoCohen
21K Followers 3K Following Deep learner at FAIR. Into codegen, equivariance, generative models. Spent time at Qualcomm, Scyfer (acquired), UvA, Deepmind, OpenAI.Machine Learning: Sci.. @MLSTjournal
9K Followers 10K Following A multidisciplinary, #openaccess journal devoted to the application and development of #machinelearning for the sciences. Published by @IOPPublishing.EPFL_AI_Center @EPFL_AI_Center
274 Followers 56 Following A new hub for artificial intelligence, shaping a future where AI works for everyone through cutting-edge research, education, and industrial collaborations.Fascinating @fasc1nate
3.3M Followers 2K Following Posting interesting science, gadgets, history, art, and more. Subscribe for in-depth posts. As an Amazon Associate I earn from qualifying purchases.Alessandro Ingrosso @ai_ngrosso
571 Followers 1K Following Theoretical neuroscientist and spin glass enthusiast. From @cu_neurotheory to @ictpnews.Blake Bordelon ☕️.. @blake__bordelon
796 Followers 743 Following ML/Neuroscience PhD student at @HarvardSteven Strogatz @stevenstrogatz
157K Followers 3K Following Mathematician, writer, Cornell professor. All cards on the table, face up, all the time.Christopher Manning @chrmanning
126K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Le guide MICHELIN @guideMichelinFR
141K Followers 166 Following Le guide MICHELIN off ! Suivez le quotidien des inspecteurs du guide.Charlotte Bunne @_bunnech
3K Followers 485 Following PostDoc at @Genentech and @Stanford and Incoming Assistant Professor at @EPFL in Computer Science and Life Sciences.Karel Břinda @KarelBrinda
1K Followers 2K Following ‖Permanent Researcher/INRIA Start. Faculty | @INRIA/@IRISA_lab Rennes‖ BioInfo/CompBio: algorithms, genomics, rapid diagnostics, pathogens & antib. resistancePetr Šulc @petr_sulc
1K Followers 1K Following Assistant Professor at ASU and ERC PI at TUM. We use computer simulations and experiments to play with DNA and RNA in biology and nanotechnologyVladka B. Petrakova @PetrakovaVladka
553 Followers 477 Following Excited about plasmons, DNA origami and microscopy. Group leader @JHINST_Prague. @AvHStiftung alumni, @czexpats co-founder, mother of 4.Matouš Glanc @MGlanc
572 Followers 462 Following Husband | Father | Director @czexpats | Cell biologist | @PSB_VIB @ISTAustria @UniKarlova @MSCActions @EMBOFellows alumnus | Opinions my ownMarkéta Tomková @marketa_tomkova
157 Followers 142 Following Group leader in Ludwig Cancer Research, University of Oxford. Wellcome Trust ECA. Mutagenesis, epigenomics, DNA polymerases, and interdisciplinarity enthusiast.Jakub Tomek @JakubTomek13
601 Followers 534 Following Computational and experimental cardiology. Tea lover (mainly sheng puerh). Sir Henry Wellcome Fellow at Oxford and UC Davis. Blog https://t.co/7vNqEgWp1dEster @furt_v__lihu
4K Followers 189 Following Rozhodně ne Elon Musk, raging feminist, sultán ve svém paláci švandyDavid M. Sabatini @DMSabatini
18K Followers 550 Following [email protected] studying rapamycin and mTOR for a long timeIndaco Biazzo @ocadni
223 Followers 809 Following Researcher at EPFL of Lausanne. Neural Networks, statistical physics, epidemics, urban science.Postmodern Jukebox @PMJofficial
51K Followers 285 Following Tickets for 2024 10th Anniversary Spring Tour on sale now! https://t.co/gSEPuWluCxflair_epfl @flair_epfl
210 Followers 5 Following The Foundations of Learning and AI Research (FLAIR) group @ EPFL aims at providing grounded scientific foundations to foster machine learning of tomorrowChristopher D. Long @octonion
22K Followers 7K Following SumerSports - NFL analytics and roster optimization. Ex-San Diego Padres, Detroit Tigers, Houston Rockets. Google Foobar winner. He/him. [email protected]Lavinia Maddaluno @LaviniaMaddalu1
2K Followers 3K Following Postdoc (RTDA) at #Ca'Foscari on ERC #WaterCulturesofItaly. #EarlyModernHist Science/Political Economy; PhD/MPhil @Cambridge_Uni Speaks: 🇮🇹🇬🇧🇵🇹🇫🇷Masayuki Ohzeki@雑.. @mohzeki222
6K Followers 322 Following 東北大学大学院情報科学研究科教授.東京工業大学理学院物理学系教授・株式会社シグマアイ代表取締役.YouTube(https://t.co/UQ8T0slpeb)Stephan Mertens 🔭�.. @snetreM
462 Followers 869 Following If you don't make mistakes, you are not working on hard enough problems. And that's a mistake. -- Frank WilczekJosef Pulkert @JPulkert
16K Followers 366 Following člověk, manžel, táta dvou holčiček, gynekolog, porodník, chronofil, audiofil, volnomyšlenkář a věčný snílek. Pravda a láska. Mé tweety vyjadřují jen mé názory.Deletroz Stephane @Deletroz
38 Followers 101 Following Journaliste à CQFD,#RTScqfd, l'émission sciences et santé de la 1ère, RTSJacob Zavatone-Veth @jzavatoneveth
675 Followers 755 Following Incoming Junior Fellow @Harvard, working on neural computation.Miloslav Šindelář @Milosval1
12K Followers 798 Following 🎓 Institut Moderní Výživy co-founder 📖 Evidence-based writer 🎤 Speaker 🍏 Registered dietitian 💊 Medicine 🧡 Longevity 🎙️IMV podcastDaniel Green @nu_phases
7K Followers 592 Following Associate Professor @UCSanDiego, Cosmologist and Particle TheoristMushtaq Bilal, PhD @MushtaqBilalPhD
228K Followers 34 Following I simplify the process of academic writing | Helped 5,000+ become efficient academic writers with AI | Work @SyddanskUni | Join 600 using https://t.co/SKfrXx2V5qDavid Tse @dntse
4K Followers 144 Following Professor at Stanford University (https://t.co/LJLXu7aKyi, https://t.co/lwU5yWvC6W) Co-founder of BabylonChain (https://t.co/2NDKSh7y3d) Information theorist.Zdenek Hel @HelZdenek
9K Followers 498 Following Professor, Immunology, Virology, University of Alabama at BirminghamDiversité EPFL @EPFLdiversity
671 Followers 656 Following Promeut la diversité & l’égalité des chances sur les campus @EPFL Fosters diversity & equal opportunity on @EPFL_en campuses #ResponsibleTransformationEPFL 💜Yatin Dandi @DandiYatin
249 Followers 2K Following PhD student (EPFL, Switzerland), interested in the theory of deep learning and statistical physics of computationFred Courant @FredCourant
3K Followers 21 Following Co-fondateur et rédacteur en chef de l'@EspritSorcier.Alice Coucke @alicecoucke
1K Followers 931 Following Head of ML research @sonos voice experience (ex @snips) | speech x language x privacy | #PhD in statistical physics from @ENS_ulm | je tweet parfois in FrenchDror Baron @BaronDror
399 Followers 391 Following Professor @ncstateece | ex-{@TechnionLive, @RiceUniversity, @ECEILLINOIS} | research in information theory, quantum computing, & signal processing.LightOn @LightOnIO
3K Followers 815 Following LightOn unlocks business productivity through Paradigm. A turnkey AI platform, using the stunning power of Large Language Models. Newsletter: https://t.co/zsxcFkWnBtEPFL @EPFL_en
60K Followers 1K Following Welcome to the official account of EPFL. Compte en français: @EPFLColin Bernet @thedatafrog
190 Followers 272 Following Co-founder of https://t.co/SLu8YCunOr. Particle physicist @CERN and @CNRS. Creator of https://t.co/bjCRfBCwGLJean-Philippe Vert @jeanphi_vert
1K Followers 53 FollowingGuillaume Obozinski @obozinski
216 Followers 90 Following Deputy Chief Data Scientist at the Swiss Data Science Center since January 2019.Jonathan Mattingly @jcmattingly
726 Followers 658 Following Applied Mathematician, Probabilist, & Stochastic Analysis:SPDEs, Stochastic algorithms, mathematical biology, & gerrymandering. See also: Urbanism, Food, SoccerYves Laszlo @yves_laszlo
157 Followers 143 Following Mathématicien, Prof. IMO Université Paris-SaclayBenjamin Aubin @benjamin_aubin_
202 Followers 144 Following Lead ML research @clipdropapp by @StabilityAI & Ph.D in theoretical physics & @MetaAI & Ecole @PolytechniqueWe don’t address racism by pretending white people can be black, nor is ableism solved by giving able-bodied people wheelchairs, so why are women and girls supposed to applaud their male imitators, centre them in language and hand over rights their foremothers fought for? 3/X
The latest chapter in the saga of using stochastic localization/denoising diffusions to sample from highly multi-modal Gibbs measures. With the amazing Brice Huang and Huy Tuan Pham. (1/4) arxiv.org/abs/2404.15651
Presidential Lecture 5/1: Lenka Zdeborová (@zdeborova) on "Statistical Physics of Machine Learning." NYC, 6pm. Free to attend but registration is required: simonsfoundation.org/event/statisti…
Starting tomorrow: If you are around MIT join for the Simons Lectures Series 2024 math.mit.edu
@avt_im I’m guessing you’ve Not been on a hiring committee.
Very much looking forward to this. The field moves so fast it can be (very) hard to keep up. These great speakers should give us a lively view. Special thanks to @framigna and @Kamesh_Kris who led the organizing effort.
Our next symposium will focus on large language models. Longer talks and plenty of discussion time should help making these exciting developments more accessible! Please join us. No streaming but recorded talks will be posted @ITSCUNY1 .
On my 🛤️way to 🇨🇭 @EPFL_en 🇨🇭in Neuchatel and Lausanne, for two days of discussions,🫕 and 🍫. I will give a seminar tomorrow on our work at @comedialkb on optical imaging (also on zoom, see QR code below). Looking forward!
Dynamical phase transitions in graph cellular automata, Freya Behrens, Barbora Hudcová, and Lenka Zdeborová #Networks #ComplexSystems #PhaseTransitions @zdeborova @EPFL_en go.aps.org/4b1DoHu
So more rigorously speaking, the pretrained deep large models are better called “artificial knowledge” or “artificial memory”.
Once knowing enough the history of science and engineering research, one shouldn't be surprised that how typical almost an entire community of a field can get trapped in a fundamentally limited approach or framework, and yet not self-aware and often self-celebratory.
Talking to many junior faculty members and students in AI lately. Many seem to be somewhat lost with all the seemingly fast progresses made by the industry. My suggestion to them is: It is industry's job to find how to do better, but academia is to find out how to do it right.
I'm happy to share the recording from my Cornell Bethe lecture a few weeks back. It's a broad-public lecture on "Bridging Physics and Computer Science: Understanding Hard Problems." No technical background is needed. Enjoy! cornell.edu/video/lenka-zd…
I gave a talk about the connection between Bayesian inference and stat-mech at @imperialcollege. I mostly followed the review by @zdeborova and @KrzakalaF but talked a little bit about our upcoming work about inferring random walks. Read the notes here: sunwoo-kim.github.io/en/activities/…
🎉@LightOnIO introduces Mambaoutai 1.6B: A game-changer in AI! With the novel WSD learning rate scheduler & positional weighting, it sets new standards for efficiency & accuracy. Dive into the future of #AI_Language_Models with our latest blogpost➡️lighton.ai/fr/blog/blog-4…
Delighted to announce that Scarlet Schwiderski-Grosche will be joining the EPFL AI Center as Executive Director, starting May 1st. Her demonstrated leadership in cultivating collaborations across various sectors, will be invaluable to the Center. Welcome aboard Scarlet!
Dear Twitter, there was recently a paper showing that different diffusion models generate very similar images when starting with the same initial noise. I did not note the reference. Somebody, please, has it?
@zdeborova I guess the initial work that links the encoder map to the optimal transport map is this one: arxiv.org/pdf/2202.07477… which, in turn, explains the observed similarity between different models
@zdeborova Also check Appendix D.5 in the original arxiv.org/pdf/2011.13456…
@zdeborova I remembered reading it in one of the earlier papers, and I finally found it: it's mentioned in arxiv.org/abs/2011.13456 when introducing the probability flow ODE (bottom of page 7 and appendix D.5)
@zdeborova You might be thinking about this one? arxiv.org/abs/2310.05264 (though this phenomenon was known before this paper) See also arxiv.org/abs/2310.02557, where we show that it happens even for diffusion models trained on different samples from the same training distribution