Nuit Blanche: A Technical Blog @NuitBlog
Defeating the curse of dimensionality one algorithm at a time. 7M+ pageviews so far..Also the Advanced Matrix Factorization Jungle page https://t.co/dpQgesm8SY nuit-blanche.blogspot.com Paris, France Joined April 2019-
Tweets1K
-
Followers400
-
Following209
-
Likes2K
It was not just a signal processing course. It was the compressive Sensing chapter!
It was not just a signal processing course. It was the compressive Sensing chapter!
It is with great sadness that the Simons Foundation announces the death of its co-founder and chair emeritus, James Harris Simons. Jim was an award-winning mathematician, a legendary investor and a generous philanthropist. simonsfoundation.org/2024/05/10/sim…
Thrilled to share the recording from my Simons Foundation Presidential lecture given last Wednesday. What else than: Statistical Physics of Machine Learning :). youtu.be/TLHYwbrhGJc?si…
📢 Our new work LESS leverages the observation that pretrained LLMs Attention has intrinsically sparse+lowrank structure. ☝️So at inference time, we can decompose KV Cache into constant sparse and RNN states (because lowrank attention is RNN). This also explains why the recent…
📢 Our new work LESS leverages the observation that pretrained LLMs Attention has intrinsically sparse+lowrank structure. ☝️So at inference time, we can decompose KV Cache into constant sparse and RNN states (because lowrank attention is RNN). This also explains why the recent…
L1 regularization for sparse solutions - as usually taught - is actually terrible in practice! I’m always surprised how few people know this. To get good results, retrain with the sparsity pattern found from the initial L1 run, but without the regularizer. Works much better.
L1 regularization for sparse solutions - as usually taught - is actually terrible in practice! I’m always surprised how few people know this. To get good results, retrain with the sparsity pattern found from the initial L1 run, but without the regularizer. Works much better.
Any papers in compressive Sensing?
🎉@LightOnIO introduces Mambaoutai 1.6B: A game-changer in AI! With the novel WSD learning rate scheduler & positional weighting, it sets new standards for efficiency & accuracy. Dive into the future of #AI_Language_Models with our latest blogpost➡️lighton.ai/fr/blog/blog-4…
Widgerson: Turing
People seem to think that Abe Wald's study on survivorship of WW2 planes amount to "shielding where there aren't holes". Zooming out from the question asked of him: the really efficient shielding was a slew of accompanying P51s. #MastersoftheAir
Tao: Fields medal Donoho: Gauss prize Candès: MacArthur Genius Parisi: Nobel prize Talagrand: Abel prize Who am I missing?
Tao: Fields medal Donoho: Gauss prize Candès: MacArthur Genius Parisi: Nobel prize Talagrand: Abel prize Who am I missing?
Michel Talagrand has been awarded the Abel Prize, one of the highest honors in mathematics, for applying tools from high-dimensional geometry to complex probability problems. @jordanacep reports: quantamagazine.org/michel-talagra…
It used to be similar in Compressive Sensing with Nuit Blanche. I was really uneasy about it sometimes.
It used to be similar in Compressive Sensing with Nuit Blanche. I was really uneasy about it sometimes.
Nick Higham's blog was a gold mine nhigham.com
Nick Higham's blog was a gold mine nhigham.com
Come as you are! lighton.ai/jobs
Come as you are! We have 🚀8 job openings 🚀 at @LightOnIO across various teams, technical and business. Join us into making Enterprise LLMs the only thing! Full remote OK for tech positions. lighton.ai/en/jobs
We are excited as well! The meetup link is here: meetup.com/lighton-meetup…
We are excited as well! The meetup link is here: meetup.com/lighton-meetup…
Come and join the discussion on long sequence generation of #LLMs (10am EDT). I'll talk about recent work on efficient LLM inference, e.g., H2O, StreamingLLM, Dejavu, from different perspectives: 1) Efficiency: reduce KVCache & weight IOs bottleneck 2) New ability: interesting…
Come and join the discussion on long sequence generation of #LLMs (10am EDT). I'll talk about recent work on efficient LLM inference, e.g., H2O, StreamingLLM, Dejavu, from different perspectives: 1) Efficiency: reduce KVCache & weight IOs bottleneck 2) New ability: interesting…
Dictionary learning works! Using a "sparse autoencoder", we can extract features that represent purer concepts than neurons do. For example, turning ~500 neurons into ~4000 features uncovers things like DNA sequences, HTTP requests, and legal text. 📄transformer-circuits.pub/2023/monoseman…
A day after David Donoho explains the acceleration of AI, the folks at @AnthropicAI come up with work showing that LLM encode knowledge in a compressive fashion. arxiv.org/abs/2310.00865
A day after David Donoho explains the acceleration of AI, the folks at @AnthropicAI come up with work showing that LLM encode knowledge in a compressive fashion. arxiv.org/abs/2310.00865 https://t.co/CpzBpLWpAs

Ulugbek S. Kamilov @ukmlv
4K Followers 2K Following Donald L. Snyder Associate Prof of EE/CS at WashU. Ex ENS Paris, Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.
Gabriel Peyré @gabrielpeyre
101K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Computational Imaging... @washucig
1K Followers 157 Following Computational Imaging Group (CIG) at WashU. Computational Imaging, Biomedical Imaging, Optimization, and AI. Director @ukmlv.
Vivek Goyal @ProfessorGoyal
771 Followers 195 Following
Laurent Daudet @Laurent_Daudet
1K Followers 1K Following Prof @univ_paris_cite. Co-founder at https://t.co/7tBdXi7xiV. Co-author of Dream Machine graphic novel on AI. PP by @WorldOfHalahala
Michael Bronstein @mmbronstein
54K Followers 7K Following #DeepMind Professor of #AI @UniofOxford / Director #AITHYRA / Chief Scientist @vant_ai / https://t.co/kZpGpDzYeV (opinions are mine) 🤖🧪🧬🎶🐎
Laurent Duval (resear... @laurentduval
909 Followers 517 Following Terrible puns #datascience #machinelearning #science #radio #music #anagram @laurentduval.bsky.social @[email protected] Opinions are nine
sylvain Gigan @sylvaingigan
5K Followers 2K Following Prof. @ScienceSorbonne | PI @comedialkb @lkb_lab @ENSParis - account currently not in use.
Mario Figueiredo @mariotelfig
2K Followers 467 Following Distinguished Prof of ECE and Feedzai Prof of machine learning @istecnico, @itnewspt Professor, photographer, music lover, curious about almost everything.
𝗔𝘆𝘂𝘀𝗵 @AB2World
621 Followers 366 Following @MIT Alum • EEE Faculty, Imperial College London @imperialeee. Current work: •- Inverse Problems •- Unconventional Sensing/Imaging. (Not so regular on twitter)
Simone Scardapane @s_scardapane
12K Followers 656 Following I fall in love with a new #machinelearning topic every month 🙄 | Researcher @SapienzaRoma | Author: Alice in a diff wonderland https://t.co/A2rr19d3Nl
Delip Rao e/σ @deliprao
62K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Low-rank Jack (go mat... @jacquesdurden
557 Followers 369 Following Follow me on Mastodon: @[email protected] (link below) I do not post anything anymore here. Just exit the faXist network.
Waheed U. Bajwa @SigProcessing
1K Followers 1K Following Professor @RutgersNB | Director @RutgersECE INSPIRE Lab | Student of #SignalProcessing, #MachineLearning, and #Statistics | 🇵🇰🇺🇸 | Img: SCholewiak (flickr)
Brian Spears @bkspears9
1K Followers 1K Following Physicist | applied mathematician | (secretly mechanical engineer). Machine learning for inertial confinement fusion and more @Livermore_Lab.
Alex Dimakis @AlexGDimakis
21K Followers 2K Following Professor, UC berkeley | Founder @bespokelabsai |
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
Lei Tian @LeiTian14
2K Followers 4K Following Assoc. Prof. @BU_ece. Ex. MIT, UC Berkeley, Tsinghua U. working on computational imaging.
Complex Media Optics ... @comedialkb
2K Followers 317 Following *Now on bluesky* we are the "Complex Media Optics" team of @lkb_lab -Principal Investigators @sylvaingigan @DeAguiar_ENS .
Yuriy Dzyuba @dzyuba_yuriy
2 Followers 155 Following
Digant Solanki @digantsolanki1
46 Followers 833 Following Editor and Founder The Economist Next Door Student At BITS Pilani
Tao Yao @taoyao2005
13 Followers 230 Following
jimcaptain @d_kapetanios
166 Followers 8K Following
Nikolay Dandanov @NDandanov
7 Followers 263 Following
Gupteswar Kousholya (... @kousolya
80 Followers 878 Following Argus News Reporter Bissamcuttack Dist (Rayagada)
Aleksandar @abukva
88 Followers 240 Following
Guillaume Chossière @gChossiere
42 Followers 3K Following
Shahin @SKhobahi
124 Followers 1K Following
Guillaume "Vermeille"... @Vermeille_
306 Followers 368 Following vi/vim. AI must be really open: research & weight. Deep Learning & Vision PhD. LLM R&D @ LightOn. Libertarien. #JeSuisNicolas
OptYu @OptYu_HENU
0 Followers 50 Following
Matthias Schöning @Schoemat92
143 Followers 2K Following artist painting and design musician Intensive Care Unit Nurse food technologist butcher master sportsman
Chaurasiya @Chaurasiya5
1 Followers 722 Following
Michael Evans @TeamTock
540 Followers 2K Following TOCK Analytics (my math project and totally awesome vaporware company that has fun). Exploring the world of applied category theory. Proven critical systems.
Federica @fgerace_
44 Followers 67 Following
eclectic leaps @eclecticleaps
47 Followers 732 Following Eclectic interests including AI, media and complex systems. Making a splash is our purest form.
Matt S @TheOneMattS
7 Followers 120 Following
conan kinde @ConanKinde
0 Followers 4K Following
Tom Hebbron @tomhebbron
117 Followers 2K Following
Observer @onlyStarGazer
9 Followers 598 Following
Krzakala Florent @KrzakalaF
3K Followers 386 Following I like Physics, Statistics, Machine learning, Computer Science & above all playing 🎸. Happy dad 👧 👧. Also professor @ EPFL. Views are my own.
Muzaffer Kal @🏡 �... @MuzafferKal_
2K Followers 6K Following Chips: ASIC, FPGA. CV/ML. Duck pictures by the lake. Some bread making.
Andrew Ashworth @fluxatron
8 Followers 21 Following
John McGarry @eJohnMcg
444 Followers 149 Following I don’t have a point of view; know not where I’m going to.
Aaron Hardin @aihardin
363 Followers 1K Following a tangled bank of biology, computers, and star wars
Grey @nashaez78497
207 Followers 5K Following See the world on the road, and get to know yourself on the way!
Nullius in Verba @TrustNoClaims
16 Followers 235 Following
Minh Khôi @_minhkhoi
21 Followers 243 Following Graduated CS student, focusing on System and Machine Learning
Murat emre Erkoç @meerkoc
0 Followers 44 Following
Nguyễn Nhật Minh ... @_minhkhoi_
7 Followers 113 Following
Testish @Testish452224
2 Followers 92 Following
Jiaming Liu @Jiaming__Liu
289 Followers 841 Following PhD in EE,computational imaging group (CIG)@wustlcig , Washington University in St.Louis (WUSTL).
Vicente Parot @VicenteParot
574 Followers 1K Following Electro-biophysical-medical engineer-scientist and neuro-technologist at https://t.co/23UeYlV4XW
Ilan Fridman Rojas @irfnali1
485 Followers 4K Following Data Scientist. Former Theoretical physicist.
Dave Kammeyer @davekammeyer
3K Followers 1K Following CEO @ https://t.co/JcJkseseWg Computer Vision, Machine Learning for High Reliability Systems
Tan Minh Nguyen @TanNguyen689
1K Followers 744 Following Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI
Ulugbek S. Kamilov @ukmlv
4K Followers 2K Following Donald L. Snyder Associate Prof of EE/CS at WashU. Ex ENS Paris, Google, MERL, Stanford, MIT, CMU, EPFL. Tennis player. I don’t eat animals. Ўзбекча гапираман.
Peyman Milanfar @docmilanfar
94K Followers 500 Following Distinguished Scientist at Google. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.
Gabriel Peyré @gabrielpeyre
101K Followers 453 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.
Yann LeCun @ylecun
956K Followers 765 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Igor Carron @IgorCarron
5K Followers 6K Following CEO https://t.co/b9fz6WvhTx @LightOnIO Paris Machine Learning Meetup (8200+) @ParisMLGroup https://t.co/jY1eeMkqJE (10M+ pageviews) @NuitBlog Rocket Scientist
Clément Canonne (on ... @ccanonne_
37K Followers 65 Following Senior Lecturer @Sydney_Uni. Formerly Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @ccanonne.bsky.social
Lenka Zdeborova @zdeborova
15K Followers 449 Following Professor at EPFL. Une mathémaphysinformaticienne. Passionate mushroom hunter. Tamer of two little dragons.
Ben Recht @beenwrekt
32K Followers 333 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Computational Imaging... @washucig
1K Followers 157 Following Computational Imaging Group (CIG) at WashU. Computational Imaging, Biomedical Imaging, Optimization, and AI. Director @ukmlv.
Yi Ma @YiMaTweets
102K Followers 513 Following Chair Prof. in AI, HKU; Visiting Prof. of EECS, UCB New book on Principles of Intelligence: https://t.co/leZlkURb7j
Vivek Goyal @ProfessorGoyal
771 Followers 195 Following
Laurent Daudet @Laurent_Daudet
1K Followers 1K Following Prof @univ_paris_cite. Co-founder at https://t.co/7tBdXi7xiV. Co-author of Dream Machine graphic novel on AI. PP by @WorldOfHalahala
Kyle Cranmer @KyleCranmer
17K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bsky
Pierre Vandergheynst @trekkinglemon
3K Followers 233 Following Educator, scientist. Dad+++. I dig data and tweet about autism awareness. Opinions my own.
Michael Bronstein @mmbronstein
54K Followers 7K Following #DeepMind Professor of #AI @UniofOxford / Director #AITHYRA / Chief Scientist @vant_ai / https://t.co/kZpGpDzYeV (opinions are mine) 🤖🧪🧬🎶🐎
Dan Roy @roydanroy
57K Followers 2K Following ML / AI researcher. Research Director and Canada CIFAR AI Chair, @VectorInst. Professor, @UofT (Statistics/CS).
Martin Vetterli @MartinVetterli
18K Followers 2K Following President and Professor of Engineering at @EPFL. My account is not active anymore, follow me on LinkedIn. Why? https://t.co/jsfKMNy4kL
Shubhendu Trivedi @_onionesque
9K Followers 895 Following Cultivated Abandon. Twitter interests: Machine learning research, applied mathematics, mathematical miscellany, ML for physics/chemistry, books.
Laurent Duval (resear... @laurentduval
909 Followers 517 Following Terrible puns #datascience #machinelearning #science #radio #music #anagram @laurentduval.bsky.social @[email protected] Opinions are nine
sylvain Gigan @sylvaingigan
5K Followers 2K Following Prof. @ScienceSorbonne | PI @comedialkb @lkb_lab @ENSParis - account currently not in use.
Federica @fgerace_
44 Followers 67 Following
Minh Khôi @_minhkhoi
21 Followers 243 Following Graduated CS student, focusing on System and Machine Learning
IEEE Trans. on Comput... @IEEE_TCI
625 Followers 271 Following Official account for the IEEE Trans. on Computational Imaging journal. Check out our spotlight talks: https://t.co/K2swm1kowl
Stanley H. Chan @stanley_h_chan
7K Followers 134 Following Professor | computational imaging | machine learning | Purdue ECE
Hilton B. de Aguiar @deAguiar_ENS
637 Followers 459 Following shooting lasers on milk and brain, all controlled by computers. currently @Lab Kastler-Brossel, ENS/Paris. thoughts r from hilton, not Paris. PI @comedialkb
Zhaoran Wang @zhaoran_wang
4K Followers 1K Following Associate Professor @NorthwesternU | PhD @Princeton | studying Reinforcement Learning
Jason Lee @jasondeanlee
18K Followers 4K Following Associate Professor at UC Berkeley. Former Research Scientist at Google DeepMind. ML/AI Researcher working on foundations of LLMs and deep learning.
Qi Lei @Qi_Lei_
4K Followers 1K Following Assistant professor in Math and Data Science, NYU, Postdoc at Princeton ECE, PhD from UT Austin, interested in machine learning, deep learning and optimization
Tom Goldstein @tomgoldsteincs
27K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.
Jia-Jie Zhu (hiring) @__jzhu__
804 Followers 452 Following Head of research group in optimization / machine learning at Weierstrass Berlin. Former postdoc in machine learning @MPI_IS Tübingen, PhD in optimization @UF.
Yoann Altmann @YoannAltmann
317 Followers 399 Following Professor at Heriot-Watt University, Computational Imaging & Bayesian inference. He/his
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Jiaming Liu @Jiaming__Liu
289 Followers 841 Following PhD in EE,computational imaging group (CIG)@wustlcig , Washington University in St.Louis (WUSTL).
Volkan Cevher @CevherLIONS
3K Followers 655 Following Associate Professor of Electrical Engineering, EPFL. Amazon Scholar (AGI Foundations). IEEE Fellow. ELLIS Fellow.
Ilan Fridman Rojas @irfnali1
485 Followers 4K Following Data Scientist. Former Theoretical physicist.
Tan Minh Nguyen @TanNguyen689
1K Followers 744 Following Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI
Ernest Ryu @ErnestRyu
6K Followers 350 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Robert Pless @rbpless
992 Followers 794 Following Professor at GWU, Developer of @traffickcam and @projectRephoto, mercenary interest in glitter and contemporary art. BlueSky: @pless.bsky.social
typedfemale @typedfemale
39K Followers 536 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
ISCS @ISCompSensing
119 Followers 88 Following The 2025 International Symposium on Computational Sensing (ISCS) will take place in Luxembourg in June 2-6 2025.
Sai Prasanna @prassu_gvb
13 Followers 105 Following
Sam Buchanan @_sdbuchanan
1K Followers 1K Following Postdoc @Berkeley_EECS, previously @TTIC_Connect, PhD @EE_ColumbiaSEAS. Representation learning, theory and practice
Kayhan Batmanghelich @kbatmang
705 Followers 863 Following Assistant Prof Boston University, ECE interested ML in healthcare in general for real world application
Princeton SML @PrincetonSML
976 Followers 173 Following Princeton University Center for Statistics and Machine Learning
Priyanka Nanayakkara @priyakalot
438 Followers 437 Following Postdoc at Harvard CRCS | privacy & visualization https://t.co/LavRZKZXbH
Sayash Kapoor @sayashk
10K Followers 2K Following CS PhD candidate @PrincetonCITP. I tweet about AI agents, AI evals, AI for science. AI as Normal Technology: https://t.co/5amOkqKDf2 Book: https://t.co/DabpkhNrcM
Momin M. Malik @MominMMalik
518 Followers 187 Following Data Science Postdoctoral Fellow @BKCHarvard. Critical data analysis, social statistics, network models.
Michael Lones @michael_lones
149 Followers 100 Following A mutualistic collection of cells. Also a @HeriotWattUni academic doing research into machine learning, bio-inspired computing and other interesting things.
Marta Serra @m_serra_garcia
2K Followers 768 Following Behavioral economist and associate professor at UCSD Rady School of Management
jake hofman @jakehofman
6K Followers 571 Following senior principal researcher at msr nyc, adjunct professor at columbia
Jessica Hullman @JessicaHullman
8K Followers 808 Following Ginni Rometty Prof @NorthwesternCS | Fellow @IPRatNU | Uncertainty & decisions | Somewhere between theory & practice | Blogger @statmodeling
Gilles Vandewiele @Gillesvdwiele
1K Followers 564 Following Co-founder https://t.co/78QOapXjFT. Kaggle Master. PhD in CS Eng. I like doing stuff with data & algorithms.
Brandon Stewart @b_m_stewart
1K Followers 531 Following Associate Professor of Sociology, Princeton University
Arvind Narayanan @random_walker
124K Followers 497 Following Princeton CS prof. Director @PrincetonCITP. I use X to share my research and commentary on the societal impact of AI. BOOK: AI Snake Oil. Views mine.
Pavel Shtykovskiy @framrus
93 Followers 1K Following Particle physics and astrophysics -» predicting ad clicks at Yandex -» spoken language understanding -» LLM-powered NPCs at https://t.co/A3vXLHYYGN
Nina Jelїazkova @10705013
365 Followers 2K Following "civilization advances by extending the number of operations we can perform without thinking about them" 🐙
Bruno Loureiro @_brloureiro
586 Followers 632 Following Researcher at @ENS_ULM working on the crossroads between machine learning and statistical physics.
Aufinal @Aufinal
89 Followers 293 Following Assistant Professor in statistics @Ensai35, social-democrat, esports addict
Christian Szegedy @ChrSzegedy
42K Followers 3K Following #deeplearning, #ai research scientist. Opinions are mine.
Yaroslav Bulatov @yaroslavvb
8K Followers 930 Following [email protected] (ex-Google Brain, OpenAI, Meta) New Blog: https://t.co/SLix8Hrt4w Old Blog: https://t.co/Ur3GWKpmp6
Dongdong Chen @ddongchen
162 Followers 170 Following Assistant Professor @HeriotWattUni, Edinburgh. I like machine learning and imaging inverse problems.
Michael P. Sheehan @mpsheehan1995
49 Followers 139 Following PhD student researching Statistical and Compressive Learning at the University of Edinburgh.
Philippe Ciuciu @Philippe_Ciuciu
738 Followers 649 Following Director of Research @Neurospin (CEA) & Inria MIND in neuroimaging & neuroscience. CS-MRI, scale-free brain dynamics (MEG and fMRI).
Arthur Mensch @arthurmensch
54K Followers 860 Following Co-founder and CEO @MistralAI. Talk to le Chat https://t.co/ZMZG8rAlWz https://t.co/ydSK6xG4Ce https://t.co/b1uf0UK5U8