TML Lab (EPFL) @tml_lab
Theory of Machine Learning Lab at @EPFL led by Nicolas Flammarion. We develop algorithmic & theoretical tools to better understand ML & make it more robust. epfl.ch/labs/tml/ Lausanne, Switzerland Joined November 2021-
Tweets30
-
Followers388
-
Following96
-
Likes87
Accepted at NeurIPS 2025 Datasets and Benchmarks Track as a *spotlight*! See you in San Diego :-)
🚨Excited to release OS-Harm! 🚨 The safety of computer use agents has been largely overlooked. We created a new safety benchmark based on OSWorld for measuring 3 broad categories of harm: 1. deliberate user misuse, 2. prompt injections, 3. model misbehavior.
📃 In our new paper, we introduce FuseLIP, an encoder for multimodal embedding. We use early fusion of modalities to train a single transformer on contrastive + masked (multimodal) modeling loss More details👇
📃 In our new paper, we introduce FuseLIP, an encoder for multimodal embedding. We use early fusion of modalities to train a single transformer on contrastive + masked (multimodal) modeling loss More details👇
🚨Don't miss out on my PhD application!🚨 Finally completed all of my PhD applications🎄. I foresee a high level of anxiety while waiting for interviews and decisions. I want to take this opportunity to summarize what I've done and what I hope to accomplish during my PhD. 🧵1/6
🔍 New research from our school demonstrates that even the most recent Large Language Models (LLMs), despite undergoing safety training, remain vulnerable to simple input manipulations that can cause them to behave in unintended or harmful ways. go.epfl.ch/GPk-en
🚨 So, why do we need weight decay in modern deep learning? 🚨 The camera-ready version of our NeurIPS 2024 paper is now on arXiv (a major update compared to the first version). Weight decay is traditionally viewed as a regularization method, but its effect in the overtraining…
Mindblowing: EPFL PhD student @maksym_andr, winner of best CS thesis award, showed that leading #AI models are not robust to even simple adaptive jailbreaking attacks. Indeed, he managed to jailbraik all models with a 100% success rate 🤯 Tonight, after winning the Patrick…
📢 The @EPFL_AI_Center Postdoctoral Fellowships call is now open! 💡Are you a postdoctoral researcher interested in collaborative and interdisciplinary research on #AI topics? ✏️Apply now until 29 November 2024 (17:00 CET). 👉More info: epfl.ch/research/fundi…
🚨Excited to share our new paper!🚨 We reveal a curious generalization gap in the current refusal training approaches: simply reformulating a harmful request in the past tense (e.g., "How to make a Molotov cocktail?" to "How did people make a Molotov cocktail?") is often…
🆕We will present a short version of our adaptive attack paper arxiv.org/abs/2404.02151 at the ICML '24 NextGenAISafety Workshop. See some of you there! 🚨We've also just released the v2 of the paper on arXiv. Main updates: - more models: Llama-3, Phi-3, Nemotron-4-340B (100%…
Super excited to share that I successfully defended my PhD thesis "Understanding Generalization and Robustness in Modern Deep Learning" today 👨🎓 A huge thanks to the thesis examiners @SebastienBubeck, @zicokolter, and @KrzakalaF, jury president Rachid Guerraoui, and, of course,…
Llama-3 is absolutely impressive, but is it more resilient to adaptive jailbreak attacks compared to Llama-2? 🤔 Not much. The same approach as in our recent work arxiv.org/abs/2404.02151 leads to 100% attack success rate. The code and logs of the attack are now available:…
Are you interested in jailbreaking LLMs? Have you ever wished that jailbreaking research was more standardized, reproducible, or transparent? Check out JailbreakBench, an open benchmark and leaderboard for Jailbreak attacks and defenses on LLMs! jailbreakbench.github.io 🧵1/n
Very excited about this: our team led by @fra__31 won the SatML trojan detection competition (method: simple random search + heuristic to reduce the search space) Interestingly, the final score (-33.4) is very close to the score on the real trojans (-37.7) RLHFed into the LLMs!
Very excited about this: our team led by @fra__31 won the SatML trojan detection competition (method: simple random search + heuristic to reduce the search space) Interestingly, the final score (-33.4) is very close to the score on the real trojans (-37.7) RLHFed into the LLMs!
Training dynamics of ReLU networks is back! Many works point out to a mysterious early alignment phase. While this phase has obvious perks for implicit bias, it can also lead to harder optimization and even convergence towards spurious stationary points. Let me explain 🧵
So, what really matters for instruction fine-tuning? Surprisingly, simply fine-tuning on the *longest* examples is an extremely strong baseline for alignment of LLMs. Really excited to share our new work: arxiv.org/abs/2402.04833. Full story below! 🧵1/n
We all know that AGI is coming, BUT adversarial examples are *still* not solved and scale is not all you need! Simple random search using logprobs of GPT-4 reveals that it has quite limited robustness. Short paper: andriushchenko.me/gpt4adv.pdf Code: github.com/max-andr/adver… 🧵1/n
Hi! I am not in Neurips at NO, but very happy to share our poster with you! @pesme_scott either, but if you are interested please talk to @suriyagnskr or Nicolas (@tml_lab) who are present !
@CIS_EPFL is hosting a post NeurIPS event at EPFL: tinyurl.com/4k998abn @EPFL_en @ICepfl @EPFLEngineering
FLAIR is looking for #postdocs in Lausanne, possibly collaborating between the labs. See flair.epfl.ch and apply before Nov 30. The FLAIR group in #EPFL is committed to provide grounded scientific foundations to machine learning & to foster next gen AI models.

Mohammad Ali Banayeea... @alibanayeean
2 Followers 61 Following
Senthil Kumar @SenthilKumarN_
72 Followers 2K Following Aspiring ML Researcher. Interested in Bayesian Machine Learning & RL.
ghost @theamtweeter
0 Followers 78 Following
Bhakti @Bhakti8997925
14 Followers 67 Following
Antonio Honsell @antoniohonsell
0 Followers 33 Following
chipiron @thechipiron
3 Followers 62 Following
IdePHICS lab @idephics
190 Followers 53 Following "Information Learning & Physics" is an academic lab. in EPFL, Switzerland, focusing on computer science, machine learning & statistical physics. PI: @krzakalaF
Atakan Bedel - aka An... @AtakanBedel
162 Followers 676 Following PhD student @Stanford interested in neuroscience, deep learning and cats
Guillaume Corlouer @tkrdan
232 Followers 629 Following AI alignment research, applying information theory and methods from complex systems for interpretability. Previously researcher at https://t.co/vY1DnJ0oIg.
Anay Mehrotra @AnayMehrotra
356 Followers 494 Following PhD Candidate @Yale // Previously @IITKanpur'20 @EPFL'19
Yorgos Pantis @yorgos_pantis
11 Followers 65 Following Ph.D. studies @uoaofficial and @ArchimedesUnit. Ex-research assistant @dtutweet, @athenaRICinfo, @studyatctu, @mpiMathSci. Ex-studies @UniofOxford, @upatras.
Aryo Lotfi @aryolotfi
63 Followers 212 Following PhD @ EPFL | ML researcher focusing on reasoning | ex-Apple intern
_ @_zalizali_
38 Followers 552 Following
zhaoyu zhu @Zhaoyu_Zhu_
0 Followers 352 Following
Klee @xiaonando
6 Followers 742 Following
Yoram Bachrach @yorambac
3K Followers 7K Following Research Scientist at Meta (prev Google DeepMind and Microsoft Research). Working on LLM Agents and Multi-Agent Systems.
Haoxuan (Steve) Chen @haoxuan_steve_c
967 Followers 3K Following Ph.D. in ICME @Stanford; B.S. @Caltech; ML Intern @AmazonScience @NECLabsAmerica; Applied & Computational Math/Machine Learning/Statistics/Scientific Computing
Nicolas Zucchet @NicolasZucchet
539 Followers 387 Following PhD student @CSatETH prev. student researcher @GoogleDeepMind | @Polytechnique
Ayaan @Reser123456789
10 Followers 454 Following
Leonardo Cázares @Leo_CazaresT
33 Followers 391 Following Data Science 📊 and Physics student 🔭 at UNAM. Affiliate Member at MIGHTE. Cycling 🚲. Nunca he fallado un penal.
Giorgia Ramponi @gio_ramponi
4K Followers 285 Following Ass. Prof. @UZH_en @uzh_ifi, PI @ ALPILab 🌼 Working on RL, multi-agent, imitation learning, and other sequential decision-making stuff @gioramponi.bsky.social
opee wise @OpeeWise
57 Followers 326 Following I don't even feel special When a girl Likes me anymore 😅,you Girls like Everybody 👿😤
武藤扬志 @JACKZJGJ
30 Followers 3K Following
Mehmet Vecdi Gonul @legndskygamer
36 Followers 660 Following chemAI @ Artificial Organic Chemistry Lab, University of Groningen - i code stuff, sometimes
elhoussaine chahboun @elhoussainechah
8 Followers 201 Following Pure Maths, Computer Graphics and Motion Design
Mark Rofin @ ICML @broccolitwit
96 Followers 261 Following Research assistant at https://t.co/YkJnuIppPm & NLP student at @LstSaar
Alessandro Soccol @alessandrosocc2
6 Followers 168 Following
Blaise Delattre @bldelattre
12 Followers 122 Following
سعدی روشنای... @wolfofroshanaei
193 Followers 2K Following
rpl @3rp3l
69 Followers 537 Following
alina @0296Alina2306
16 Followers 804 Following
AISecHub @AISecHub
3K Followers 4K Following 🚀 AISecHub | AI & Cybersecurity | Discussing AI-driven threats, securing AI systems, and sharing insights on emerging challenges 💡
Giovanni Lucarelli @_giolucarelli
3 Followers 157 Following
adhelper adhelper @GoogleMksMeBtr
0 Followers 31 Following
Meskerem A. Kebede @AyalMeskeremAk
1K Followers 2K Following MD👩🏾⚕️ GP|@LSEHealthpolicy @LSHTM @AddisAbabaUnive alum |Research Officer Global Surgical Econ& Policy| Academic Editor @PLOSDigiHealth |☕️ |
Ofir Lindenbaum @Ofirlin
1K Followers 2K Following Assistant professor at Bar Ilan University. Primary research is Machine learning, computational biology, and signal processing.
Ludwig Schmidt @lschmidt3
6K Followers 424 Following Assistant professor at @Stanford and member of the technical staff at @AnthropicAI.
William Merrill @lambdaviking
5K Followers 669 Following Incoming Assistant Prof, Toyota Technical Institute at Chicago @TTIC_Connect Recruiting PhD students (start 2026) 👀 Will irl - TC0 enthusiast
Danqi Chen @danqi_chen
17K Followers 789 Following Associate professor @princetonPLI @PrincetonCS. Previously: @facebookai, @stanfordnlp, @Tsinghua_Uni https://t.co/hLXgShMIPE
Max Simchowitz @max_simchowitz
1K Followers 105 Following Assistant Professor @mldcmu. Formerly: Postdoc @MITEECS, PhD @Berkeley_EECS, Math Undergrad @Princeton. New to Twitter. https://t.co/67bMOAyqK6
Giorgia Ramponi @gio_ramponi
4K Followers 285 Following Ass. Prof. @UZH_en @uzh_ifi, PI @ ALPILab 🌼 Working on RL, multi-agent, imitation learning, and other sequential decision-making stuff @gioramponi.bsky.social
Jérôme Bolte @jerome_bolte
178 Followers 41 Following Professor of Mathematics, Toulouse School of Economics & ANITI
Mathurin Massias @mathusmassias
2K Followers 181 Following Researcher @INRIA_lyon, Ockham team. Teacher @Polytechnique and @ENSdeLyon Machine Learning, Python and Optimization
Arnaud Doucet @ArnaudDoucet1
6K Followers 811 Following Senior Staff Research Scientist @GoogleDeepMind, previously Oxford Stats Prof - interested in Comp Stats, Generative Modeling, Monte Carlo, Optimal Transport
Lénaïc Chizat @LenaicChizat
2K Followers 247 Following Assistant professor @epfl (previously @cnrs researcher).
Fabian Pedregosa @fpedregosa
6K Followers 579 Following Keeping the gradients flowing since 2013. Loves open source. Sometime blogs and writes papers.
Quanquan Gu @QuanquanGu
16K Followers 2K Following Professor @UCLA, Pretraining and Scaling at ByteDance Seed | Recent work: Build AGI | Opinions are my own
Mark Schmidt @MarkSchmidtUBC
2K Followers 230 Following So machine learning. Very optimization. Wow. Such UBC.
Vitaly 🇺🇦 Feldm... @vitalyFM
4K Followers 379 Following Proving theorems about machine learning. Worried about data privacy. Research scientist at @Apple
Andrea Montanari @Andrea__M
8K Followers 283 Following Professor, Statistics and Mathematics, Stanford University. (Opinions are my own)
Florian Tramèr @florian_tramer
6K Followers 209 Following Assistant professor of computer science at ETH Zürich. Interested in Security, Privacy and Machine Learning
Nicolò Cesa-Bianchi @NicoloCB
2K Followers 130 Following Professor at the University of Milan, Italy Machine learning algorithms
Andrej Risteski @risteski_a
3K Followers 2K Following Machine learning researcher. Associate Professor, ML department at CMU (@mldcmu).
Anna Korba @Korba_Anna
1K Followers 742 Following Assistant prof in Machine Learning @Ensaeparis/@CrestUmr
Guillermo Ortiz-Jimé... @gortizji
917 Followers 687 Following Research Scientist at @GoogleDeepMind. Past: PhD at EPFL, intern at Google, ELLIS student Oxford.
Simon Shaolei Du @SimonShaoleiDu
9K Followers 2K Following Assistant Professor @uwcse. Postdoc @the_IAS. PhD in machine learning @mldcmu.
Constantinos Daskalak... @KonstDaskalakis
7K Followers 233 Following Scientist. Computer Science Professor @MIT. Studying Computation, and using it as a lens to study Game Theory, Economics, and Machine Intelligence.
Kush Bhatia @kushbhatia03
54 Followers 99 Following
Keivan Rezaei @RezaeiKeivan
428 Followers 314 Following Research Intern @Adobe || CS Ph.D. Student @UofMaryland || Prv. Student Researcher @GoogleAI || Prv. intern @allen_ai Ai2 || Alum @SharifSocial
Ernest Ryu @ErnestRyu
6K Followers 351 Following Professor of Mathematics at UCLA. Interested in deep learning and optimization.
Mengdi Wang @MengdiWang10
4K Followers 1K Following Professor @Princeton in AIML. Co-Director of #Princeton AI^2. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua. my Erdos number: 3
Piotr Bojanowski @p_bojanowski
1K Followers 140 Following Research Scientist at Facebook AI Research. Interested in Machine Learning and Computer Vision.
Quentin Berthet @qberthet
3K Followers 2K Following Research Scientist at Google DeepMind Machine Learning - Paris
rodolphe_jenatton @RJenatton
333 Followers 262 Following
Etienne Boursier @eboursie
232 Followers 271 Following Researcher at INRIA (CELESTE team). Former Postdoc at EPFL and PhD student at ENS Paris-Saclay. Focusing on theory of neural networks and multiplayer bandits
Alberto Bietti @albertobietti
2K Followers 2K Following Machine learning research. Research scientist @FlatironCCM, previously @MetaAI, @NYUDataScience, @Inria, @Quora.
Sam Power @sp_monte_carlo
19K Followers 7K Following Lecturer in Maths & Stats at Bristol. Interested in probabilistic + numerical computation, statistical modelling + inference. @OnlineMCSeminar. (he / him)
Omar Rivasplata @OmarRivasplata
1K Followers 377 Following Carpe espresso ☕ Manchester Centre for AI FUNdamentals Deep Thinker. Posts/reposts might be non-deep.
Maria Brbic @mariabrbic
2K Followers 224 Following Assistant Professor of #computerscience and #lifesciences at @EPFL @ICepfl @epflSV Previously @Stanford #AI #compbio
Tengyu Ma @tengyuma
37K Followers 564 Following Assistant professor at Stanford; Co-founder of Voyage AI (https://t.co/wpIITHLgF0) ; Working on ML, DL, RL, LLMs, and their theory.
Ben Recht @beenwrekt
32K Followers 333 Following optimization. machine learning. uc berkeley. I blog at https://t.co/fkJujOPsJb The world won't end.
Pierre Ablin @PierreAblin
6K Followers 361 Following https://t.co/sNXqNTO0Vm Machine learning research @Apple
IdePHICS lab @idephics
190 Followers 53 Following "Information Learning & Physics" is an academic lab. in EPFL, Switzerland, focusing on computer science, machine learning & statistical physics. PI: @krzakalaF
flair_epfl @flair_epfl
211 Followers 5 Following The Foundations of Learning and AI Research (FLAIR) group @ EPFL aims at providing grounded scientific foundations to foster machine learning of tomorrow
Volkan Cevher @CevherLIONS
3K Followers 656 Following Associate Professor of Electrical Engineering, EPFL. Amazon Scholar (AGI Foundations). IEEE Fellow. ELLIS Fellow.
Caglar Gulcehre @caglarml
5K Followers 1K Following Scientist MAI, Prof @ EPFL, Ex-research scientist @ DeepMind, MSR, IBM Socials: https://t.co/qYmpvyUf0u, https://t.co/LZ5sWt7Asj