Jary Pomponi @JaryPom
Post-doc researcher @SapienzaRoma (@IspammL Lab) | Works on Continual Learning in #MachineLearning (and others stuff) | Searching for the posterior by sampling jarypomponi.com Rome Joined June 2009-
Tweets61
-
Followers88
-
Following468
-
Likes3K
*Alice goes to a differentiable wonderland!* 🔥 I published a short free book on the design of neural networks, from convolutions to transformers, SSMs, and a few other topics. As a bonus, I tried to make it looking nice - any feedback is appreciated! sscardapane.it/alice-book
*Conditional computation in NNs: principles and research trends* by @devoto_alessio @valeriomarsocci @JaryPom @PMinervini Our latest tutorial on increasing modularity in NNs with conditional computation, covering MoEs, token selection, & early exits. arxiv.org/abs/2403.07965
More than 17,000 tree species are at risk from rapid #globalchange - check our new data-driven assessment @NatureComms suggesting a substantial underestimation of threats to #trees from factors such as #deforestation and #climatechange🌳🔥🌥️ ☠️nature.com/articles/s4146… @EconovoAU
Synecdoche, Log Cabin. Charlie Kaufman, 2008.
My first paper of 2024 is out! With Matteo Gambella, Manuel Roveri, and @s_scardapane, we developed NACHOS, the first Neural Architecture Search framework for automatically designing optimal Early Exits NNs. You can find the paper here: arxiv.org/abs/2401.13330
Omg, github.com/pytorch/tensor… is a gift from the gods 😍 (thx @clured!)
It just took me three years of #PhD and 1 of #Postdoc to build up a personal website: jarypomponi.com. Four long years searching for the best template and the best colour palette. It was worth it.
*Centroids Matching: an efficient CL approach in the embedding space* w/ @JaryPom In our latest work published on @TmlrOrg we study an efficient approach for continual learning based on extracting centroids from the embeddings of past tasks. openreview.net/forum?id=7gzQl…
I'm glad to present my last paper, which is perfect if you are searching for a summer CL paper to read before going to holidays. Enjoy!
I'm glad to present my last paper, which is perfect if you are searching for a summer CL paper to read before going to holidays. Enjoy!
I am very excited to release this primer on lifelong supervised learning: arxiv.org/abs/2207.04354. Lifelong learning is one of the most promising learning paradigms to achieve artificial general intelligence. 1/n
1922 was an important year in western literature: the publication of ‘Ulysses' in full by James Joyce and ‘The Wasteland’ by T.S. Eliot, the death of Marcel Proust and it's the year in which F. Scott Fitzgerald set 'The Great Gatsby’.
We got a new paper published in #NeuralNetworks! 🥳 "Structured Ensemble" is our contribution to the field of ensemble neural networks: we build efficient ensembles by finding subnetworks at initialization (inspired by lottery tickets). Great work by @JaryPom 1/x
Tigotasm @tigotasm13467
0 Followers 323 Following My hobbies are reading, food and sports. I like cats😘 I like to meet new friends while traveling🎉🎉🎉Shore @ShoreFSL
0 Followers 146 FollowingThair @Thair932811
0 Followers 301 FollowingJonathan Lorraine @jonLorraine9
4K Followers 5K Following Research @NVIDIA | PhD in machine learning @UofT. Previously @Google / @MetaAI. Opinions are my own. 🤖 💻 ☕️cigdem.beyan @BeyanCigdem
442 Followers 455 Following Associate Professor in Computer Science @UniVerona Member of @ELLISforEurope Computer Vision & Social and Affective Computing & Machine and Deep LearningLuna @Esther420831272
3 Followers 810 FollowingSreerag M./ ശ്ര.. @sreagm
86 Followers 3K FollowingAlessio Devoto @devoto_alessio
15 Followers 35 FollowingDonatella Genovese @d_genovese
6 Followers 44 Following PhD Student at @SapienzaRoma | Works on Explainable AI at @IspammL Labpatente di guida @patente_di
52 Followers 436 FollowingDishes @Dishes531729
17 Followers 225 FollowingSaurav Jha @saurav_j_
177 Followers 893 Following PhD student in continual learning @UNSWCOMPUTING , Previously @Inria_Nancy, @StAndrewsCS and @FactSet. Lived in 🇳🇵 🇮🇳 🇬🇧 🇫🇷 🇪🇸 🇦🇺Liyuan Wang @LiyuanW30011275
150 Followers 291 Following Continual Learning, Lifelong Learning, Brain-Inspired AIClaudio Battiloro @ClaBat9
505 Followers 246 Following Postdoctoral fellow @Harvard @Harvard_data | Topological Signal Processing ⋂ Deep Learning | Former Visiting @PennEngineers UPennSam Cohen @SamCMaths
372 Followers 366 Following Mathematician; Christian; beer, beards and silly hats aficionadoFuturFlo @FuturFlo
40K Followers 7K Following Founder & CEO @BlockFloDigital + @BlockchaiNorth 🌍 Connector/biz developer/speaker/#SocialMedia pro #BlockchainNorthAndreas Kirsch 🇮�.. @BlackHC
9K Followers 5K Following Past: 🧑🎓 DPhil @AIMS_oxford @ExeterCollegeOx @UniofOxford (4.5yr) 🧙♂️ RE @DeepMind (1yr) 📺 SWE @Google (3yrs) 🎓 @TU_Muenchen 👤 Fellow @nwspkRiccardo Fosco Gramac.. @riccardofosco
45 Followers 96 Following PhD Student in AI for Audiovisual Media @IspammL, @SapienzaRoma | Visiting Academic @c4dm, @QMULLuigi Sigillo @luigi_sigillo
35 Followers 106 Following #PhD student in ICT, dealing with Generative Deep Learning @SapienzaRomaJayan solved AGI-a He.. @isolvedagi2
337 Followers 1K Following it has an instinct to create multi-level novelty by default and associates things to form complex thoughts. no obj needed. see pinned tweet - Jayan Mudhaliar.KOUSHIK BISWAS @Koushik313
545 Followers 5K Following PhD student. Working on Deep learning and computer vision.Luca Maiano @lucamaiano
88 Followers 385 Following Ph.D. candidate at Sapienza University. Computer Vision and Digital Forensics.Cesare Campagnano @caesar_one_
199 Followers 413 Following PhD Student @ Sapienza University of Rome | ex-AmazonRedemptor Jr Taloma @bong_taloma
25 Followers 254 FollowingValerio Marsocci @valeriomarsocci
235 Followers 324 Following postdoc at @KULeuvenGent, using #SelfSupervisedLearning for #RemoteSensing. Previously postdoc at @LeCnam; and PhD in #DataScience at @SapienzaRomaGido van de Ven @GMvandeVen
519 Followers 437 Following Researcher on continual learning, taking a deep learning as well as cognitive science perspective. At @KU_Leuven, Belgium. Also on @[email protected]Timo Flesch @timoflesch
1K Followers 779 FollowingEleonora Lopez @elelopess
34 Followers 81 FollowingMarco Fontani @marco_fontani
119 Followers 171 FollowingLev Telyatnikov @lev_telyatnikov
102 Followers 224 Following Moving forward Topological Deep Learning @SapienzaRoma (PhD)Gabriele Galasso 🇪.. @GabrieleGalas17
724 Followers 1K Following Energy and Nuclear Engineering Student ⚛ Climate Change🌡️ 🌍 EcoModernist #SlavaUkraini 🇺🇦Ken Gardner @kennethcgardner
837 Followers 3K Following Seven time software entrepreneur, software engineer, inventor, interested in everythingAndrea Cossu @Cossu94
345 Followers 315 Following Post-doc in continual learning, ContinualAI board member. Pisa, IT.Machine Learning: Sci.. @MLSTjournal
9K Followers 10K Following A multidisciplinary, #openaccess journal devoted to the application and development of #machinelearning for the sciences. Published by @IOPPublishing.Abdus Samad @I_mAbdulSamad
126 Followers 2K Following Research scholar at VIT University | #deeplearning | #ComputerVisionvenktesh @vvenki22
616 Followers 5K Following Postdoc researcher @tudelft wis, former PhD candidate @iiitdelhi .PM fellow 2021 ( for doctoral research ). former Full stack dev . Opinions are my own.Bruno Neri @neribr
348 Followers 2K Following Technical Leader - Artificial Intelligence and Machine Learning Enthusiast - Senior Software Engineer @altenitaliaSvk @Svk20012305
219 Followers 2K FollowingAndrea Santilli @teelinsan
656 Followers 2K Following Intern at @Apple MLR | PhD student at Sapienza w/ @EmanueleRodola | Prev: @colt_upf, @BigscienceW, @picampusschool, @HumanCentricArt #NLProcbest_writers @bestwriters700
148 Followers 2K Following For help with #paper,#assignments, #proposal,#termpapers,#online classes,#exams, WhatsApp +1(779)223-4342,grade guaranteed A+Massimo Caccia @MassCaccia
2K Followers 570 Following Research Scientist @ServiceNowRSRCH. Gradient-descent enthusiast building LLM agents. PhD @Mila_Quebec. Formerly @Deepmind, @AWScloud, @SpotifyResearch.Cosimo Amato @cosimoamato13
10K Followers 10K Following Tu dois voir plus loin, tu dois tout essayer / Palermitano tra le montagne valdostane. Annata '83.neurallambda @neurallambda
209 Followers 159 Following λ/acc. building opensource AGI by jamming turing machines in the latent spaceTaelin @VictorTaelin
18K Followers 908 Following Founder of @HigherOrderComp Building the massively parallel future of computing Reaching AGI to cure all diseases and suffering is all that mattersJonathan Lorraine @jonLorraine9
4K Followers 5K Following Research @NVIDIA | PhD in machine learning @UofT. Previously @Google / @MetaAI. Opinions are my own. 🤖 💻 ☕️ELLIS @ELLISforEurope
12K Followers 70 Following Shaping the future with AI research excellence! More about ELLIS: https://t.co/n6nVmEGhKkcigdem.beyan @BeyanCigdem
442 Followers 455 Following Associate Professor in Computer Science @UniVerona Member of @ELLISforEurope Computer Vision & Social and Affective Computing & Machine and Deep LearningInformation is Beauti.. @infobeautiful
124K Followers 471 Following Data-visualizations & infographics made by David McCandless @mccandelish - app @vizsweet - new project @beautiful__news - https://t.co/oVLj2XZ7nfDepressedBergman @DannyDrinksWine
144K Followers 854 Following Fan of Chelsea, Blackcaps & a Movie aficionado. Alt: @danydrinkswineAll The Right Movies @ATRightMovies
829K Followers 140 Following The account on classic and hit films. Detail in our making of stories is from cast/crew or 3+ sources. To support what we do, please subscribe 😁Yen-Huan Li @yenhuan_li
2K Followers 537 Following Associate professor in CS @ National Taiwan University. PhD in CS from EPFL. Learning, optimization, statistics, and some quantum information.Dr Christopher T M Cl.. @DrChrisClack
7K Followers 3K Following VP at Pattern Energy. Trying to help provide cheap, clean energy 4 all! Father. Personal account. #math #energy #optimizationPasquale Minervini �.. @PMinervini
7K Followers 4K Following Researcher in ML/NLP at the University of Edinburgh (faculty @InfAtEd @EdinburghNLP), @ELLISforEurope, @UCL_NLP, PI for @Clarify2020, https://t.co/WydvfU8ugz he/theyAnthropic @AnthropicAI
264K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.Gary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.Ferran Alet @FerranAlet
2K Followers 395 Following Research Scientist @GoogleDeepMind; PhD from @MIT_CSAIL at @MIT_LISLab and @MITCoCoSciVincent Abbott | Deep.. @vtabbott_
3K Followers 200 Following Maker of *those* diagrams for deep learning algorithms | 🇦🇺 | https://t.co/kE2BIGCiMYKeiland Cooper @kw_cooper
922 Followers 2K Following Neuroscientist: Pull the AI out of brAIns and do good with it | @ucicnlm | cofounder @ContinualAI | @GCChemosensoryR | #firstGen [email protected]Berkeley AI Research @berkeley_ai
149K Followers 190 Following We're graduate students, postdocs, faculty and scientists at the cutting edge of artificial intelligence research.Donatella Genovese @d_genovese
6 Followers 44 Following PhD Student at @SapienzaRoma | Works on Explainable AI at @IspammL LabMartin Mundt @mundt_martin
2K Followers 607 Following Lifelong ML independent research group @Hessian_AI @CS_TUDarmstadt | Board @continualAI | AAAI-24 DEI Chair | @CoLLAs_conf Review Chair | He/they 🏳️🌈🇪🇺Daniel Jeffries @Dan_Jeffries1
22K Followers 1K Following I'm an author, futurist, thinker and systems architect.Alessio Devoto @devoto_alessio
15 Followers 35 FollowingThomas Steinke @shortstein
9K Followers 457 Following Computer scientist interested in (differential) privacy & related topics, e.g., generalization. @GoogleDeepMind Opinions are mine ©. 🇳🇿Orr Kislev @OrrKislev
4K Followers 399 Following Creative Technologist ; Generative Artist ; Nice Guy ; Father ; Educator ;Ioana Bica @IoanaBica95
2K Followers 714 Following Research Scientist @GoogleDeepMind | Board of Directors @WiMLworkshop | Ex PhD Student @UniofOxford,@turinginst and @cambridge_cl BA & MPhilMatthias Bauer @MatthiasSBauer
927 Followers 168 Following Research Scientist at DeepMind. All opinions are my ownZifeng Wang @ZifengWang315
480 Followers 493 Following Research Scientist @Google, PhD in Machine Learning @Northeastern. Large Language Models, Continual learning, Data & Parameter-efficient learning.Cambridge Computer Sc.. @Cambridge_CL
8K Followers 376 Following Department of Computer Science and Technology at the University of Cambridge. Also known as the Cambridge Computer Laboratory. Established in 1937.PostdocVoice @PostdocVoice
31K Followers 20K Following Amplifying the voices of Postdocs. Tag us with #PostdocVoice or @PostdocVoice. Run by @PhDVoice. Independently Run. How To Write An Academic Paper 101 link👇Emanuele Rodolà @EmanueleRodola
688 Followers 82 Following Head of GLADIA @SapienzaRoma and fellow of @SSAS_Sapienza, @ELLISforEurope and @yacadeuro. Lover of crazy ideas and anything passion-driven. #EUFundedInria @Inria
48K Followers 2K Following Institut national de #recherche en sciences et technologies du #numérique 🚀 La recherche de rang mondial et l’#innovation technologique constituent notre ADN.Tuytelaars Lab @tuytelaarslab
57 Followers 41 Following Computer vision lab @KU_Leuven focussing on representation learning, multimodal learning (images + text) and continual learning. PI: Tinne Tuytelaars.Tim Dettmers @Tim_Dettmers
29K Followers 826 Following PhD Student at @UW. I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.Jonathan Whitaker @johnowhitaker
7K Followers 959 Following Data scientist and AI researcher. R&D at https://t.co/9xrxRrGfEE.radiohead lyrics @radioheadlyrics
38K Followers 254 Following The largest #radiohead lyrics fan account online. All credit and bits of words from @Radiohead and @ThomYorkeJulien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @PolytechniqueFuzhao Xue @XueFz
4K Followers 542 Following Ph.D. candidate@NUSingapore, Intern of GEAR @NVIDIA | Google PhD Fellow | LLM, Foundation Model Scaling | Ex-@GoogleBrain | Zero-shot Cooking Learner🧑🍳Saurav Jha @saurav_j_
177 Followers 893 Following PhD student in continual learning @UNSWCOMPUTING , Previously @Inria_Nancy, @StAndrewsCS and @FactSet. Lived in 🇳🇵 🇮🇳 🇬🇧 🇫🇷 🇪🇸 🇦🇺Liyuan Wang @LiyuanW30011275
150 Followers 291 Following Continual Learning, Lifelong Learning, Brain-Inspired AIAlexis Conneau @alex_conneau
24K Followers 114 Following Audio AGI Research Lead @OpenAI - "Hear the AGI"Science Magazine @ScienceMagazine
4.0M Followers 483 Following The world's leading outlet for cutting-edge research in all areas of science. Follow @NewsfromScience for stories from our news team.Claudio Battiloro @ClaBat9
505 Followers 246 Following Postdoctoral fellow @Harvard @Harvard_data | Topological Signal Processing ⋂ Deep Learning | Former Visiting @PennEngineers UPenn@sigmjj @TerribleMaps No. That's the average American. Italo-americans are not Italian. They don't even speak Italian.
@TerribleMaps Which country has the least attractive people according to Europe?
Accepted to #ICML2024!! 🚀 Meet MAIA- a Multimodal Automated Interpretabilty Agent that helps users understand AI systems. Given a user query (eg "label a model’s feature"), MAIA designs experiments iteratively by forming and updating hypotheses based on experimental results.
We release the strongest public 1.3B and 3B models so far – the ShearedLLaMA series. Structured pruning from a large model to a small one is far more cost-effective (only 3%!) than pre-training them from scratch! Check out our paper and models at: xiamengzhou.github.io/sheared-llama/ [1/n]
When to Retrieve? This new paper presents an approach to train LLMs to effectively utilize information retrieval. It first proposes a training approach to teach an LLM to generate a special token, <RET>, when it's not confident or doesn't know the answer to a question. The…
Turns out, a simple sum operator might just render #deeplearning obsolete. Solid math-based ideas are proving once again to outperform gimmicks. #kolmogorovarnoldnetwork
*Alice goes to a differentiable wonderland!* 🔥 I published a short free book on the design of neural networks, from convolutions to transformers, SSMs, and a few other topics. As a bonus, I tried to make it looking nice - any feedback is appreciated! sscardapane.it/alice-book
@GoddenThomas @ImperialDyson @thrishlab my favorite part is how the cart gets stuck every single time when the obstacle high centers the body. it's a cool wheel, though!
I *WAS* WRONG - $10K CLAIMED! ## The Claim Two days ago, I confidently claimed that "GPTs will NEVER solve the A::B problem". I believed that: 1. GPTs can't truly learn new problems, outside of their training set, 2. GPTs can't perform long-term reasoning, no matter how simple…
A::B Prompting Challenge: $10k to prove me wrong! # CHALLENGE Develop an AI prompt that solves random 12-token instances of the A::B problem (defined in the quoted tweet), with 90%+ success rate. # RULES 1. The AI will be given a random instance, inside a <problem/> tag. 2.…
one of the most important things I know about deep learning I learned from this paper: "Pretraining Without Attention" this what I found so surprising: these people developed an architecture very different from Transformers called BiGS, spent months and months optimizing it and…
@LandsbergLaw @CarolineFohlin No and neither do you because that did not happen. Here is a larger copy of the video — there is no evidence of her touching anyone:
@Doing_my_best1 If you really don’t think you could ever be on the wrong side of a fascist’s boot you are a naive little child.
@Mel1612ancholia Talking to the police while an officer is kneeling on the head of a protester is not interfering, it is potentially preventing a murder.
✨New Paper Alert✨ Excited to introduce ExPO, an extremely simple method to boost LLMs' alignment with human preference, via weak-to-strong model extrapolation 👇 #LLMs #MachineLearning #NLProc #ArtificialIntelligence #AI
🧵1/6 Introducing Diffusion Constrained Samplers 🥳🥳🥳 arxiv.org/abs/2402.18012 Interested in optimization problems where (partial) constraints are unknown (protein/molecule design)? We show diffusion models learn it implicitly and optimize feasible solutions thru sampling!
I'm as excited as you are about your {lab, company, school}'s research, but perhaps rather than just hype, you can display a bit of scientific humility and tell me also what the challenges, gaps are.