Andrew Saxe @SaxeLab
Prof at @GatsbyUCL and @SWC_Neuro, trying to figure out how we learn. Bluesky: @SaxeLab Mastodon: @[email protected] saxelab.org London, UK Joined November 2019-
Tweets608
-
Followers4K
-
Following392
-
Likes2K
Proud to announce that in Sept I'll start as Assistant Professor at @chalmersuniv! Very grateful for my time @GatsbyUCL in @SaxeLab. Exciting times ahead! If you are interested in the core principles of AI and bias in ML systems, keep an eye out for PhD/postdoc openings!
Animals can learn to use all kinds of brain-computer interfaces, from controlling single neurons to large populations of neurons in motor ctx. How do they do this? Thrilled to be finally sharing our research on this question, now up on biorxiv! 🧵
In-context learning (ICL) circuits emerge in a phase change... Excited for our new work "What needs to go right for an induction head (IH)?" We present "clamping", a method to causally intervene on dynamics, and use it to shed light on IH diversity + formation. Read on 🔎⏬
2 postdoc positions in my lab @ King's College London @dev_neuro. Please apply if you'd like to understand neural circuits of cognition in mice, using 2p, 3p imaging, holographic optostim, flexible behaviour & more! Please RT! Links kcl.ac.uk/jobs/087206-re… khanlab.net
Excited that our new position piece is out! In this article, @summerfieldlab and I review three recent advances in using deep RL to model cognitive flexibility, a hallmark of human cognition: sciencedirect.com/science/articl… (1/4)
Excited to announce this summer school on analytical approaches (eg statistical physics and probability theory) for understanding deep learning models and higher-level cognition in NYC! Analytical Connectionism Summer School (Aug 12-23, '24) Speakers: Jonathan Cohen @CPehlevan…
Excited to announce this summer school on analytical approaches (eg statistical physics and probability theory) for understanding deep learning models and higher-level cognition in NYC! Analytical Connectionism Summer School (Aug 12-23, '24) Speakers: Jonathan Cohen @CPehlevan… https://t.co/xx2c1xdvUq
📣 Join us in Analytical Connectionism our summer school on the foundations of higher-level cognition. Join experts from neuroscience, psychology & ML for lectures, tutorials, and a hackathon! Aug 12-23, 2024 in NYC @FlatironInst @nyuniversity [events.simonsfoundation.org/event/e070287e…] 🐭🤖
Join us in this marvelous place to talk, learn, work and explore. Deadline 31 March 2024. compneuronrsn.org
New preprint! @tafazolisina shows the brain builds complex tasks by compositionally combining simpler sub-task representations. By dynamically reusing neural subspaces for sensory inputs and motor actions, the brain can flexibly perform multiple tasks. 🧵 biorxiv.org/content/10.110…
I’m really excited to see the NeuralPlayground team has finally put out a preprint: biorxiv.org/content/10.110…! My students in @raillabwits and @PrimeLabWits have already been making use of the library (github.com/SainsburyWellc…) and feeling the impact both for teaching and research.
Kording —-& Lab �.. @KordingLab
42K Followers 4K Following Konrad kording, @Penn Prof, deep learning, brains, #causality, rigor, https://t.co/tTJW05RjpC, https://t.co/qf7ZHxiCUt, Transdisciplinary optimist, Dad, Loves outdoors, 🦖Patrick Mineault @patrickmineault
19K Followers 3K Following Neuro AI, vision, Python, open science. Senior ML scientist @ Mila. Previously engineer @ Google, Meta. Updates from https://t.co/d0o7cSLC6o, https://t.co/duh0cFwLywShahab Bakhtiari @ShahabBakht
3K Followers 1K Following || assistant prof @UMontreal || leading the systems neuroscience and AI lab (SNAIL) || @Mila_Quebec || #NeuroAI || vision and learning in brains and machinesTim Kietzmann @TimKietzmann
11K Followers 3K Following ML meets Neuroscience #NeuroAI, Full Professor at the Institute of Cognitive Science (@UniOsnabrueck), prev. @DondersInst, @Cambridge_Uni #neuroconnectionismIda Momennejad @criticalneuro
15K Followers 2K Following Principal Researcher @MSFTResearch. I study memory/planning in brains. I build/evaluate AI. Writing on Memory. Finishing a novel. Cohost https://t.co/rgvLjhBvSHBlake Richards @tyrell_turing
15K Followers 2K Following Researcher at @mcgillu combining AI and neuroscience. Also on Bluesky (@tyrellturing.bsky.social) and Mastodon: @[email protected].Dr. Anna Schapiro @AnnaSchapiro
9K Followers 827 Following Assistant Prof at U Penn. Learning, memory, sleep, neural network modeling, open science. https://t.co/4dODyQuOd0Kanaka Rajan @KanakaRajanPhD
10K Followers 2K Following Associate Professor at Harvard & Kempner Institute. Applying computational frameworks & ML to decode multi-scale neural processes. Marathoner. Rescue dog mom.Dan Goodman @neuralreckoning
12K Followers 614 Following Computational neuroscientist @imperialcollege. I like to make stuff: @briansimulator @neuromatch. 🐘 @[email protected]David Sussillo @SussilloDavid
12K Followers 811 Following Comp neuro/deep learning. Research scientist at Meta Reality Labs. Adjunct prof at Stanford. Prev: Google Brain, Stanford postdoc. Milton Hershey Alum.Rui Ponte Costa @somnirons
3K Followers 1K Following Computational neuroscientist bringing machine and neural learning closer together @OxNeuro @OxfordDPAG | #firstgen | @ERC_Research Grantee 🇵🇹🇪🇺🇬🇧🌳Grace Lindsay @neurograce
18K Followers 1K Following Asst Prof, Psych & Data Science @nyuniversity | Brains & Climate | Book: "Models of the Mind" https://t.co/X7Cd5iCuiE | @neurograce.bsky.social & https://t.co/0TTSXGpTATNicole C Rust, PhD @NicoleCRust
7K Followers 890 Following Professor @Penn. Memory scientist. Advocate of community-based progress. Writing a book about brain research. What do we want to know?Tony Zador @TonyZador
11K Followers 2K Following Neuroscientist at CSHL. Interests: neuroAI, molecular connectomics, & cortical circuits underlying decisions. Co-founder of Cosyne and NAISys meetings.Dan Levenstein @dlevenstein
3K Followers 1K Following Neuroscientist, in theory. Studying sleep in 🧠s and 💻s with @tyrell_turing and @apeyrache at Mila/McGillDileep George @dileeplearning
10K Followers 1K Following AGI research @DeepMind. Ex cofounder & CTO @vicariousai (acqd by Alphabet) and @Numenta. Triply EE (BTech IIT-Mumbai, MS&PhD Stanford). #AGIComicssummerfieldlab @summe.. @summerfieldlab
8K Followers 811 Following Investigating the mechanisms that underpin human learning, perception and cognition, headed by Chris SummerfieldClémentine Dominé �.. @ClementineDomi6
2K Followers 2K Following PhD student @GatsbyUCL| Masters Theoretical Physics @OfficialUoM| @UCLA | Previously @SapienzaRoma | @CERN | @EPFL | Music Art Creator @ArtlovessciencesHarry Ying @YKanyang
75 Followers 1K Following Physics student who is also interested in Rust programming language, mathematics and social science. Terrible guitar player. Star Wars fan.Kunvar Thaman @firstuserhere
221 Followers 641 Following Taking apart neural networks and putting them back together for a living Social profiles: https://t.co/OxoeMvCw3aJinyuan (Tobias) @JinyuanWang7
83 Followers 773 Following Research Engineer @NUS. Data scientist @LushairSatish Talluri @satishtalluri
1K Followers 4K Following Investment Partner at Andreessen Horowitz. Previously - growth & product at AppDynamics, https://t.co/vipvmt4XDI, BCG, IntelAlo @Hal90910
0 Followers 2K Followingliuyong @forrestbing
268 Followers 5K Following I am a researcher in AIGC, Multi-modality and VitrualHuman tech directionJerry Hellden @Yariv_hellden
754 Followers 7K Following Founder @ Andromedaerospace, Experimental Aerospace engineer, Theoretical physicist, Quantum cosmologist, ML engineer, Futurist, Scientist, Reverse engineer🇺🇸Atilla_Kelemen @Ata_Kelemen
0 Followers 62 FollowingHokin Deng @DengHokin
22 Followers 360 FollowingYoujing Yu @youjing_yu99
0 Followers 26 FollowingTom Varsavsky @tomvarsavsky
492 Followers 819 Following Research Engineer @V7Labs | Previously an academic @UCL and @KingsImaging working on AI in NeuroImaging and the COVID-19 Symptom Study appNishant Suman @nishantsuman3
13 Followers 1K FollowingAnushri @Anushri92339589
29 Followers 75 Followingflyingfish @fujisawafish
22 Followers 383 FollowingVikram Dutt @vd_
837 Followers 7K FollowingNirupama Ratna (looki.. @ratna_kandala
191 Followers 2K Following Ph.D. student in Linguistics @ IIT Hyderabad BS-MS in Systems Biology #NLP#AI#NeuroscienceZahra Jourahmad @ZahraJourahmad
149 Followers 1K Following Medical Doctor, System Neuroscience and clinical Neurology Researcher and Computational Neuroscience Enthusiast.🧠 Semi-Professional Chess player ♟plasmoidinho @plasmoidinho
10 Followers 84 FollowingEmilio Bazan Sanchez @Neuroemi
483 Followers 2K Following Cyber-sorcerer, apprentice of the lost arts, qualia engineer, netrunner and braindance editorAbby Acey @abby_acey95644
92 Followers 5K FollowingARENA @ARENA_ResUnit
21 Followers 36 Following ARENA Research Unit .@dfg_public funded Abstract Representations in Neural ArchitecturesMark Sheffield @Sheffield_Lab
1K Followers 1K Following UChicago Neuroscientist & Assistant Professor - Mechanisms of Memory 🧠. He/him.Kaiser Lab @DKaiserlab
264 Followers 449 Following Studying natural vision @jlugiessen using psychophysics, EEG, fMRI, TMS and computational models, PI: Daniel KaiserMeebai @Meebaipro
433 Followers 3K Following Una metodología para la educación consciente de las emociones basada en la inteligencia artificial (AI). #MEEBAI #AI #Education #EmotionsSina Khanmohammadi @Dr_SinaKhan
188 Followers 325 Following Assistant Professor @UofOklahoma | Principal Investigator @3sigmalabPDFviewoor @fontaines_bc
41 Followers 548 FollowingChenyi Li @OrangeKiller0
17 Followers 90 Following CUHKSZ 23’ UC Berkeley 22’ NYU 25’. computational neuroscience & cognitive science. Coffee person. (she/her)Ayla Halliburton @AylaHallib20094
39 Followers 5K FollowingLollipop @lollipopseeker
36 Followers 144 FollowingSanchari Sengupta @Sanchari_07
93 Followers 1K Following Masters in Cognitive Neuroscience @Maastricht University Research Masters in Psychology @IIPR Looking for PhD positions in cognitive neuroscience & psychologyBillie Hutmacher @BillieHutm79851
97 Followers 5K FollowingYiwei C. @Ivy00312911
8 Followers 123 FollowingSaahith @saahithjanapati
42 Followers 1K FollowingDonghoon Shin @shinapses
34 Followers 205 Following PhD student at @UCSF Frank lab | @BerkeleyBioE | Interested in understanding principles of intelligence | previously: @GeorgiaTech_ECE, @coulterBME, KAISTKamil C @kchoudhu
4K Followers 1K Following Financial programmer, dollar maximalist, professional idiot.Henry Ward @HenryAWard
24 Followers 974 Following MSc Artificial Intelligence @UniKent 2023 Also cares about going to Mars, 🚀saving the planet 🌎 and dropping the bass. 🎸Pensé FFun @inftyCategory
96 Followers 6K FollowingVictoria Brami @BramiVictoria
3 Followers 50 FollowingRavi Jayakumar @ravi_jayakumar
122 Followers 904 Following Postdoc in the LIMBS & Knierim Lab, Johns Hopkins UniversityFlatiron CCN @FlatironCCN
2K Followers 51 Following The Center for Computational Neuroscience (CCN) is part of the @FlatironInst, a multidisciplinary institute focused on computation.Arjun Kaul @ProbablyArjun
620 Followers 3K Following 🇬🇧🇨🇦🇮🇳🏳️⚧️ | they/them | neuroscience @UofT, @uoftsu '20Kording —-& Lab �.. @KordingLab
42K Followers 4K Following Konrad kording, @Penn Prof, deep learning, brains, #causality, rigor, https://t.co/tTJW05RjpC, https://t.co/qf7ZHxiCUt, Transdisciplinary optimist, Dad, Loves outdoors, 🦖Patrick Mineault @patrickmineault
19K Followers 3K Following Neuro AI, vision, Python, open science. Senior ML scientist @ Mila. Previously engineer @ Google, Meta. Updates from https://t.co/d0o7cSLC6o, https://t.co/duh0cFwLywShahab Bakhtiari @ShahabBakht
3K Followers 1K Following || assistant prof @UMontreal || leading the systems neuroscience and AI lab (SNAIL) || @Mila_Quebec || #NeuroAI || vision and learning in brains and machinesTim Kietzmann @TimKietzmann
11K Followers 3K Following ML meets Neuroscience #NeuroAI, Full Professor at the Institute of Cognitive Science (@UniOsnabrueck), prev. @DondersInst, @Cambridge_Uni #neuroconnectionismIda Momennejad @criticalneuro
15K Followers 2K Following Principal Researcher @MSFTResearch. I study memory/planning in brains. I build/evaluate AI. Writing on Memory. Finishing a novel. Cohost https://t.co/rgvLjhBvSHBlake Richards @tyrell_turing
15K Followers 2K Following Researcher at @mcgillu combining AI and neuroscience. Also on Bluesky (@tyrellturing.bsky.social) and Mastodon: @[email protected].Dr. Anna Schapiro @AnnaSchapiro
9K Followers 827 Following Assistant Prof at U Penn. Learning, memory, sleep, neural network modeling, open science. https://t.co/4dODyQuOd0Kanaka Rajan @KanakaRajanPhD
10K Followers 2K Following Associate Professor at Harvard & Kempner Institute. Applying computational frameworks & ML to decode multi-scale neural processes. Marathoner. Rescue dog mom.Earl K. Miller @MillerLabMIT
36K Followers 2K Following Picower Professor of Neuroscience at MIT https://t.co/UoEeD2FzEY https://t.co/GJDAccXAW8 https://t.co/my1do6xTn1Dan Goodman @neuralreckoning
12K Followers 614 Following Computational neuroscientist @imperialcollege. I like to make stuff: @briansimulator @neuromatch. 🐘 @[email protected]David Sussillo @SussilloDavid
12K Followers 811 Following Comp neuro/deep learning. Research scientist at Meta Reality Labs. Adjunct prof at Stanford. Prev: Google Brain, Stanford postdoc. Milton Hershey Alum.Rui Ponte Costa @somnirons
3K Followers 1K Following Computational neuroscientist bringing machine and neural learning closer together @OxNeuro @OxfordDPAG | #firstgen | @ERC_Research Grantee 🇵🇹🇪🇺🇬🇧🌳Grace Lindsay @neurograce
18K Followers 1K Following Asst Prof, Psych & Data Science @nyuniversity | Brains & Climate | Book: "Models of the Mind" https://t.co/X7Cd5iCuiE | @neurograce.bsky.social & https://t.co/0TTSXGpTATMackenzie Mathis, PhD @TrackingActions
20K Followers 12 Following Scientist merging adaptive motor control & machine learning | 🐭@deeplabcut 🦓@cebraAI | @ELLISforEurope Scholar | (same @ on bluesky)Nicole C Rust, PhD @NicoleCRust
7K Followers 890 Following Professor @Penn. Memory scientist. Advocate of community-based progress. Writing a book about brain research. What do we want to know?Tony Zador @TonyZador
11K Followers 2K Following Neuroscientist at CSHL. Interests: neuroAI, molecular connectomics, & cortical circuits underlying decisions. Co-founder of Cosyne and NAISys meetings.Dileep George @dileeplearning
10K Followers 1K Following AGI research @DeepMind. Ex cofounder & CTO @vicariousai (acqd by Alphabet) and @Numenta. Triply EE (BTech IIT-Mumbai, MS&PhD Stanford). #AGIComicssummerfieldlab @summe.. @summerfieldlab
8K Followers 811 Following Investigating the mechanisms that underpin human learning, perception and cognition, headed by Chris SummerfieldEmma Bryce @EmmaSAanne
2K Followers 2K Following Environment journalist, clips in @guardian @chinadialogue @AnthropoceneMag @sciam @WiredUKAnna Ivanova @neuranna
5K Followers 1K Following Language and thought in brains vs machines. New Assistant Prof @ Georgia Tech Psychology. Previously: postdoc @MIT_Quest & PhD @mitbrainandcog. She/herTed Moskovitz @ted_moskovitz
743 Followers 193 Following PhD student at @GatsbyUCL. Formerly: intern at @DeepMind, @UberAILabs, student at @ColumbiaCompSci, @PrincetonNeuro.Simon Kirby @SimonKirby
5K Followers 922 Following Prof Language Evolution FBA FRSE MAE. Head of Dept, Linguistics & English Language, Uni Edinburgh. With my students & collaborators I do science & art. he/him.Jiquan Ngiam @JiquanNgiam
522 Followers 176 Following Building @Lutra_AI Previously: Google Brain, Coursera, Stanford ML GroupConference on Parsimo.. @CPALconf
704 Followers 1K Following CPAL is a new annual research conference focused on the parsimonious, low dimensional structures that prevail in ML, signal processing, optimization, and beyondSong Mei @Song__Mei
1K Followers 572 Following Assistant Professor at UC Berkeley, Department of Statistics and EECS. Researcher working on foundations of AI and deep learning.Aaditya Singh @Aaditya6284
447 Followers 247 Following PhD student at @GatsbyUCL working with @SaxeLab, @FelixHill84 on learning dynamics, ICL, concepts, LLMs. Prev. at: @GoogleDeepMind, @AIatMeta (LLaMa 3), @MITStephanie Chan @scychan_brains
3K Followers 2K Following Senior Research Scientist at DeepMind. Artificial and biological brains 🤖 🧠 Views are my ownNina Miolane @ninamiolane
4K Followers 2K Following Assis. Prof. @ucsbece Affiliate @SLAClab Stanford Prev @Stanford @Inria @imperialcollege @Polytechnique PI @geometric_intel https://t.co/Eeeaqytppe, PilotTania Barkat @tania_barkat
557 Followers 284 Following neuroscientist @unibasel_en | professor and head of brain & sound lab | mountain enthusiastBruno Loureiro @_brloureiro
403 Followers 637 Following Researcher at @ENS_ULM working on the crossroads between machine learning and statistical physics.Quilee Simeon @qsimeon98
18 Followers 74 Following PhD Candidate @ MIT BCS & Statistics. Comp Neuro. https://t.co/xFOSUWPJORAnna Sadnicka @AnnaSadnicka
280 Followers 248 Following Trying to understand human movement disorders. Consultant neurologist @ NHNN and early career researcher @wellcometrust @GatsbyUCL @MDC_IoN_UCLWilka Carvalho @cogscikid
1K Followers 762 Following kempner fellow @Harvard studying human reinforcement learning. cognitive scientist & AI researcher. latinx new yorker. prev: umich, deepmind, msrAgostina Palmigiano @APalmigiano
668 Followers 502 Following Lecturer at @GatsbyUCL, former @cu_neurotheory Looking for postdocs! Apply here: https://t.co/y37qSSfkWsVictoria Bosch @__init_self
255 Followers 395 Following neuromantic - ML and cognitive computational neuroscience - PhD student at Kietzmann Lab, Osnabrück University.Li Zhaoping @Li_Zhaoping
2K Followers 380 Following Prof. and head of Dept. of Sensory and Sensorimotor System, Max Planck Inst. of Biol. Cybern, author of "Understanding vision: theory, models, and data"Julia @JuliaJadeHarris
514 Followers 282 Following Neuroscientist | Group Leader @SWC_Neuro | Let's all sleep more 💤Josh Makepeace @josh_makepeace
592 Followers 401 Following Lecturer in Chemistry and Future Leaders Fellow at the University of Birmingham 🏳️🌈 (he/him)Matt Botvinick @mattbotvinick
818 Followers 31 Following Senior Technology and Policy Advisor @DeepMindAaron Boes @boeslab
8K Followers 1K Following Neurologist & Neuroscientist: Lesion Mapping | Lesion Network Mapping | Brain StimulationJin Lee @jinleewastaken
223 Followers 117 Following 🧠 Learning about learning; PhD student in SaxeLab @SWC_neuro @UCLNishil Patel @nishpathead
36 Followers 111 FollowingDharshan Kumaran @dharshsky
110 Followers 140 FollowingDevon Jarvis @devonjarvi5
116 Followers 116 Following PhD + Lecturer in Theoretical ML at Wits University in RAIL Lab and Prime Lab. Previously at Gatsby and SWC, UCL. Google PhD Fellow and Commonwealth Scholar.Sophia Sanborn @naturecomputes
4K Followers 3K Following Theory, ML, neurotechnology @ https://t.co/OmhC0RyxZp | Organizer @neur_reps | Prev: @geometric_intel @berkeley_ai @redwood_neuro @intelai @harvardBrad Wyble @bwyble@ne.. @bradpwyble
5K Followers 4K Following Father, Academic, cognitive & vision scientist, computational modeller, cofounder @neuromatch Academy, He/His. This is a personal account.Sepiedeh Keshavarzi |.. @SepiKeshavarzi
843 Followers 477 Following Assistant Professor & Group Leader at @PDN_Cambridge @[email protected]Sandra Reinert @sandra_tanja
309 Followers 250 Following excited neuroscientist, mouse trainer by profession, postdoc @SWC_Neuro, @[email protected]Anna Mitchell🐒🐀.. @annamitch28
436 Followers 800 Following Wellcome Trust Senior Research Fellow Thalamocortical interactions, neuroscience, cognition. Tweets are my own opinionUCL Neuroscience @uclnpp
3K Followers 109 Following UCL Neuroscience, Physiology and Pharmacology carries out world-leading research into the nervous system, from molecules and synapses to circuits and behaviour.Freya Aquarone 🏳�.. @freyaaquarone
467 Followers 693 Following Teaching & Learning Coordinator at The New School. Interested in inclusion, SEND, and democracy in education.Michael Milford FTSE .. @maththrills
4K Followers 823 Following Director QUT Centre for Robotics, ARC Laureate Fellow, ATSE & MS Fellow, Math Thrills founder, localization, autonomous vehicles, robotics, RatSLAM, SeqSLAMEleonora Russo @russo_eleon
617 Followers 669 Following Theoretical neuroscientist. Assistant Professor @SantAnnaPisa, PI of the Brain Dynamics Laboratory. @russoel.bsky.social @[email protected]Aurelie Herbelot (@mi.. @ah__cl
901 Followers 313 Following Ex-academic. Forever a computational semanticist. I care about meaning. I also care *for* meaning, here for instance: https://t.co/fic4erWFIH.Geraint Rees @profgeraintrees
12K Followers 4K Following UCL Vice-Provost (Research, Innovation & Global Engagement). Husband, dad, doctor, professor, runner. Not necessarily in that orderYasser Roudi @yasser_roudi
1K Followers 382 Following Scientist, Immigrant, King's College London @KCLDisorder @kclmathematics https://t.co/sMfjBPVXAb https://t.co/klqp49XQl7Laureline Logiaco @LLogiaco
1K Followers 1K Following Theoretical neuroscientist, feeling uncomfortable with personal advertisement of science, but pressured to go on twitter. [email protected]Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.Michael Hasselmo @HasselmoMichael
3K Followers 319 Following Director of Center for Systems Neuroscience at Boston University @buCSNneuro Editor in Chief of the journal HippocampusErin Grant @ermgrant
3K Followers 1K Following Senior Research Fellow @GatsbyUCL & @SWC_Neuro {learning, representations, structure} in 🧠💭🤖 @[email protected] @[email protected]Roberta Raileanu @robertarail
4K Followers 1K Following Research Scientist @Meta & Honorary Lecturer @UCL. ex @DeepMind | @MSFTResearch | @NYU | @Princeton. Llama-3, Toolformer, Rainbow Teaming.Guillaume Lajoie @g_lajoie_
2K Followers 235 Following Associate Prof. @UMontreal Math & Stats and @MILAMontreal, @ai_unique Applied Math, AI, Computational Neuroscience, Neural InterfacingProud to announce that in Sept I'll start as Assistant Professor at @chalmersuniv! Very grateful for my time @GatsbyUCL in @SaxeLab. Exciting times ahead! If you are interested in the core principles of AI and bias in ML systems, keep an eye out for PhD/postdoc openings!
1/6 Surrogate gradients (SGs) are empirically successful at training spiking neural networks (SNNs). But why do they work so well, and what is their theoretical basis? In our new preprint led by @JuliaGygax4, we provide the answers: arxiv.org/abs/2404.14964
Thanks, Gaute, for having me on the podcast. It was a lot of fun!
Episode #11 in #TheoreticalNeurosciencePodcast: On synaptic learning rules for spiking neurons – with Friedemann Zenke @hisspikeness theoreticalneuroscience.no/thn11 How can we do supervised learning of spiking networks? And how can neurons self-supervise their learning?
Excited to see the final version out @eLife. A long journey since the 1st draft as we ran experiments to test new model's predictions. Thanks to reviewers whose comments made it a better paper! @vboboeva, A Pezzotta, @ClopathLab Image by @mulesome article: elifesciences.org/articles/86725…
New preprint (first from the lab)! 📢 "From recency to central tendency biases in working memory: a unifying attractor network model" by @vizhe4 (Vezha Boboeva), Alberto Pezzotta, co-supervised by me & @ClopathLab! @SWC_Neuro, @imperialcollege biorxiv.org/content/10.110… (1/25)
Animals can learn to use all kinds of brain-computer interfaces, from controlling single neurons to large populations of neurons in motor ctx. How do they do this? Thrilled to be finally sharing our research on this question, now up on biorxiv! 🧵
Crazy! Someone’s making a lot of money out of this but I guess @UniofOxford is comfortable with that. Why should we pay a third party to do something we can do cheaper and faster?
@MasudHusain @UniofOxford If you try booking hotels you will find sometimes it can be as much as double the cost through Oxford’s booking site compared to booking online!
Booked a conference hotel. Travel agency @UniofOxford quoted 11% more than if I booked it myself. Decided to do that anyway but need to show University that travel agency quote was higher. Madness! Let's increase admin burden and ensure that we and our funders get screwed over.
@tyrell_turing, @KordingLab and @SaxeLab, thought y'all might find this interesting!!
super excited to see @adamimos rocking out in his new gig with this super cool application of computational mechanics for understanding representational structure in transformers! lesswrong.com/posts/gTZ2Sxes…
My new preprint attempts to explain the function of interneuron diversity in the fly visual system. The answer (or at least the beginning of it) falls in your lap once you have the connectome. biorxiv.org/content/10.110…
Congrats to Prof Andrew Saxe (@SaxeLab), joint SWC/@GatsbyUCL PI, and collaborators at @unicomplutense @Wellesley & Martin Luther University Halle-Wittenberg, on their @HFSP grant covering research on the emergence of collective intelligence. 🎉 Read more sainsburywellcome.org/web/research-n…
Reviewers / meta reviewers: this is an example of what NOT to do. Isolating the simplest possible failure modes of complex models is a worthwhile contribution - as is (in other cases) deriving the simplest possible model of a phenomenon that makes testable predictions.
Here is a meta-review we got for third submission of a paper that aims to study text-understanding capacities of LLMs, focusing on very simple, if not trivial, cases where they systematically fail. We see every stated weakness as a strength, and they are all by design.
Research in probably the most important feature in transformers (and LLMs) -- how in context learning emerges as we scale up.
In-context learning (ICL) circuits emerge in a phase change... Excited for our new work "What needs to go right for an induction head (IH)?" We present "clamping", a method to causally intervene on dynamics, and use it to shed light on IH diversity + formation. Read on 🔎⏬
Super cool paper on ICL, and using "artificial optogenetics" to probe induction head formation!
In-context learning (ICL) circuits emerge in a phase change... Excited for our new work "What needs to go right for an induction head (IH)?" We present "clamping", a method to causally intervene on dynamics, and use it to shed light on IH diversity + formation. Read on 🔎⏬
Thrilled to share a review on THE LANGUAGE NETWORK AS A NATURAL KIND—a culmination of ~20 yrs of thinking about+studying language from linguistic, psycholinguistic, and cog neuro perspectives. @NatRevNeurosci rdcu.be/dEylV With the amazing @neuranna @tamaregev 🥳 🧵1/n
Introducing Dr. Peter Vincent to the world -- Lab's First-Ever PhD Graduate, who successfully passed his viva yesterday! Sincere thanks to the examiners @smfleming & @BaysLab! It's been a blast working w Peter & Maneesh Sahani (co-adviser). Stay tuned to read Peter's work soon!
Check out our new paper using neuroscience-inspired methods to study in-context learning circuits in transformers 🧠 Amazing job by @Aaditya6284 leading the project!
In-context learning (ICL) circuits emerge in a phase change... Excited for our new work "What needs to go right for an induction head (IH)?" We present "clamping", a method to causally intervene on dynamics, and use it to shed light on IH diversity + formation. Read on 🔎⏬
Huge shoutout to my amazing collaborators: @ted_moskovitz, @FelixHill84, @scychan_brains, @SaxeLab. Check out the full paper at arxiv.org/abs/2404.07129. And stay tuned for what's next: understanding why these circuits fade away during transience! (10/10)
In-context learning (ICL) circuits emerge in a phase change... Excited for our new work "What needs to go right for an induction head (IH)?" We present "clamping", a method to causally intervene on dynamics, and use it to shed light on IH diversity + formation. Read on 🔎⏬
I wish I could join this a second time - last year’s summer school was great, I can highly recommend it!
Excited to announce the 2nd Analytical Connectionism summer school! How can we mathematically understand neural network models of higher level cognition? Where: @FlatironCCN, New York When: Aug 12-23, 2024 Info: events.simonsfoundation.org/event/e070287e… Apply by May 17, travel awards available!