Robert Kirk @_robertkirk
Research Scientist at @AISecurityInst; PhD Student @ucl_dark. LLMs, AI Safety, Generalisation; @Effect_altruism robertkirk.github.io Joined January 2020-
Tweets384
-
Followers1K
-
Following285
-
Likes618
Robert Kirk retweeted
Excited to share details on two of our longest running and most effective safeguard collaborations, one with Anthropic and one with OpenAI. We've identified—and they've patched—a large number of vulnerabilities and together strengthened their safeguards. 🧵 1/6
8
63
292
52K
121
Download Image
Robert Kirk retweeted
New blog! We @AISecurityInst partnered with @NCSC to write about an emerging practice I'm really excited about: Safeguard Bypass Bounty Programmes (SBBPs). Summary of what these are, why they are useful, & how to do them well 🧵
Robert Kirk retweeted
Since I started working on safeguards, we've seen substantial progress in defending certain hosted models, but less progress in measuring & managing misuse risks from open weight models. Three directions I want explored more, drawn from our @AISecurityInst post today 🧵
Robert Kirk retweeted
🚨Open-weight AI models are becoming more powerful, now knocking on the door of today’s closed-weight frontier. This poses critical safety challenges – how can we prevent the misuse of models whose parameters are free to download online? 🧵
Jim Fan @DrJimFan
327K Followers 3K Following NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Edward Grefenstette �... @egrefen
42K Followers 866 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Laura Ruis @LauraRuis
6K Followers 754 Following PhD with @_rockt and @egrefen. Inc. postdoc with @jacobandreas @MIT_CSAIL. Anon feedback: https://t.co/sbebAl53tU
Roberta Raileanu @robertarail
9K Followers 2K Following Senior Staff Research Scientist @GoogleDeepMind & Honorary Lecturer @UCL. ex @Meta|@MSFTResearch|@NYU|@Princeton. Llama-3, Toolformer, Rainbow Teaming, MLGym.
Tim Rocktäschel @_rockt
40K Followers 2K Following Director and Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope.
Minqi Jiang @MinqiJiang
6K Followers 880 Following
Nathan Lambert @natolambert
57K Followers 857 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Bam4d @Bam4d
3K Followers 1K Following AI Scientist at https://t.co/SUcb0CBcb7. PhD in AI. Inference Wizardry. ex. @MetaAI @modl_ai
Michael Dennis @MichaelD1729
4K Followers 812 Following Open-Endedness RS @GoogleDeepMind. Building for an unspecifiable world | Unsupervised Environment Design, Game&Decision Theory, RL, AIS. prev @CHAI_Berkeley
Pasquale Minervini @PMinervini
9K Followers 5K Following Research in ML/NLP at the U of Edinburgh (tenured faculty @InfAtEd @EdinburghNLP), Co-Founder @Miniml_AI, @ELLISforEurope Scholar, https://t.co/5dUI3EFexo
Miles Brundage @Miles_Brundage
62K Followers 12K Following AI policy researcher, wife guy in training, fan of cute animals and sci-fi, Substack writer, stealth-ish non-profit co-founder
Jack Parker-Holder @jparkerholder
9K Followers 778 Following Co-lead of Genie 3 @GoogleDeepMind & Honorary Associate Professor @UCL_DARK. Dad (👶🐶), CFC fan, BJJ. Views are my own :)
David Krueger @DavidSKrueger
18K Followers 4K Following AI professor. Deep Learning, AI alignment, ethics, policy, & safety. Formerly Cambridge, Mila, Oxford, DeepMind, ElementAI, UK AISI. AI is a really big deal.
Chris Lu @_chris_lu_
4K Followers 624 Following Research @OpenAI Prev: DPhil Student @UniofOxford, RS Intern @SakanaAILabs @DeepMind and RS @CovariantAI
Ethan Caballero @ethanCaballero
11K Followers 2K Following ML @Mila_Quebec ; previously @GoogleDeepMind
UCL DARK @UCL_DARK
4K Followers 197 Following UCL Deciding, Acting, and Reasoning with Knowledge (DARK) Lab at @AI_UCL led by @_rockt, @egrefen, @robertarail, and @jparkerholder.
akbir. @akbirkhan
2K Followers 1K Following
Zhengyao Jiang @zhengyaojiang
4K Followers 421 Following Cofounder & CEO @WecoAI. Automating hill climbing with AI-Driven Exploration (AIDE). PhD in Machine Learning @UCL_DARK. (Zheng=j-uhng, j as in job; yao=y-aoww)
Tomek Korbak @tomekkorbak
2K Followers 564 Following senior research scientist @AISecurityInst | previously @AnthropicAI @nyuniversity @SussexUni
Jacob Beck @jakeABeck
354 Followers 110 Following Let’s get agents to learn fast! 🤖🔥 Research Scientist @Oracle | PhD @UniOfOxford, MS & BS @BrownUniversity, Predoc @Microsoft
Elena @Elena9857860688
0 Followers 104 Following
Monica Dahiya @mon_dahiya
615 Followers 893 Following Frontier AI Security Policy @scitechgovuk /@AISecurityInst
Ekin @ekinomicss
214 Followers 292 Following borrowed stardust, technical staff @AISecurityInst, 👩💻🕊️🚴🏼♀️☕️🏔️🌳🐱🎬📚
Maxim Von Tarnow (tes... @yaponamat
62 Followers 1K Following Hinter jeder Tür, wo d nit uffmache söttsch, ligt öbbis, wo uf di wartet.
Chandler Smith @ChandlerDSmith
154 Followers 803 Following Multi-Agent Safety Researcher | Cooperative AI Foundation | Technical Architect Fellow at IQT | LFC Fan
Rodrigo Alves Vieira @RodrigoAVieiraX
4 Followers 92 Following
Visual-Intelligence @VI_Journal_CSIG
141 Followers 2K Following Official journal of China Society of Image and Graphics (CSIG). The jouarnl is published by Springer, sponsored by CSIG. E-ISSN 2731-9008.
Sam Lewis-Lim @samlewislim
9 Followers 239 Following PhD student doing NLP @ University of Sheffield.
Matthew Henty @matthewhenty
295 Followers 2K Following
mRr3b00t @UK_Daniel_Card
114K Followers 8K Following Department of Cyber WAR CEO of everyone's email servers!
Tara Makara @queenie_sunday
420 Followers 3K Following CyberSec, Art & Nature Loving, Cheese Mourning Yam Yam Queenie Sunday | Flickr https://t.co/iu33I1cuM7
Daniel Cuthbert @dcuthbert
32K Followers 2K Following Documentary photographer, old creaky hacker. Co-author of @OWASP ASVS standard. Blackhat/Brucon Review Board & Co_chair UK Gov Cyber Security Advisory Board
Jon @ElfordJon
279 Followers 921 Following
Haydn Belfield @HaydnBelfield
5K Followers 2K Following Research Scientist (Frontier Planning) at @GoogleDeepMind. Research Affiliate @Cambridge_Uni @CSERCambridge & @LeverhulmeCFI. All views my own.
Alex Borshik @AlexBorshik
107 Followers 713 Following
Maksym Andriushchenko @maksym_andr
5K Followers 905 Following Faculty at @ELLISInst_Tue & @MPI_IS, leading the AI Safety and Alignment group. PhD from @EPFL supported by Google & OpenPhil PhD fellowships.
云创兽Ai @Flieber638646
1 Followers 93 Following 💸 tracking Nasdaq trends is my vibe, says this brave girl! open to insights. DM me about GDP growth! 💬 #Finance #Wealth
Manfred Diaz @linuxpotter
559 Followers 1K Following Ph.D. Candidate @Mila_Quebec interested in AI/ML connections with economics, game theory, and social choice theory.
Ryan Remmel @ryan_remmel
26 Followers 698 Following
Grzegorz Pohorecki @gregpoho
7 Followers 158 Following
George Gor @ggomondi
1K Followers 2K Following Many things AI @thefuturesoc & @Cambridge_Uni. Fundani, sebenzani, nizimele✨Views my own
Matthew Clarke @Matthew05049818
0 Followers 3K Following
Matt Kilcoyne @MRJKilcoyne
13K Followers 8K Following Policy. Tech. Data. AI. Trade. Housing. Migration. Caledonian, Cheshire/Clwyd border. British. Live, Laugh, Love!
Illy G. @illyG1111
117 Followers 416 Following Hacking SEO as Director for https://t.co/JJSjby3RSM. Speaking on the topics in SEO, crypto, AI. A queer techie + Coffee Geek ☕️
Sumaya Nur @SumayaNur_
2K Followers 670 Following Law| AI governance| Department of Science Innovation & Technology
New Scientists @awards67811
147 Followers 7K Following Research work, Innovation, exemplifying creativity, impact, and a vision for a better future. #nscawards #phd #researcher website: https://t.co/LlgGrYt7X8
🇺🇸@jason is Elo... @mcnultydigital
444 Followers 7K Following All-In Podcast Bro. 🇺🇸 Patriot with grit and no skill issues. 1st iPhone owner. Genius. Parody.
waleedsial @JrWaleedsial
396 Followers 7K Following Senior Analyst @ GoldmanSachs - Alum @UT_Dallas, @FastNU_Official, @jindal_utdallas
Amirmahdi Sadeghzadeh @amsadeghzadeh
6 Followers 101 Following Assistant Prof. @ Sharif UT / Trustworthy and Secure AI / Blockchain.
Models Matrices @MatricesLayers
178 Followers 4K Following
Martim Cruz @martimC11
500 Followers 621 Following Founding Data Scientist, quantifying AI risk @testudoinsure | 🇵🇹 between SF and London
Ayla Croft @aylacroft
3K Followers 1K Following ```move 37 ``` | samy is my hero | the world is forked | i groom & gaslight llms | #ff0000 team
Varsha Bansal @VarshaaBansal
6K Followers 5K Following Independent journalist. Writes on tech & society. Knight-Bagehot Fellow ‘25 at @columbia. Bylines: @TIME, @wired, @techreview, @AJEnglish, @restofworld
@[email protected]... @EdHenry_
2K Followers 1K Following Things I like : Mathematics, Machine Learning, Causality, Networks, and Philosophy.
Ben Murphy @benjaminmmurphy
176 Followers 855 Following 2L @Harvard_Law, previously Summer Fellow @GovAI_, eng. at @InflectionAI, @SubstackInc, SRE @Google, @BrownUniversity.
Yixiong Hao @Yixiong_Hao
398 Followers 1K Following cs @GeorgiaTech | strong preference for aligned AI | co-director @ https://t.co/pJCxjv7GWv | prev @startupxchange
AISecHub @AISecHub
4K Followers 4K Following 🚀 AISecHub | AI & Cybersecurity | Discussing AI-driven threats, securing AI systems, and sharing insights on emerging challenges 💡
Reg Saddler @zaibatsu
445K Followers 166K Following Systems architect. Bridging strategy, #AIresearch and #cybersecurity for next-gen, human-aligned tech. Designing for impact, resilience, & trust.
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
Sergey Levine @svlevine
110K Followers 133 Following Associate Professor at UC Berkeley Co-founder, Physical Intelligence
Edward Grefenstette �... @egrefen
42K Followers 866 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
Laura Ruis @LauraRuis
6K Followers 754 Following PhD with @_rockt and @egrefen. Inc. postdoc with @jacobandreas @MIT_CSAIL. Anon feedback: https://t.co/sbebAl53tU
Natasha Jaques @natashajaques
31K Followers 1K Following Assistant Professor @uwcse and Staff Research Scientist at @GoogleAI. Let's get off this app: https://t.co/jbH2oAjbPN
Roberta Raileanu @robertarail
9K Followers 2K Following Senior Staff Research Scientist @GoogleDeepMind & Honorary Lecturer @UCL. ex @Meta|@MSFTResearch|@NYU|@Princeton. Llama-3, Toolformer, Rainbow Teaming, MLGym.
Tim Rocktäschel @_rockt
40K Followers 2K Following Director and Open-Endedness Team Lead @GoogleDeepMind, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope.
Minqi Jiang @MinqiJiang
6K Followers 880 Following
Anthropic @AnthropicAI
646K Followers 35 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
Nathan Lambert @natolambert
57K Followers 857 Following Figuring out AI @allen_ai, open models, RLHF, fine-tuning, etc Contact via email. Writes @interconnectsai Wrote The RLHF Book Mountain runner
Bam4d @Bam4d
3K Followers 1K Following AI Scientist at https://t.co/SUcb0CBcb7. PhD in AI. Inference Wizardry. ex. @MetaAI @modl_ai
Michael Dennis @MichaelD1729
4K Followers 812 Following Open-Endedness RS @GoogleDeepMind. Building for an unspecifiable world | Unsupervised Environment Design, Game&Decision Theory, RL, AIS. prev @CHAI_Berkeley
Neel Nanda @NeelNanda5
32K Followers 123 Following Mechanistic Interpretability lead DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!
Felix Hill @FelixHill84
12K Followers 742 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else's
Marc G. Bellemare @marcgbellemare
16K Followers 349 Following CSO & co-founder, Reliant AI. Ex RL research lead at Google Brain, DeepMind. Known for Atari 2600 RL benchmark, Distributional RL (MIT Press 2023).
Miles Brundage @Miles_Brundage
62K Followers 12K Following AI policy researcher, wife guy in training, fan of cute animals and sci-fi, Substack writer, stealth-ish non-profit co-founder
Sophie Rose @SophieMRose_
543 Followers 383 Following Chem-Bio @AISecurityInst | formerly @longresilience @JHSPH_CHS @JohnsHopkinsSPH @Stanford
Jonas Sandbrink @JonasSandbrink
984 Followers 586 Following Strategic Awareness at UK AISI; AI; Biosecurity
Pebble @Pebble
74K Followers 529 Following Wearables with brains for people with heart. Turn tiny moments of awesome into the best times ever. Tell the world how you #MakePebbleYours ❤️
Boaz Barak @boazbaraktcs
24K Followers 600 Following Computer Scientist. See also https://t.co/EXWR5k634w . @harvard @openai opinions my own.
Reuben Adams @ReubenJAdams
42 Followers 137 Following PhD student in AI at UCL. Statistical learning theory.
Ilia Shumailov🦔 @iliaishacked
3K Followers 792 Following Now: @aisequrity, Past: {Senior Scientist @GoogleDeepMind, JRF @ChCh_Oxford @UniofOxford, Fellow @VectorInst, PhD @Cambridge_Uni}
Simon Willison @simonw
117K Followers 6K Following Creator @datasetteproj, co-creator Django. PSF board. Hangs out with @natbat. He/Him. Mastodon: https://t.co/t0MrmnJW0K Bsky: https://t.co/OnWIyhX4CH
Avi Schwarzschild @A_v_i__S
898 Followers 247 Following Trying to learn about deep learning faster than deep learning can learn about me.
Matthew Yglesias @mattyglesias
549K Followers 2K Following Slow Boring, cohosting https://t.co/wxUj3JFSFf, Bloomberg columnist
Micah Carroll @MicahCarroll
1K Followers 688 Following AI PhD student @berkeley_ai /w @ancadianadragan & Stuart Russell. Working on AI safety ⊃ preference changes/AI manipulation.
Joshua Clymer @joshua_clymer
2K Followers 118 Following Turtle hatchling trying to make it to the ocean. I work at Redwood Research.
Benjamin Hilton @benjamin_hilton
3K Followers 857 Following Head of Alignment at the UK AI Security Institute (AISI). Semi-informed about economics, physics and governments. views my own
Will Kirby @wk1rby
219 Followers 536 Following UK AISI's alignment team. Views my own. sand god doula.
Lorenz Breidenbach @ethlorenz
2K Followers 468 Following Yak Shaver and Security Researcher. Head of Research&Development at Chainlink Labs. Formerly at 🇨🇭 ETH Zürich, 🗽 Cornell Tech,⛓️ IC3.
Ryan Greenblatt @RyanPGreenblatt
6K Followers 4 Following Chief scientist at Redwood Research (@redwood_ai), focused on technical AI safety research to reduce risks from rogue AIs
Asa Cooper Stickland @AsaCoopStick
1K Followers 909 Following I test language models @ the UK AI Security Institute
Tom Davidson @TomDavidsonX
1K Followers 239 Following Senior Research Fellow @forethought_org Understanding the intelligence explosion and how to prepare
Steven Adler @sjgadler
9K Followers 773 Following Ex-OpenAI safety researcher (danger evals & AGI readiness), https://t.co/XtUTLK3jEo. Likes maximizing benefits and minimizing risks of AI
Erik Jenner @jenner_erik
917 Followers 152 Following Research scientist @ Google DeepMind working on AGI safety & alignment
Yi Xu @_yixu
518 Followers 422 Following AI researcher, interested in LLMs and reinforcement learning | Previously @UCL_DARK, @imperialcollege, @UniMelb
Haydn Belfield @HaydnBelfield
5K Followers 2K Following Research Scientist (Frontier Planning) at @GoogleDeepMind. Research Affiliate @Cambridge_Uni @CSERCambridge & @LeverhulmeCFI. All views my own.
Ryan Kidd @ryan_kidd44
2K Followers 1K Following Co-Executive Director @MATSprogram, Co-Founder @LondonSafeAI, Regrantor @Manifund | PhD in physics | Accelerate AI alignment + build a better future for all
Max Nadeau @MaxNadeau_
1K Followers 526 Following Funding research to make AIs more understandable, truthful, and dependable at @open_phil.
Lorenz Wolf @lorenz_wlf
55 Followers 217 Following PhD student in Foundational AI @ucl @ai_ucl @uclcs Enrichment Fellow @turinginst 2x ML Research Intern at Apple working on Differential Privacy
Evžen Wybitul @evzen_wy
262 Followers 783 Following Incoming AI safety and technical AI governance DPhil @UniofOxford • MSc in AI at ETH Zurich • 2x @MATSprogram • Talos AI Governance Fellowship • 🇪🇺🇨🇿
Marie Davidsen Buhl @MarieBassBuhl
238 Followers 96 Following Research Scientist @AISecurityInst| AI Policy Researcher @GovAI_ | Frontier AI Safety Cases
Jasmine @j_asminewang
7K Followers 1K Following alignment @OpenAI. past @AISecurityInst @verses_xyz @kernel_magazine @readtrellis @copysmith_ai
Dylan HadfieldMenell @dhadfieldmenell
4K Followers 2K Following Associate Prof @MITEECS working on value (mis)alignment in AI systems; @[email protected]; he/him
Hyrum Anderson @drhyrum
3K Followers 1K Following CTO at Robust Intelligence. Formerly, Microsoft, Endgame/Elastic, Mandiant/FireEye, Sandia & MIT Lincoln Labs. 'He who forgives ends the quarrel'
Ben Edelman @EdelmanBen
426 Followers 51 Following trying to see through context windows currently: agent security lead @ U.S. Center for AI Standards and Innovation past: science of deep learning phd @ harvard
Chris Arnade 🐢🐱... @Chris_arnade
92K Followers 3K Following Walking the world, one city at a time. I like turtles, cats, & buses. Subscribe to my Substack: https://t.co/j6mE4TVfBl
Séb Krier @sebkrier
13K Followers 7K Following 🪼 AGI policy dev lead @GoogleDeepMind | rekkid junkie, dimensional glider, deep ArXiv dweller, interstellar fugitive, uncertain | 🛸
David Chanin @chanindav
102 Followers 207 Following
Naomi Saphra @nsaphra
10K Followers 1K Following Waiting on a robot body. All opinions are universal and held by both employers and family. Now a dedicated grok hate account. Accepting ML/NLP PhD students.
Yo Shavit @yonashav
7K Followers 963 Following policy for v smart things @openai. Past: CS PhD @HarvardSEAS/@SchmidtFutures/@MIT_CSAIL. Tweets my own; on my head be it.
Rootclaim @Rootclaim
5K Followers 167 Following Settle controversies using real-world data and math. Calculating reality the way no human can.
Yarin @yaringal
41K Followers 246 Following Professor of Machine Learning, University of Oxford @OATML_Oxford Group Leader Director of Research at the UK govt's AI Security Institute (AISI)
Matt Clifford @matthewclifford
33K Followers 2K Following Co-founder @join_ef; Chair @ARIA_Research; UK AI
michael vassar @HiFromMichaelV
5K Followers 169 Following ZOG in exile. Alpha Midwit. The most ironic outcome is the most likely. Reducing the irony is my job. There is no antimemetics division
Ben Landau-Taylor @benlandautaylor
13K Followers 24 Following Investigating power, society, and industry. Please don't get your ought all over my is.
Aella @Aella_Girl
240K Followers 394 Following survey artist, too earnest. FDA delenda est. https://t.co/IcEgPhVD3o
Transluce @TransluceAI
8K Followers 15 Following Open and scalable technology for understanding AI systems.Trends for United States
78,1 B posts
29,6 B posts
32,9 B posts
40,6 B posts
5.036 posts
9.412 posts
3.260 posts
2.622 posts
29 B posts
6.356 posts
4.921 posts
4.628 posts
1.119 posts
2.707 posts
1.049 posts
77,8 B posts
4.355 posts
1.547 posts
2.060 posts
4.654 posts
You might like
UCL DARK
@UCL_DARK
4K Followers
Danijar Hafner
@danijarh
22K Followers
Ben Eysenbach
@ben_eysenbach
5K Followers
Jack Parker-Holder
@jparkerholder
9K Followers
Jakob Foerster
@j_foerst
21K Followers
Rishabh Agarwal
@agarwl_
17K Followers
Abhishek Gupta
@abhishekunique7
9K Followers
raia hadsell
@RaiaHadsell
9K Followers
Nathan Lambert
@natolambert
57K Followers
Roberta Raileanu
@robertarail
9K Followers
Joseph Suarez 🐡
@jsuarez5341
17K Followers
Amy Zhang
@yayitsamyzhang
4K Followers
Bam4d
@Bam4d
3K Followers
Michael Dennis
@MichaelD1729
4K Followers
Eugene Vinitsky (@RLC...
@EugeneVinitsky
21K Followers