If anyone has any advice, opportunities or feedback it would be greatly appreciated, opportunities like BlueDot, SPAR, MATs, ARENA, METR etc are on my radar but I feel far from ready, any direction would be appreciated.
DMs open. #AISafety#MechanisticInterpretability
Doing AI safety here and there in my spare time outside my job no longer feels enough, in light of pivoting my career I've taken the straightfoward route of replicating and extending existing work.
devalexau.com/blog/role-conf…
Would love advice and feedback!
Thread:
#AIsafety
In this preliminary evaluation, clear malicious tool-call attempts fell from 9.5% to 4.9%.
The work is very early and very limited, I am currently working on a followup with a docker sink to emulate tool calling rather than an LLM judge of output, giving a more binary measure.
Prompt injection may partly be a role-confusion problem: untrusted tool content can become represented more like a user instruction inside the model.
I wanted to test whether we could intervene directly on that representation.
29K Followers 506 FollowingHelping the world prepare for powerful AI. Risk assessment @METR_evals (opinions my own). Blogs: Planned Obsolescence (AI), Good Bones (whatever's on my mind).
143K Followers 335 FollowingAI research @AnthropicAI. Previously OpenAI & DeepMind.
Optimizing for a post-AGI future where humanity flourishes.
Opinions aren't my employer's.
67K Followers 871 FollowingExplaining AI Alignment to anyone who'll stand still for long enough, on YouTube and Discord.
Music, movies, microcode, and high-speed pizza delivery
20K Followers 558 Following@MIRIBerkeley. If we build opaque superhuman AIs, it's likely to get us killed. The least-bad solution is an international agreement like https://t.co/BsSp5beZhp.
1.8M Followers 2 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
244K Followers 101 FollowingThe original AI alignment person. Understanding the reasons it's difficult since 2003.
This is my serious low-volume account. Follow @allTheYud for the rest.
50K Followers 126 FollowingMechanistic Interpretability lead DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!