1,087 papers in, 16 out.
This week: DPO was never built for how language models actually generate text; and three separate teams just found the same blind spot.
The research worth reading →
castromac.substack.com/p/the-drop-iss…
AI sovereignty is becoming an enterprise priority.
Trust, control and visibility over AI systems are no longer just technical concerns, they’re strategic ones ↓ x.com/i/article/2105…
Next stop for Sovrano: @COLM_conf 2026.
We’re heading to San Francisco to spend a week with researchers and teams working at the frontier of AI.
Find @SovranoAI at our booth, or message us to grab a coffee ;)
We’re travelling 9,500 km from Barcelona to SF to attend @COLM_conf 2026 next week.
We’ll have our own booth, a few activities to put your AI judgement to the test, and some gifts waiting for you!
And if you’d like to grab a coffee and chat during the conference contact via DM ☕
See you in SF!
WE'RE HIRING!!
3 roles open in Barcelona:
→ Project Lead: goo.su/q6oXu
→ Talent Ops & Community Associate: goo.su/M6eDNX
→ University Partnerships Associate: goo.su/ZGhqj
We’re moving fast, working on ambitious AI projects, and looking for people who want to take real ownership as we grow. We want to know you!!
the best conversations happen after the talks, around a table
so we're doing that on purpose. People behind AI, by @SovranoAI
madrid, this thursday. limited seats.
building or researching AI in madrid and want one? dms open
When I started Sovrano AI, the idea was simple:
What if people with real expertise had a bigger role in how AI gets built?
A lot has happened since then. So with many new people here, it feels like a good time to go back to the beginning.
This is Sovrano AI 👀 let's make Europe sovereign 💡
People Behind AI is coming to Madrid!!! 🥘
Good food. Good conversations. And a table full of people shaping AI.
Want a seat at the table? DM @marinaalvaro7 🤝
Lots of new faces here lately 👀 So, hi again. We’re Sovrano AI
Here’s what we do, why we do it, and where you come in!!
Let’s make Europe sovereign.
#ai#sovranoai#artificialintelligence#aievaluation #futureofai
930 papers in, 15 out.
This week: one uncomfortable finding: your benchmark may be measuring your annotators
The research worth reading →
castromac.substack.com/p/the-drop-iss…
What does “better model performance” actually mean?
In EuroExec, 6 frontier models were evaluated across 413 real-world executive questions by 47 domain experts using rubrics, checklists and preference ranking.
The leaderboard is the output. The evaluation methodology is what gives it meaning.
What makes a good benchmark actually good?
At @AISummitBCN we put it to the test.
Participants built evaluation rubrics, tested them against model outputs and compared how human judgement changes the way we measure AI performance.
Good benchmarking starts with good evaluation!!
Hiii we are the people behind Sovrano 👋
Turns out getting the whole team in front of a camera at the same time is harder than it looks, but we made it happen!
Follow us & stick around!
494 Followers 5K FollowingWe help our clients harness the power of data, analytics, #language, culture, and technology to achieve their global business and security objectives. #t9n #1nt
77 Followers 357 FollowingMANCHESTER UNITED 🤍❤️. Graduate Surving on Betting !
🔞 Come let's discuss football ⚽️ | Football news| Transfer | highlights ⚽️♥️
21K Followers 1K FollowingHelping people earn online 🌍
Remote Jobs • AI Work • Testing
📩 Open for promotions & partnerships
Join Telegram 👇
https://t.co/Imud9YFPIW�
120 Followers 53 FollowingEurope's most actionable AI event. 10,000+ builders, founders & investors. Barcelona, Sep 16–23, 2026. Where AI stops being theory and starts moving.
245 Followers 1K FollowingCEO @SovranoAI. 400+ universities. 500k+ professionals. 20+ languages. Building the European human evaluation data layer: robotics, RL plus more.
75K Followers 1K FollowingArmin's handler at https://t.co/B05ybKGkzx. Old man yelling at Claudes.
https://t.co/Q1wG57v1yc
https://t.co/mnOoWUr0TO
https://t.co/8i5vIRE0Wn
15K Followers 510 FollowingFounder, CEO @LightningAI, PyTorch Lightning⚡, Former USN, AI PhD student (pretraining, researcher) @AIatMeta @CILVRatNYU w @kchonyc @ylecun
20K Followers 338 FollowingBuilding AI that learns by interacting with the world. Associate Professor @ MIT, leading the Scene Representation Group (https://t.co/h5gvhLYZj4).
44K Followers 267 FollowingProfessor of Machine Learning, University of Oxford
@OATML_Oxford Group Leader
Expert Advisor to AISI
"One of the top machine-learning people" - Tim Berners-Lee
38K Followers 24 FollowingProfessor of machine learning at the University of Cambridge. Opinions are my own. Author of "The Atomic Human"
Mainly found on @lawrennd.bsky.social
84K Followers 1K Followingdon’t mind me… just hanging with my friends building this paper from 1968 https://t.co/jgTRdB3ueG
@openminedorg @GoogleDeepMind @OxfordUni
50K Followers 2K FollowingTeaching AI the joy of invention at @Recursive_SI, Professor of AI @AI_UCL, PI @BOLD_Lab_AI, Fellow @ELLISforEurope. Ex @GoogleDeepMind @AIatMeta @CompSciOxford
16K Followers 944 FollowingSenior Director & RS @Meta + Visiting Prof NYU | OG in LLMs | Pretrain+Finetune in 2008+ | 155k+ citations | Current: Self-Improving & Co-Improving AI
79K Followers 14K FollowingAI policy researcher, @lfschiavo wife guy, Executive Director of @AVERIorg, Substacker, fan of animals and sci-fi, views my own
12K Followers 739 FollowingResearch Scientist, Deepmind
I try to think hard about everything I tweet, esp on 90s football and 80s music
None of my opinions are really someone else's
32K Followers 231 Followingscaling @ Nemotron
getting us to singularity with friends | angel
computers can be understood: https://t.co/doHE1Quv2L
x founder, @GoogleDeepMind @Microsoft