carlos @_carlosejimenez
i like ai, philosophy, and politics carlosejimenez.com San Francisco, CA Joined May 2019-
Tweets337
-
Followers1K
-
Following359
-
Likes7K
Accepted to #NeurIPS2025! Big shoutout to our ~120 participants, who graciously allowed me to pester them daily with reminder emails, bug fixes, and troubleshooting queries 😓
Accepted to #NeurIPS2025! Big shoutout to our ~120 participants, who graciously allowed me to pester them daily with reminder emails, bug fixes, and troubleshooting queries 😓
Deepseek v3.1 chat scores 53.8% on SWE-bench verified with mini-SWE-agent. Tends to take more steps to solve problems than others (flattens out after some 125 steps). As a result effective cost is somewhere near GPT-5 mini. Details in 🧵
What if your agent uses a different LM at every turn? We let mini-SWE-agent randomly switch between GPT-5 and Sonnet 4 and it scored higher on SWE-bench than with either model separately. Read more in the SWE-bench blog 🧵
At the end of the day, the SWE-bench leaderboard on swebench dot com is probably the most clear description of current model performance on this benchmark. No "verified" subset, limited tool use (bash only), most scaffolding is open to see. In this benchmark, the Claude 4 Opus…
We evaluated the new GPT models with a minimal agent on SWE-bench verified. GPT-5 scores 65%, mini 60%, nano 35%. Still behind Opus 5 (68%), on par with Sonnet 4 (65%). But a lot cheaper, especially mini! Complete cost breakdown + details in 🧵
Incredible to see the progress in Offensive Cybersecurity benchmarks!
Incredible to see the progress in Offensive Cybersecurity benchmarks!
Play with gpt-5 in our minimal agent (guide in the 🧵)! gpt-5 really wants to solve anything in one shot, so some prompting adjustments are needed to have it behave like a proper agent. Still likes to cram in a lot into a single step. Full evals tomorrow!
.@_carlosejimenez updated the SWE-bench [Bash only] leaderboard with Qwen3 numbers. Congrats to the team on the great results! Note that these numbers are about 10% lower than the max numbers achievable by each model since we don't allow tools in this leaderboard.
.@_carlosejimenez updated the SWE-bench [Bash only] leaderboard with Qwen3 numbers. Congrats to the team on the great results! Note that these numbers are about 10% lower than the max numbers achievable by each model since we don't allow tools in this leaderboard. https://t.co/oQOnajNjFw
Releasing mini, a radically simple SWE-agent: 100 lines of code, 0 special tools, and gets 65% on SWE-bench verified! Made for benchmarking, fine-tuning, RL, or just for use from your terminal. It’s open source, simple to hack, and compatible with any LM! Link in 🧵
LMs had a really tough time playing real video games from the 90s- so we made a suite of 3 simple games to test specific abilities, including drag-and-dropping, and navigating a maze using the arrow keys. Even on these *extremely* simple games, most frontier LMs fail. Results-->
LMs had a really tough time playing real video games from the 90s- so we made a suite of 3 simple games to test specific abilities, including drag-and-dropping, and navigating a maze using the arrow keys. Even on these *extremely* simple games, most frontier LMs fail. Results-->
SWE-agent is now Multimodal! 😎 We're releasing SWE-agent Multimodal, with image-viewing abilities and a full web browser for debugging front-ends. Evaluate your LMs on SWE-bench Multimodal or use it yourself for front-end dev. 🔗➡️
Join me next week at #ICML25, where I will be presenting my first first-author paper –– EnIGMA. EnIGMA, an LM agent for cybersecurity, uses interactive tools for server connection and debugging, achieving state-of-the-art on 3 CTF benchmarks. youtube.com/watch?v=50zkWJ…
Andre Niyongabo Rubun... @andre_niyongabo
476 Followers 722 Following CS PhD Candidate @Vertaix_ @Princeton | Previously @IBMResearch, @MetaAI, @Huawei & @WhaleCloud2 | Studied @la_UPC & @UESTC1956 | Previously @MasakhaneNLP
Jun Heng Choo @futurerich527
1 Followers 28 Following
Zhang bm @Zhanyapeng9527
13 Followers 376 Following
Charles Foster @CFGeek
3K Followers 501 Following Excels at reasoning & tool use🪄 Tensor-enjoyer 🧪 @METR_Evals. My COI policy is available under “Disclosures” at https://t.co/bihrMIUKJq
thomas @xundecidability
835 Followers 442 Following
Muhammad Hammad Khan @hammad_khan23
857 Followers 6K Following Views are my own. Search & RecSys | LLM
Cade Gordon @CadeGordonML
2K Followers 845 Following Helping models grow wise @Anthropic | Hertz Fellow | Prev: LAION-5B & OpenCLIP @UCBerkeley
Guillaume @glebedel
194 Followers 1K Following Co-founder & CTO @StackOneHQ Integrations 🤝 LLMs https://t.co/QzCXnNLDPM / https://t.co/RJdVzX8O7R Hiring 👉 https://t.co/xUS9yS1nTb
Lakshya A Agrawal @LakshyAAAgrawal
2K Followers 2K Following AI PhD @ UC Berkeley | GEPA Creator (https://t.co/EdPqvzj7k4) | Created https://t.co/YxPZsXZJeS | Past: AI4Code Research Fellow @MSFTResearch | Hobbyist Saxophonist
120l3327 @120l3327
12 Followers 4K Following
davo @davoclavo
929 Followers 3K Following plants, agents, concurrency, embedded systems, robotics, rust, scala
rbd1990 @rbd_rbd1990
165 Followers 4K Following
Gretel, Vega. @Leaona4292
31 Followers 930 Following
Charlie London @CharlieLondon02
115 Followers 321 Following DPhil student in ML theory at Oxford, previously @QuantinuumQC. Learning theory, RL theory, LLMs. Arsenal fan.
Vadim Liventsev @vadimdotme
80 Followers 1K Following lead hip hop engineer @ https://t.co/y80r2iuMsN
Alexander Golubev @agolubev13
74 Followers 36 Following LLMs, RL and Agents Research Lead | @nebiusai
Joel Becker @joel_bkr
3K Followers 2K Following move fast and fix things @METR_evals. 'soccer'-me @MessiSeconds.
Shuyan Zhou @shuyanzhxyc
3K Followers 822 Following assistant professor @dukecompsci | past: research lead @AIatMeta computer use agent, phd @LTIatCMU
Raef Onevah @RaefOnevah
57 Followers 998 Following This moment is perfect and the next is a perfect mystery. Now is never and forever, so forget your beliefs and see. This is all I will ever be as I is not me.
Ibragim @ibragim_bad
214 Followers 146 Following eval coding agents on fresh github issues | rl environments | @nebiusai
Aryo Pradipta Gema @aryopg
1K Followers 2K Following AI Safety Fellow @Anthropic | PhD student @BioMedAI_CDT @EdinburghNLP @EdiClinicalNLP LLM Hallucinations | Clinical NLP | Opinions are my own.
Gary @garythung
3K Followers 951 Following engineering @ElectricCapital ⏺️ https://t.co/cQZkMJFxVi 🥬 https://t.co/yIkdHfPP6e
Frirdo @Frirdo8692
15 Followers 1K Following
Marv @marvsunglao
453 Followers 2K Following
juan manuel espinosa @juanmaes83
163 Followers 2K Following Publicidad, Marketing Digital y Comunicación
hon2838 @Mathew604
200 Followers 3K Following Just a normal Malaysian Twitter User interested with tech and international politics.
Aryaman Arora @aryaman2020
8K Followers 2K Following member of technical staff @stanfordnlp @TransluceAI
Bobby Bob @nsk7153
0 Followers 458 Following
Bukit 🇮🇩 🇵�... @bukitsorrento
264 Followers 2K Following NOW: Founder/CEO KRONIK® Lifestyle💈💇♀️ 🏪 🤖 Co-Founder/Former CTO Lingkar Ganja Nusantara 🌿
Kokko @pandekokko
8 Followers 158 Following Software Engineer currently building Ingenious (https://t.co/ZjHuvymGXU), Certified Yapper, Scale Model Enthusiast. Views are mine.
BeastTitanHunter @Titan1Beast
323 Followers 4K Following
Alpay Ariyak @AlpayAriyak
3K Followers 3K Following Post-Training Lead @ Together AI | OpenChat Project Lead (#1 7B LLM on Arena for 2+ months, 2M+ downloads) | DeepCoder, DeepSWE
Agung Tri Handoyo @agungthndyo
114 Followers 805 Following Listening 'Love You So Bad' - Ezra Furman 🎶🎧 | sukak kucing, sukak hujan, sukak jalan-jalan, dan pastinya sukak kamu 😺🌧️✈️❤️
shahid Hossain @deadshahid_help
1 Followers 51 Following
Joel Washington @joelwashington
1K Followers 5K Following Founder, Modern Talent (tech talent recruiting), Zero/Level (sold, ~$50m), Shift (went public, hit $1b rev & valuation). Fmr Pres., Belong SPAC (NASDAQ:BLNG)
Luke Pham @REMEMBER_70411
54 Followers 5K Following
Metis Kairos @MetisKairos
14 Followers 4K Following
Jamal Id Aissa 🇲�... @JAMALIDAISSA1
14 Followers 843 Following Finding joy in every line of code I write.
AZIZ @azizalto
422 Followers 5K Following Open source | Programming | Applied ML & AI | PhD CS | learn, get inspired, build, smile, repeat 🔁
hasanabi @hasanthehun
1.7M Followers 2K Following i stream everyday on https://t.co/8ITEAnynTB - tiktok+ig: hasandpiker // business: mailto:[email protected]
Deedy @deedydas
209K Followers 5K Following Partner @MenloVentures. Formerly founding team @glean, @Google Search. @Cornell CS. Tweets about tech, immigration, India, fitness and search.
Charles Foster @CFGeek
3K Followers 501 Following Excels at reasoning & tool use🪄 Tensor-enjoyer 🧪 @METR_Evals. My COI policy is available under “Disclosures” at https://t.co/bihrMIUKJq
Charlie London @CharlieLondon02
115 Followers 321 Following DPhil student in ML theory at Oxford, previously @QuantinuumQC. Learning theory, RL theory, LLMs. Arsenal fan.
Governor Newsom Press... @GovPressOffice
624K Followers 1K Following Official account for the press office of @CAGovernor Gavin Newsom #CaliforniaForAll
Joel Becker @joel_bkr
3K Followers 2K Following move fast and fix things @METR_evals. 'soccer'-me @MessiSeconds.
Garrison Lovely @GarrisonLovely
9K Followers 5K Following Writing a book on AI+economics+geopolitics for Nation Books. Bylines: @NYTimes, @Nature, @BBC, @Business, @Guardian, @TIME, @Verge, + others.
Angelina Wang @angeli... @ang3linawang
2K Followers 784 Following Asst Prof @CornellInfoSci, @Cornell_Tech | Responsible AI | Prev: @StanfordHAI @PrincetonCS @Berkeley_EECS
The Argument @TheArgumentMag
10K Followers 9 Following Join us. We're Libbing Out. Complaints to @JerusalemDemsas
Aryaman Arora @aryaman2020
8K Followers 2K Following member of technical staff @stanfordnlp @TransluceAI
Harry Sisson @harryjsisson
329K Followers 3K Following 23 | Democrat | @harryjsisson (1 million+) on Tik Tok | Email: [email protected]
Dean Withers @itsdeaann
485K Followers 34 Following modern american patriot | i stream daily on tiktok and youtube👇🏼
Paul Graham @paulg
2.1M Followers 779 Following
Dennis @dennizor
2K Followers 2K Following Novelty miner. Interface artist. Made https://t.co/rEhGneyKVD | https://t.co/OxhFFAd0Qr | https://t.co/d9FPvnyFkD | https://t.co/64m8sGVCyd
Populism Updates @PopulismUpdates
133K Followers 3K Following New, insurgent or international politics + commentary (also whatever I want to post about)
巴丢草 Bad ї ucao @badiucao
126K Followers 16K Following Chinese Australian artist/Award wining cartoonist for @theage @smh /Human rights Activist/DM for signed print & original art /New Book https://t.co/O7ZmTyt7h5
李老师不是你老... @whyyoutouzhele
2.1M Followers 989 Following 投稿私信 或：https://t.co/SwoJzv97eA 邮箱投稿： [email protected] 你看那通天的巨塔，每时每刻都有人往下跳。我小时候不懂，以为那是雪花。 加入我们的社区 https://t.co/OWEgUHVaqG
SwiftOnSecurity @SwiftOnSecurity
405K Followers 9K Following computer security person. former helpdesk.
SWE-bench @SWEbench
136 Followers 5 Following
Shaiel Ben-Ephraim @academic_la
78K Followers 13K Following All tremble at the rod, all fear death. Having drawn the parallel to oneself, one should not strike or kill others. Media inquiries: [email protected]
alex bronzini-vender @alexbronzini
6K Followers 635 Following freelance writer, studying history @harvard; alexanderbronzini at gmail dot com
YIMBY Democrats for A... @YIMBYDems
6K Followers 784 Following The Voice of Progressive Abundance. Build America. Defeat Fascism. Join us at YIMBY Democrats dot org.
Jess Coleman @jesskcoleman
6K Followers 735 Following 🗽 Lower Manhattan native ⚖️ Attorney & community advocate 🏙️ Fighting for a just, affordable, thriving NYC 🏛️ Former candidate, NYC Council
Jack Morris @jxmnop
46K Followers 992 Following research @cornell // language models, information theory, science of AI
Kabir @plodq
30 Followers 35 Following
Gary Stevenson @garyseconomics
183K Followers 304 Following Inequality Economist. Former Trader. Other Economists make predictions, but my ones are actually right. Explaining Economics on YouTube - garyseconomics
william @wgussml
15K Followers 702 Following cofounder @generalagentsco prev CMU PhD, OpenAI research scientist, helped build copilot & MineRL. building ell https://t.co/kQN8n3fBKH
Michael Pettis @michaelxpettis
180K Followers 222 Following Senior Fellow, Carnegie Endowment. For speaking engagements, please contact me at [email protected]
LaurieWired @lauriewired
105K Followers 285 Following researcher @google; serial complexity unpacker; https://t.co/Vl1seeNgYK ex @ msft & aerospace
Joel Spolsky @spolsky
162K Followers 561 Following co-founder of Fog Creek, Trello, Stack Overflow, Glitch, and https://t.co/Jb7fG3eQgU - I have moved to @[email protected] on mastodon
zeynep tufekci @zeynep
435K Followers 765 Following Complex systems, wicked problems. Society, technology, science and more. @Princeton professor. @NYTimes columnist. My newsletter @insight https://t.co/6Ky01N9JwA
Ye Zhu @szyezhu
362 Followers 254 Following Postdoc @PrincetonCS | Research in Multimodal Generation, Computer Vision, ML4Astrophysics
Neel Baronia is 📖 ... @nbaronia1
897 Followers 148 Following “If you’re careful enough, nothing good or bad will ever happen to you.” -Ashleigh Brilliant Very low frequency trading: [email protected]
Ted Sanders @sandersted
9K Followers 1K Following Research at OpenAI. Be kind to others, and yourself.
Alejandro Cuadron @Alex_Cuadron
1K Followers 330 Following Infra & AI enthusiast, dreaming about test-time compute ✨ Research Scholar at @Berkeley_EECS, @ucbrise, @berkeley_ai | MS in CS @ETH_en | Prev, @IBMResearch
🔰Chief Georgist Sh... @BlueRepublik
6K Followers 5K Following Spreading the glory of Georgism one tweet at a time. Regular Econ, Chess & OSINT twitter lurker. Peak lichess rating: 2496 - Eng/Deu/Esp/Rus - 27
🇺🇦 Alex Polozov @Skiminok
4K Followers 799 Following Sr. Staff Research Scientist @GoogleDeepMind • previously @Theteamatx, @MSFTResearch, @uwcse • program synthesis, GenAI for Code & SWE • he/him
Yonatan Bitton @YonatanBitton
3K Followers 1K Following Research Scientist @GoogleAI | Multimodal ML & Vision-Language | Account restored after hack (July 2025).
Andy Konwinski @andykonwinski
8K Followers 98 Following Co-founder of @databricks, @perplexity_ai, @laudeinstitute, @laudeventures
Antonia @antonia_mdprjct
51K Followers 475 Following RE Developer, doer, design & construction geek, owner @ MADDPROJECT, work from anywhere specialist, RA, NCARB. I build teams that design & build buildings.Trends for United States
You might like
