Openbenchmarks (YC F24) @openbenchmarks
Independent benchmarks to help you discover, compare, and choose APIs and agents for your use cases. openbenchmarks.com San Francisco, CA Joined July 2026-
Tweets34
-
Followers48
-
Following41
-
Likes27
@openbenchmarks x @orthogonal_sh ?
Introducing Jev + Orthogonal. Describe what you need. Jev finds the right API in seconds. 1,000+ endpoints across 50+ providers. Ready to use. Pay as you go. Live now 👇
@benswerd @freestyle_dev @tensorlake @e2b @modal @daytonaio @blaxelAI @tenki @orgo @flydotio @vercel @Cloudflare Let's get you benchmarked! 👀
@firecrawl's POST /v2/search scores 0.60 F1 per 1k tokens, #1 of 20 endpoints. @Tiny_Fish is next at 0.56, then @brave at 0.54. @firecrawl also leads the search-only (0.60) On this benchmark, no endpoint gets more accuracy per token than @firecrawl.
We ran 45 hand-labelled multi-hop questions 3 times each, with the same model (gpt-5.6-sol) for every provider, up to 8 turns and 14 searches. On the search & fetch board, the agent can also fetch any URL a search returns, using the provider's own extraction where available.
Benchmark Spotlight: @firecrawl - Accuracy per Token Benchmark: Multi-Turn Company Search (Search & Fetch) It tests whether a search API can help an agent assemble a set of companies from questions that combine 3-4 constraints: investor, geography, founding era, funding.
Eval harness is Open Source Eval harness + code: github.com/openbenchmarks… Public dataset: huggingface.co/datasets/openb… Full benchmark: github.com/openbenchmarks…
The caller code, the analyzer, every turn's timings and the recordings behind each are public, so any number here can be checked against the audio without an account on any platform. Claude and ChatGPT already answer off this benchmark.
Introducing VoiceLatencyBench: An independent measurement of how long voice agents make callers wait, across 5 voice agent platforms on live phone calls. We measure Time To First Audio Byte (TTFAB): the gap between the caller going quiet and the agent's first sound.
Excited to partner with such a fast moving team!
Introducing Alexandria. We raised a $75M Series B led by Smash Capital to build the world’s largest knowledge library for superintelligence. Supercharge your agents with instant access to the most powerful data sets & providers. firecrawl.dev/alexandria
@0xluffy Let's get you on openbenchmarks.com
This is one column, not a verdict. Several of the endpoints here are deep or advanced configurations that spend time doing more inside a single call. But on this benchmark, nothing comes back faster than @youdotcom.
@youdotcom's POST /v1/search at extraction_mode=highlights, with POST /v1/contents on fetch, takes 638 ms, fastest of 14 endpoints on this board. Same endpoint with knowledge=core added takes second at 678 ms. The next endpoint after that is @nimble_search's standard variant at 905 ms.
100 coding tickets built from live enterprise documentation, gpt-5.6-sol held fixed, 5 searches and 32 turns, three runs per endpoint. On this benchmark, web_fetch routes through the same vendor as web_search.
When you put a search tool inside an agent loop, latency stops being a one-time cost. The agent searches, opens a page, searches again. Every call is a wait, the budget is five searches per ticket. We ranked on average search time: mean latency per web_search call.
Benchmark Spotlight: @youdotcom - Average Search Time Benchmark: Web Search for Coding Agents (Hard Retrieval, Search & Fetch) This benchmark tests whether a search API can get an agent to a detail buried deep inside one page, among many near-identical pages.
Assistant Analysis HQ @assanalysis
0 Followers 1 Following Assistants need analysis - so we bring you Assistant Analysis. The best way to measure your assistant - https://t.co/W8Lvu77800 Dev by @anchor_browser
ZenithAi @ZenithAiLab
84K Followers 5K Following Tech+AI influencer | Building, learning, evolving | Reviewed 100+ AI tools so far | DM for collaboration📩 [email protected]
Aria Tech @Ariaaiexpert
33K Followers 3K Following AI, SaaS & Web3 growth on X I break down AI tools, automation & code Building in public 🚀📩 DM for collabs 📨 [email protected]
Chole Syntax Expert A... @CholeSyntax
42K Followers 1K Following AI Influencer | AI Tools Expert I test tools & Tools & Tips help to Grow AI projects DM for Collabs [email protected]
Alice The Ai Expert @AliceInfoAi
30K Followers 5K Following AI Educator | Simplifying AI for everyone Daily AI tools & tutorials & video ⚡Learn faster. Build https://t.co/ReGIXeYlGj for paid collab💌 [email protected]
Arshia Arya @AryaArshia
2K Followers 6K Following PhD student @ucsd_cse. Ex @MSFTResearch. Alum @bitspilaniindia
Vignesh Nanda Kumar @VigneshN1997
213 Followers 3K Following Software Engineer - Data Management @ServiceNow | MS CS @ucsd_cse | Systems for ML| Ex- @AmericanExpress
Loren @lorenforeal
181 Followers 253 Following Building -1 to 0 @spc | Voice Agent Trust https://t.co/wvXAxKc1Ej
Panam Dodia @PanamDodia
7 Followers 145 Following
Nimble @nimble_search
4K Followers 6 Following Expert-level web search for AI agents. Higher accuracy, lower token costs, full auditability — built for production.
BAM @bruceandrewmag
116 Followers 3K Following building great things // chief of staff at string // ex-bain
Bipin Yadav @BIPINKU00806804
7 Followers 76 Following
Aviraj Dongare @aviraj_dongare
23 Followers 111 Following Equipped with five senses, exploring the universe around and calling the adventure Science.🚀
Patrick @kkpeckk
283 Followers 1K Following building the internet money stack with @ametyst_ai / not a dev, not a banker, just a financial hacker
Sean Brennan @seanwbren
5K Followers 7K Following building Regents Labs @regents_sh ⟢ prev. Makerdao, Infura, Bio Protocol
Awais alwaisy @alvaisy
61 Followers 94 Following 5y swe. building ideas from my brain. https://t.co/VE2KyeB8pm // https://t.co/6izlQZScpV Discord: https://t.co/MyaVGclgXX
Pond AI @JoinPond
40K Followers 577 Following Pond helps you solve any problems with AI agents and talented experts. Post a task today: https://t.co/3Zmj6ZfhkN Hiring GTM and Head of Engineering. Please DM.
Nael @naelmohammad
464 Followers 6K Following 🇵🇸🇱🇧 Free Palestine/Lebanon inshallah Advocating for Palestinian and Lebanese freedom. Focused on ending the occupation, coexistences, and peace.
Ryan Junejo @RyanJunejo
290 Followers 1K Following Founder @CrashLabs_AI prev resident @fdotinc research @VectorInst @cohere dropout @uoft trying to make this ai thing go well!
converge80 @converge80
225 Followers 4K Following
Reply by AI @replybyai
7 Followers 648 Following
X9715964319704 @X9715964319704
0 Followers 102 Following
CCC Consultoria Ltda @cccconsultoria
1 Followers 605 Following
AI Buddy K @AIBuddyK
19 Followers 4K Following
Aditya Narayan Singh @Savvy_Blunderer
0 Followers 115 Following Class 12 CBSE, Aspiring Digital Product Tech Entrepreneur, Curious about the universe & beyond.
Yi Zhong 🍊 @yiz_be_building
661 Followers 1K Following Building @besimple_ai (YC P25) 🍊 to help AI hear you, ex Meta / Dropbox / MSFT product lead from MIT
Ayush Shekhar 💙 @ayushshekhar17
3K Followers 1K Following Engineering @ @flutterflow | The 'Poet'ech Speaker | @GoogleDevExpert - Flutter & Dart | Telling stories
Galaxy @getgalaxyio
220 Followers 344 Following Building open data infrastructure for the context era. Try Filament, our data movement engine.
Vlad M. @vlad_mykhailov
41 Followers 84 Following Building a web design & AI search consultancy in public | LSE Grad
Tom 👓 @crypblizz
2K Followers 927 Following
George Pickett @georgepickett
7K Followers 3K Following Developer Relations Engineer @p0 Codex Ambassador
Aditya Lahiri @cross_entrippy
3K Followers 3K Following co-founder @openbenchmarks- building for humans and agents
Arshia Arya @AryaArshia
2K Followers 6K Following PhD student @ucsd_cse. Ex @MSFTResearch. Alum @bitspilaniindia
Nimble @nimble_search
4K Followers 6 Following Expert-level web search for AI agents. Higher accuracy, lower token costs, full auditability — built for production.
TinyFish @Tiny_Fish
9K Followers 58 Following Give AI agents access to the live web with one API. Search & Fetch are free. Start at: https://t.co/jGnj2ampDQ
Parallel Web Systems @p0
22K Followers 56 Following Web infrastructure for AI to search, extract, monitor, and reason over the world's information. Start here → https://t.co/0Enegj3dhv
Pond AI @JoinPond
40K Followers 577 Following Pond helps you solve any problems with AI agents and talented experts. Post a task today: https://t.co/3Zmj6ZfhkN Hiring GTM and Head of Engineering. Please DM.
Yi Zhong 🍊 @yiz_be_building
661 Followers 1K Following Building @besimple_ai (YC P25) 🍊 to help AI hear you, ex Meta / Dropbox / MSFT product lead from MIT
Vlad M. @vlad_mykhailov
41 Followers 84 Following Building a web design & AI search consultancy in public | LSE Grad
Aditya Lahiri @cross_entrippy
3K Followers 3K Following co-founder @openbenchmarks- building for humans and agents
George Pickett @georgepickett
7K Followers 3K Following Developer Relations Engineer @p0 Codex Ambassador
dara khosrowshahi @dkhos
4.8M Followers 769 Following Uber CEO; travel and sci-fi geek; gamer who doesn't have enough time to play much.
Arvind Krishna @ArvindKrishna
4.7M Followers 545 Following Chairman and CEO of @IBM, avid learner and listener, relentlessly focused on what's next, #GoodTechIBM, father, husband, @Illinois_Alma, @IITKanpur
Antonio Neri @AntonioNeri_HPE
4.7M Followers 163 Following President & CEO, Hewlett Packard Enterprise https://t.co/q5IqSX5u3H
Chuck Robbins @ChuckRobbins
4.7M Followers 342 Following Chair and CEO, Cisco Chair, Business Roundtable Proud UNC Tarheel
Jim Farley @jimfarley98
4.9M Followers 772 Following CEO of @Ford Dad, husband, racer #NoBoringProducts
Andy Jassy @ajassy
5.7M Followers 285 Following Lead Amazon, married and father of two kids, big sports/music/film fan, experienced buffalo wings eater. Go Kraken!
Albert Bourla @AlbertBourla
4.7M Followers 159 Following Chairman and CEO of @Pfizer. Father. Optimist. Working every day for breakthroughs that change patients’ lives. 🇬🇷🇺🇸
Mary Barra @mtbarra
5.8M Followers 126 Following @GM Chair and CEO leading an outstanding team with the ambition, talent and technology to create a world with zero crashes, zero emissions and zero congestion.
Pat Gelsinger @PGelsinger
4.8M Followers 159 Following Values are most enduring thing leaders create. Engineering pioneer, proud grandfather, philanthropist, Christian, farm boy at heart.
Jason Fried @jasonfried
5.1M Followers 269 Following Started & runs 37signals (makers of Basecamp, HEY, and ONCE). Non-serial entrepreneur, serial author. DM or email me at [email protected].
Bill Gates @BillGates
65.1M Followers 570 Following Sharing things I'm learning through my foundation work and other interests.
Steve Ballmer @Steven_Ballmer
3.0M Followers 199 Following Lots going on: follow what's new @LAClippers 🏀 and @USAFacts 📊. Also busy with @BallmerGroup.
Steve Wozniak @stevewoz
3.6M Followers 91 Following Engineers first! Human rights. Gadgets. Jokes and pranks. Segways. Music and concerts. Gameboy Tetris.
Paul Graham @paulg
5.3M Followers 799 Following
John Carmack @ID_AA_Carmack
4.1M Followers 295 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo Aerospace
Tim O'Reilly @timoreilly
4.5M Followers 2K Following Founder and CEO, O'Reilly Media. Watching the alpha geeks, sharing their stories, helping the future unfold. Didn't pay for a blue check, cannot make it go away
Guy Kawasaki @GuyKawasaki
4.0M Followers 506 Following Chief evangelist @Canva 🎧 Host Remarkable People podcast https://t.co/Hout7LwJjC
Michael Dell 🇺🇸 @MichaelDell
8.3M Followers 4K Following Husband, Father, Grandfather, Brother, Founder, Chairman and CEO Dell Technologies Grateful 🇺🇸 #PlayNiceButWin https://t.co/3JiGiLQq1C
Marc Andreessen 🇺�... @pmarca
6.5M Followers 33K Following You’re not talking to someone who woke up a loser. That loser attitude, that loser premise makes no sense to me.
Jeff Bezos @JeffBezos
10.2M Followers 615 Following Six thousand years ago, someone invented the plow, and we all got wealthier. A gentle reminder that all civilizational wealth is driven by invention.You might like
