Mikyo @mikeldking
Building the future of LLMOps. Head of Open-Source at @arizeai @ArizePhoenix | Former eng @apple ☕️🚲🧗🏻♂️🏂⛰🕴 mikeldking.com San Francisco Joined August 2009-
Tweets1K
-
Followers381
-
Following639
-
Likes2K
tldr - if you are b2b SaaS: - think about how you will expand up-market early - minimize operational complexity (serverless is your friend) - bet on open-source if you don't, your competitor will
🌀 Since LLMs are probabilistic, their synthesis can differ even when the supplied prompts are exactly the same. This can make it challenging to determine if a particular change is warranted as a single execution cannot concretely tell you whether a given change improves or…
Definitely an ick
Comparing experiments in Phoenix just got a lot easier. The new List View helps you quickly scan results with per-example metrics, while the Metrics View gives you a high-level look at how changes impact cost, latency, tokens, and more. Upgrade to v11.32.1 to start exploring.
See the new Phoenix evals library in action and bring your questions for our virtual workshop this Thursday! RSVP: luma.com/45eopucf
pnpm is the best
Lately, evals have been everywhere. But the real challenge is not just running them. Your evals need to be aligned to your agent. The key step is incorporating human feedback at the beginning. You start by selecting a handful of examples, annotating them, and refining your…
Dify 🤝 Arize We are excited to share how we bring observability into Dify apps with @arizeai. - Trace every step - Debug faster - Keep production agents reliable at scale With Arize Phoenix, developers can trace every agent call, debug failures, and run structured evaluations…
You have to feel it. mitchellh.com/writing/feel-it
⌨️ We've been hard at work creating a light-weight package that is fully featured for interacting with @ArizePhoenix . If you don't know it's called arize-phoenix-client and it has first-class support for interacting with a phoenix instance. You should no longer have to install…
Tracking and correlating the back and forth conversations with an AI Agent is an ever increasing requirement for Agent Observability. Whether it's evaluating the coherency of the agent or its ability to recall relevant information over time - sessions and treads are proving to be…
Building a reliable RAG system doesn’t stop at retrieval and generation, you need observability too. In the Retrieval Augmented Generation course, you'll explore how LLM observability platforms can help you: - Trace prompts through each step of the pipeline - Log and evaluate…
This article by Elizabeth Hutton, @schavalii, and @aparnadhinak encapsulates a core discovery we made when building one of the first #oss eval libraries back in 2023 - notably that sometimes the explanation of a particular judgement can be as informative as the judgement itself.…
This article by Elizabeth Hutton, @schavalii, and @aparnadhinak encapsulates a core discovery we made when building one of the first #oss eval libraries back in 2023 - notably that sometimes the explanation of a particular judgement can be as informative as the judgement itself.…
Working with teams running LLM-as-a-judge evals, I’ve noticed a shocking amount of variance on when they use reasoning, CoT, and explanations. Here’s what we’ve seen works best: Explanations make judge models more reliable. They reduce variance across runs, improve agreement…
🚀Day 0 Support for GPT-5 is Live 🚀 We’re thrilled to announce immediate support for GPT-5 in our platform. Whether you’re evaluating performance or scaling production workloads, we’ve got you covered: ️👉Cost tracking: Full visibility into spend per request ️👉Reasoning…
Just hit this issue with Claude not being able to use a MCP server talking to localhost. stackoverflow.com/questions/7950… Feels like there was a secret security issue... Am I wrong?
cagri @cagriyonca
175 Followers 622 Following
Farshad Taheri @farshadtaheri
397 Followers 2K Following Early Stage Investor. Founder / CEO at Arbor
jingbo yao @jingboyao320
1 Followers 70 Following
Robert Scoble @Scobleizer
543K Followers 24K Following The best from ML/AI community | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future | Silicon Valley robots, holodecks, BCIs, & startups.
AudreyTomlinson @Fim480MDex7xfS
21 Followers 470 Following
Rahul @rahulgupta765
47 Followers 2K Following
Ankaj Mohindroo @amhrtech
178 Followers 2K Following AI Analyst at GAI Insights. Follow for latest insights on GenAI.
aicentury @42aicentury
1 Followers 130 Following
Diego Marinho @diegumarinho
631 Followers 6K Following Senior Consultant Engineer☕ Blockchain enthusiastic♟ Personal investor💰 Part-Time Day Trader 📈📉📊Storm Hunter
Ilemie @Ilemie33310
127 Followers 3K Following
Tegan Jegede @jegede_tegan
208 Followers 7K Following Tegan = print( “👨🏾💻passionate engineer ,AI/ML enthusiast , Real Madrid ,arsenal ⚽️ and GSW🏀: ”)
Prasanna @Prasanna809
28 Followers 616 Following
Daniel @passoaprol
160 Followers 2K Following
Alex Chen @ipruning
399 Followers 1K Following Babysitting GPUs / F on Empirically-Driven Scaling / prev @ Edinburgh NLP 24'
Jean-Marc Guerin @JeanMarcGuerin
130 Followers 965 Following
AI_Safety_Governance @puneethmishra
636 Followers 4K Following AI Architect. Graph Neural networks & Knowledge graphs excites me....
Ihoncal @Ihoncal6241825
31 Followers 1K Following
shubham @ShubhamInTech
808 Followers 2K Following your mcp guy | ceo @agnostai | prev: @onboardingclub @formbricks @cisco | oss/acc
Celedonio Hernández @ctcichs
92 Followers 4K Following
Mohit @aximox_cc
267 Followers 2K Following Founder Aximox, @ArizePhoenix Ambassdor Previously @cisco @VMware, Distributed Systems, Databases, Go/Rust.
Luciano Renzi @lucianorenzi_
32 Followers 441 Following
Clint Kelly @ClintKelly25356
5 Followers 167 Following
Soumendra Kumar Sahoo @soumendrak_
919 Followers 809 Following 📊 AI #Observability Architect at @PepsiCo 💼 Prev worked at @FreshworksInc, @IBM, @Wipro, @Accenture, & @TCS 🎓M. Tech in Data Science from @bitspilaniindia
Mohit Munjal @mohitmunjal19
135 Followers 944 Following Data Scientist by day | NSIT'18 | Gave a TEDx at 21 for starting a nationwide storytelling initiative | Built @blankbreaks for Minimal Twitter Breaks
bijan bina @voidserf
280 Followers 2K Following building AI quality systems to slash prod failures 80%+ @zerodrift_. helping teams ship AI features with confidence.
Prof Ciekawski @CiekawskiP20193
25 Followers 1K Following
Aagosh Aggarwal @AagoshAggarwal
3 Followers 203 Following
Hogie_ @MoonstoneDiver
23 Followers 631 Following
Félix Henri @FeelHenri
47 Followers 527 Following CPA, CFA. Fier Repentignois. En mission apolitique pour faire découvrir l'univers gouvernemental et vulgariser la performance de l'administration publique.
Forrest Cox @tetsuotrees
936 Followers 6K Following at play in the intersection of lifesci and of finance (and trying to not get run over) | opinions = mine
Emmie Abshire @AbshireEmm382
120 Followers 4K Following
waleedsial @JrWaleedsial
396 Followers 7K Following Senior Analyst @ GoldmanSachs - Alum @UT_Dallas, @FastNU_Official, @jindal_utdallas
DanielR @Dan_R87
314 Followers 2K Following Sentipensante | Data Science | Statistics | GeoSpatial | #Pythonist 🐍#R learner | Amo México y el pan dulce 🇲🇽🇳🇮 | Aprendiendo siempre
Vansh Kharidia @VanshKharidia
304 Followers 2K Following making machines learn | https://t.co/hDl7hd6irJ
Rustem S @vigosun
501 Followers 2K Following AWS Solution Architect and AI Engineer Transducing knowledge from the void.
Yardena Meymann 🎗�... @ymeymann
179 Followers 388 Following
Baghdad Gherras @BagGherras
16 Followers 360 Following Director Data Science and AI @FinTech // Adjunct Professor @RITDubai // Google Developer Expert Product Design
ThePrimeagen @ThePrimeagen
300K Followers 1K Following skill issues: 🟩⬛️⬛️⬛️⬛️⬛️(69/420) https://t.co/qWJnB6p4EP https://t.co/IwY3FTx1ZE https://t.co/TYJ6aSpwYs
DHH @dhh
565K Followers 136 Following Father of three, Creator of Ruby on Rails + Omarchy, Co-owner & CTO of 37signals, Shopify director, NYT best-selling author, and Le Mans 24h class-winner.
Jake Archibald @jaffathecake
105K Followers 2K Following Developer of sorts at @firefox. No thought goes unpublished. He/him. Also jaffathecake on Mastodon, bsky, Threads etc.
Alex Chen @ipruning
399 Followers 1K Following Babysitting GPUs / F on Empirically-Driven Scaling / prev @ Edinburgh NLP 24'
Alexandr Wang @alexandr_wang
333K Followers 838 Following chief ai officer @meta, founder @scale_ai. rational in the fullness of time
Shengjia Zhao @shengjia_zhao
52K Followers 231 Following Chief Scientist @ Meta MSL. Formerly MTS @ OpenAI, PhD @ Stanford. I train models. All opinions my own.
WarrenBuffering @WarrenInTheBuff
9K Followers 1K Following 91% NPC | Real person w/ real feelings | Not a bot | Nikita please read this I'm not a bot | I'm an NPC it's different | NPC != Bot | Help
Sam Bhagwat @calcsam
9K Followers 2K Following building @mastra_ai. author principles of building ai agents, the "most popular book in SF right now". prev cofounder @gatsbyjs
Theo - t3.gg @theo
247K Followers 4K Following Full time CEO @t3dotchat. Part time YouTuber, investor, and developer
Rohan @rsrohan99
3K Followers 287 Following Professional AI Engineer. Sharing what I'm currently learning, mostly about AI, LLMs, RAG, building AI powered software, AI automation etc.
Sherwood 💬 @realshcallaway
2K Followers 3K Following Agents + Dev Tools + Observability | Prev @11x_official @ycombinator @brexHQ @crunchbase
Aniket @aniketmaurya
2K Followers 1K Following Building @CelestoAI (AI teammates for enterprises) | @joinODF Fellow | prev. @LightningAI
Isaac Flath @isaac_flath
2K Followers 68 Following Teaching AI Assisted Coding at https://t.co/Yisgsz91iH
Agno @AgnoAgi
11K Followers 169 Following Agno (previously phidata) is a lightweight library for building Multimodal Agents. Github: https://t.co/HDX1G6ibHr Docs: https://t.co/vZGdFvbmfg
Chen Qian @ChenMoneyQ
612 Followers 120 Following AI Engineer@Databricks, maintainer of DSPy. I am passionate about open source, and building AI products.
Noah Ziems @NoahZiems
1K Followers 1K Following Visiting Researcher @MIT_CSAIL under @lateinteraction. PhD student @NotreDame advised by @Meng_CS. Creator of Arbor RL framework for @DSPyOSS
DSPy @DSPyOSS
11K Followers 50 Following An open-source declarative framework for building modular AI software. Programming—not prompting—LLMs via higher-level abstractions & optimizers.
Matyo @matyo91
323 Followers 448 Following French Developer #Symfony #ReactJS #Automation 👉 https://t.co/WnXEVn18KB
W&B Weave @weave_wb
1K Followers 586 Following A lightweight toolkit for tracking and evaluating LLM applications, built by @weights_biases for AI developers!
kwindla @kwindla
11K Followers 4K Following Infrastructure and developer tools for real-time voice, video, and AI. @trydaily // ᓚᘏᗢ // @pipecat_ai
Shreya Shankar @sh_reya
49K Followers 703 Following on the CS faculty job market | PhD @Berkeley_EECS, building https://t.co/PmuOqAYt6q | teaching https://t.co/CTWJ6z0JEg | formerly ML eng & undergrad @Stanford
Eugene Yan @eugeneyan
25K Followers 536 Following Principal Applied Scientist @ Amazon. Led ML @ Alibaba, Lazada, Healthtech Series A. Writing @ https://t.co/DEUfIuYC47.
sanjana @sanjanayed
142 Followers 129 Following
Keywords AI (YC W24) @keywordsai
1K Followers 58 Following The best LLM engineering platform for AI teams 📍Community: https://t.co/JAZ9auu0hr
Curtis G. Northcutt @cgnorthcutt
957 Followers 257 Following CEO & Co-Founder @CleanlabAI. PhD in ML @MIT. ~ Former @GoogleAI, @oculus, @amazon, @facebookai, @MSFTResearch
Mastra @mastra_ai
7K Followers 18 Following the typescript framework for building agents by @calcsam @smthomas3 @abhiaiyer @tonykovanen @wardpeet @tylbar and many others
Matthäus Krzykowski @matthausk
3K Followers 995 Following CEO/co-founder @dltHub, makers of dlt - a Python library for data movement (https://t.co/AEKM8plNI4)
Zenbase AI @ZenbaseAI
3K Followers 2 Following
eric zakariasson @ericzakariasson
41K Followers 457 Following @cursor_ai & tinkering. gone colfing at https://t.co/KFkkR5CJVl
Jaana Dogan ヤナ �... @rakyll
126K Followers 1K Following Principal Engineer at Google. Bettering Gemini model serving infra, bettering APIs. Simplicity and optimism. Personal opinions.
Maximilian Kaske 🏓 @mxkaske
3K Followers 600 Following dev · climber · building @openstatushq · call me max
Toshiaki Maki (🦋 @... @making
4K Followers 176 Following Senior Principal Architect at @VMwareTanzu | Ex @Pivotal | Bichon Frise 🍋🐩
Rachitt @rachittshah
3K Followers 830 Following Applied AI consultant. Building https://t.co/dxxWrtW2pA Past: SRE, Quant, Founder, @googleOSS, @sequoia
martin_casado @martin_casado
69K Followers 3K Following GP @ a16z ... questionable heuristics in a grossly underdetermined world
Vítor Balocco @vitorbal
828 Followers 684 Following Builder and Applied AI Engineer. Working on something new. Prev. AI lead for @Zapier Agents, @Stedi, ESLint. Carioca 🇧🇷 living in Madrid 🇪🇸Trends for United States
You might like
