Mikyo @mikeldking
Building the future of LLMOps. Head of Open-Source at @arizeai @ArizePhoenix | Former eng @apple ☕️🚲🧗🏻♂️🏂⛰🕴 mikeldking.com San Francisco Joined August 2009-
Tweets1K
-
Followers377
-
Following637
-
Likes2K
⌨️ We've been hard at work creating a light-weight package that is fully featured for interacting with @ArizePhoenix . If you don't know it's called arize-phoenix-client and it has first-class support for interacting with a phoenix instance. You should no longer have to install…
Tracking and correlating the back and forth conversations with an AI Agent is an ever increasing requirement for Agent Observability. Whether it's evaluating the coherency of the agent or its ability to recall relevant information over time - sessions and treads are proving to be…
Building a reliable RAG system doesn’t stop at retrieval and generation, you need observability too. In the Retrieval Augmented Generation course, you'll explore how LLM observability platforms can help you: - Trace prompts through each step of the pipeline - Log and evaluate…
This article by Elizabeth Hutton, @schavalii, and @aparnadhinak encapsulates a core discovery we made when building one of the first #oss eval libraries back in 2023 - notably that sometimes the explanation of a particular judgement can be as informative as the judgement itself.…
This article by Elizabeth Hutton, @schavalii, and @aparnadhinak encapsulates a core discovery we made when building one of the first #oss eval libraries back in 2023 - notably that sometimes the explanation of a particular judgement can be as informative as the judgement itself.…
Working with teams running LLM-as-a-judge evals, I’ve noticed a shocking amount of variance on when they use reasoning, CoT, and explanations. Here’s what we’ve seen works best: Explanations make judge models more reliable. They reduce variance across runs, improve agreement…
🚀Day 0 Support for GPT-5 is Live 🚀 We’re thrilled to announce immediate support for GPT-5 in our platform. Whether you’re evaluating performance or scaling production workloads, we’ve got you covered: ️👉Cost tracking: Full visibility into spend per request ️👉Reasoning…
Just hit this issue with Claude not being able to use a MCP server talking to localhost. stackoverflow.com/questions/7950… Feels like there was a secret security issue... Am I wrong?
Open-Source the system prompt evals
Killer integration
Hill-climbing for LLM-as-a-judge is extremely difficult if you don't have an experimentation framework. @sanjanayed breaks down how to use benchmarked datasets to apply a scientific approach to your judge building.
Hill-climbing for LLM-as-a-judge is extremely difficult if you don't have an experimentation framework. @sanjanayed breaks down how to use benchmarked datasets to apply a scientific approach to your judge building.
Wanted to showcase a probably not well understood (but increasingly powerful package) (pypi.org/project/openin…) It comes with things like decorators and utilities for customizing tracing but it also has some useful utilities that help you run evals and capture human feedback…
I find great inspiration in others' eloquence. "How can we work wonderfully efficiently to create something with breathtaking quality" - Jony Ive youtube.com/shorts/3XJwM6N…
Agree
Very compelling advice. If you want to dig into this with me, lmk. User abandonment is such a hard thing to track.
Very compelling advice. If you want to dig into this with me, lmk. User abandonment is such a hard thing to track.
Design Iteration >> Design Overhaul @arizeai @ArizePhoenix #AI #LLM #LLMOps

Rahul @rahulgupta765
41 Followers 2K Following
Ankaj Mohindroo @amhrtech
175 Followers 2K Following AI Analyst at GAI Insights. Follow for latest insights on GenAI.
aicentury @42aicentury
1 Followers 129 Following
Diego Marinho @diegumarinho
631 Followers 6K Following Senior Consultant Engineer☕ Blockchain enthusiastic♟ Personal investor💰 Part-Time Day Trader 📈📉📊Storm Hunter
Ilemie @Ilemie33310
109 Followers 3K Following
Tegan Jegede @jegede_tegan
200 Followers 6K Following Tegan = print( “👨🏾💻passionate engineer ,AI/ML enthusiast , Real Madrid ,arsenal ⚽️ and GSW🏀: ”)
Prasanna @Prasanna809
19 Followers 607 Following
Oucoodaw @Oucoodaw163289
12 Followers 1K Following
Daniel @passoaprol
159 Followers 2K Following
Alex Chen @ipruning
384 Followers 1K Following Babysitting GPUs / F on Empirically-Driven Scaling / prev @ Edinburgh NLP 24'
Jean-Marc Guerin @JeanMarcGuerin
130 Followers 961 Following
AI_Safety_Governance @puneethmishra
630 Followers 4K Following AI Architect. Graph Neural networks & Knowledge graphs excites me....
Ihoncal @Ihoncal6241825
25 Followers 947 Following
shubham @ShubhamInTech
793 Followers 2K Following ceo @agnostai | prev: @onboardingclub @formbricks @cisco | oss/acc
Celedonio Hernández @ctcichs
95 Followers 4K Following
Mohit @aximox_cc
226 Followers 2K Following Founder Aximox, @ArizePhoenix Ambassdor Previously @cisco @VMware, Distributed Systems, Databases, Go/Rust.
Luciano Renzi @lucianorenzi_
33 Followers 441 Following
Clint Kelly @ClintKelly25356
5 Followers 166 Following
Soumendra Kumar Sahoo @soumendrak_
917 Followers 808 Following 📊 AI #Observability Architect at @PepsiCo 💼 Prev worked at @FreshworksInc, @IBM, @Wipro, @Accenture, & @TCS 🎓M. Tech in Data Science from @bitspilaniindia
Mohit Munjal @mohitmunjal19
139 Followers 933 Following Data Scientist by day | NSIT'18 | Gave a TEDx at 21 for starting a nationwide storytelling initiative | Built @blankbreaks for Minimal Twitter Breaks
bijan bina @voidserf
295 Followers 2K Following building AI quality systems to slash prod failures 80%+ @zerodrift_. helping teams ship AI features with confidence.
Prof Ciekawski @CiekawskiP20193
18 Followers 1K Following
Aagosh Aggarwal @AagoshAggarwal
3 Followers 203 Following
Hogie_ @MoonstoneDiver
16 Followers 640 Following
Félix Henri @FeelHenri
48 Followers 524 Following CPA, CFA. Fier Repentignois. En mission apolitique pour faire découvrir l'univers gouvernemental et vulgariser la performance de l'administration publique.
Forrest Cox @tetsuotrees
947 Followers 6K Following at play in the intersection of lifesci and of finance (and trying to not get run over) | opinions = mine
Emmie Abshire @AbshireEmm382
98 Followers 4K Following
waleedsial @JrWaleedsial
414 Followers 8K Following Senior Analyst @ GoldmanSachs - Alum @UT_Dallas, @FastNU_Official, @jindal_utdallas
DanielR @Dan_R87
314 Followers 2K Following Sentipensante | Data Science | Statistics | GeoSpatial | #Pythonist 🐍#R learner | Amo México y el pan dulce 🇲🇽🇳🇮 | Aprendiendo siempre
Vansh Kharidia @VanshKharidia
298 Followers 2K Following making machines learn | https://t.co/hDl7hd6irJ
Rustem S @vigosun
491 Followers 2K Following AWS Solution Architect and AI Engineer Transducing knowledge from the void.
Yardena Meymann 🎗�... @ymeymann
179 Followers 385 Following
Baghdad Gherras @BagGherras
16 Followers 357 Following Director Data Science and AI @FinTech // Adjunct Professor @RITDubai // Google Developer Expert Product Design
Alex Rigler @alexrigler
582 Followers 7K Following
Laurian Gridinoc @gridinoc
3K Followers 5K Following Full Stack Computational Linguist ※ Mozilla OpenNews Fellow ※ Virtual Production ※ Filmmaker ※ AI accelerationist
DHH @dhh
555K Followers 132 Following Father of three, Creator of Ruby on Rails + Omarchy, Co-owner & CTO of 37signals, Shopify director, NYT best-selling author, and Le Mans 24h class-winner.
Jake Archibald @jaffathecake
105K Followers 2K Following Developer of sorts at @firefox. No thought goes unpublished. He/him. Also jaffathecake on Mastodon, bsky, Threads etc.
Alex Chen @ipruning
384 Followers 1K Following Babysitting GPUs / F on Empirically-Driven Scaling / prev @ Edinburgh NLP 24'
Alexandr Wang @alexandr_wang
327K Followers 833 Following chief ai officer @meta, founder @scale_ai. rational in the fullness of time
Shengjia Zhao @shengjia_zhao
52K Followers 230 Following Chief Scientist @ Meta MSL. Formerly MTS @ OpenAI, PhD @ Stanford. I train models. All opinions my own.
Sam Bhagwat @calcsam
8K Followers 2K Following building @mastra_ai. author principles of building ai agents, the "most popular book in SF right now". prev cofounder @gatsbyjs
Theo - t3.gg @theo
244K Followers 4K Following Full time CEO @t3dotchat. Part time YouTuber, investor, and developer
Rohan @rsrohan99
3K Followers 288 Following Professional AI Engineer. Sharing what I'm currently learning, mostly about AI, LLMs, RAG, building AI powered software, AI automation etc.
Sherwood 💬 @realshcallaway
1K Followers 2K Following Agents & Observability | Previously @11x_official @ycombinator @brexHQ @crunchbase
Aniket @aniketmaurya
2K Followers 1K Following Building @CelestoAI | @joinodf'26 | prev. @LightningAI
Isaac Flath @isaac_flath
2K Followers 122 Following Teaching AI Assisted Coding at https://t.co/Yisgsz91iH
Agno @AgnoAgi
11K Followers 163 Following Agno (previously phidata) is a lightweight library for building Multimodal Agents. Github: https://t.co/HDX1G6ibHr Docs: https://t.co/vZGdFvbmfg
Chen Qian @ChenMoneyQ
592 Followers 117 Following AI Engineer@Databricks, maintainer of DSPy. I am passionate about open source, and building AI products.
Noah Ziems @NoahZiems
1K Followers 1K Following Visiting Researcher @MIT_CSAIL. PhD student @NotreDame advised by @Meng_CS. Creator of Arbor RL library for @DSPyOSS
DSPy @DSPyOSS
10K Followers 48 Following An open-source declarative framework for building modular AI software. Programming—not prompting—LLMs via higher-level abstractions & optimizers.
Matyo @matyo91
319 Followers 447 Following French Developer #Symfony #ReactJS #Automation 👉 https://t.co/WnXEVn18KB
W&B Weave @weave_wb
971 Followers 583 Following A lightweight toolkit for tracking and evaluating LLM applications, built by @weights_biases for AI developers!
kwindla @kwindla
11K Followers 4K Following Infrastructure and developer tools for real-time voice, video, and AI. @trydaily // ᓚᘏᗢ // @pipecat_ai
Shreya Shankar @sh_reya
48K Followers 691 Following on the CS faculty job market | PhD @Berkeley_EECS, building https://t.co/PmuOqAYt6q | teaching https://t.co/CTWJ6z0JEg | formerly ML eng & undergrad @Stanford
Eugene Yan @eugeneyan
25K Followers 538 Following Principal Applied Scientist @ Amazon; RecSys, AI, Engineering. Led ML @ Alibaba, Lazada, Healthtech Series A. Creating @ https://t.co/DEUfIuYC47, https://t.co/jJRZ8MOSnj.
Keywords AI (YC W24) @keywordsai
1K Followers 58 Following The best LLM engineering platform for AI teams 📍Community: https://t.co/JAZ9auu0hr
Curtis G. Northcutt @cgnorthcutt
959 Followers 256 Following CEO & Co-Founder @CleanlabAI. PhD in ML @MIT. ~ Former @GoogleAI, @oculus, @amazon, @facebookai, @MSFTResearch
Mastra @mastra_ai
7K Followers 15 Following the typescript framework for building agents by @calcsam @smthomas3 @abhiaiyer @tonykovanen @wardpeet @tylbar and many others
Matthäus Krzykowski @matthausk
3K Followers 992 Following CEO/co-founder @dltHub, makers of dlt - a Python library for data movement (https://t.co/AEKM8plNI4)
Zenbase AI @ZenbaseAI
3K Followers 2 Following
eric zakariasson @ericzakariasson
40K Followers 446 Following @cursor_ai & tinkering. gone colfing at https://t.co/KFkkR5CJVl
Jaana Dogan ヤナ �... @rakyll
125K Followers 1K Following Principal Engineer at Google. Gemini + model serving at large. Simplicity and optimism. Personal opinions.
Maximilian Kaske 🏓 @mxkaske
3K Followers 595 Following dev · climber · building @openstatushq · call me max
Toshiaki Maki (🦋 @... @making
4K Followers 178 Following Senior Principal Architect at @VMwareTanzu | Ex @Pivotal | Bichon Frise 🍋🐩
Rachitt @rachittshah
3K Followers 827 Following Applied AI consultant. Building https://t.co/dxxWrtW2pA Past: SRE, Quant, Founder, @googleOSS, @sequoia
martin_casado @martin_casado
68K Followers 3K Following GP @ a16z ... questionable heuristics in a grossly underdetermined world