When you're building AI agents, evaluation gets tricky fast. Agents make multiple decisions, use tools, and follow complex reasoning paths to reach their conclusions—you need to assess the entire workflow, not just the final output.
#MLflow's agent evaluation framework addresses…
With #MLflow, you can version your agents and capture their code, parameters, and evaluation metrics for every iteration. This makes it easier to understand how an agent has changed over time and to reproduce past results when needed. ✅
By managing agents in a central place,…
In this blog by #MLflow Ambassador Rahul Pandey, learn how the MLflow Prompt Registry helps teams move from scattered notebook files and chat threads to a streamlined prompt management process—one that’s versioned, searchable, and always ready for rollbacks. 🚀
Discover how…
📣 MLflow 3.3.0 is now available!
🔗 Check out the release notes: github.com/mlflow/mlflow/…
This release introduces several major features and improvements:
🔹 𝗠𝗼𝗱𝗲𝗹 𝗥𝗲𝗴𝗶𝘀𝘁𝗿𝘆 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀: Support for webhooks on model registry events, enabling automated…
📣 MLflow Office Hours — Wednesday, Sept 10
Connect directly with MLflow maintainers and contributors for live Q&A! Bring your production challenges or your latest #LLM and #GenAI experiments—this session is dedicated to hands-on technical discussion and feedback.
You'll get:…
The new GenAI Evaluation capability available in MLflow 3.3 helps teams measure, improve, and maintain the quality of your GenAI applications throughout their lifecycle from development through production. 🙌
✅ Run automatic and custom evaluations (scorers & judges) on your…
Have you heard the news? ⚡ The MLflow TypeScript SDK is here!
Now you can bring #MLflow’s industry‑leading observability directly to your TypeScript and JavaScript applications. 🚀
The SDK enables:
✅ Automatic tracing of #LLM and AI API calls
✅ Manual instrumentation for…
Tracking datasets is key to building reliable #machinelearning models — and image data brings unique challenges: high dimensionality, variability, and storage demands.
In this post, #MLflow Ambassador Thor Steen Larsen shows how to use MLflow’s experiment tracking and UI to…
🚨 Just 1 week to go! The August MLflow Community Meetup kicks off next Wednesday, August 20 at 4:00 PM PT.
What’s on the agenda?👇
🔹 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀 𝗶𝗻 𝗠𝗟𝗳𝗹𝗼𝘄: Learn how webhooks unlock real-time automation and tighter integrations for your #ML workflows.
🔹…
Build production-grade GenAI workflows with MLflow 🚀
MLflow is the complete open source platform for #LLMOps, designed to help engineers instrument, track, and evaluate GenAI systems end-to-end. Whether you’re working with retrieval-augmented generation, custom #LLM agents, or…
At Agents in Production 2025, Yuki Watanabe presented 𝘌𝘷𝘢𝘭𝘶𝘢𝘵𝘪𝘰𝘯-𝘋𝘳𝘪𝘷𝘦𝘯 𝘋𝘦𝘷𝘦𝘭𝘰𝘱𝘮𝘦𝘯𝘵 𝘸𝘪𝘵𝘩 𝘔𝘓𝘧𝘭𝘰𝘸 3.0 — a process that uses evaluation as the foundation for building high-quality, reliable Agentic systems.
The talk showed how #MLflow 3.0…
Join us for the next MLflow Community Meetup on August 20! 🥳 This month, we’re excited to bring you the latest updates and insights from the MLflow ecosystem, featuring:
🔔 Learn how webhooks are making MLflow even more powerful by enabling real-time automation and tighter…
Don't forget! TODAY, August 6, at 8AM PT, we have MLflow Office Hours! 🚀
What to Expect:
✅ Live troubleshooting of your MLflow implementation questions
✅ Expert insights on model lifecycle management and GenAI integrations
✅ Sneak peeks at new and upcoming features
✅Tips &…
44K Followers 1K FollowingCTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
10K Followers 67 FollowingDelta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!
46K Followers 1K FollowingWriter https://t.co/TquuQXlLOJ. O'Reilly Author https://t.co/Fl3uPAZHLg. LLM Builder @Cohere. Visualizing AI one concept at a time.
50K Followers 3K FollowingDeveloper Experience Lead at @GoogleDeepMind
Building Gemini API, Gemma, AI Studio and more AI products. My views
ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
41 Followers 166 FollowingI've been working with IT for 15+ years, having experience as Software Development, Project Manager, Data Engineer, and Solutions Architect.
2K Followers 395 Followinghttps://t.co/dg3amofxmH offers private & corporate digital bank accounts, crypto payments, and trade finance products and services for international businesses.
47 Followers 134 Following✝️ React Django Full Stack Engineer. 6'3" Monolith defender. No vibes. Aggregating solutions to common dev problems. 8y .Net 2y Django. Creator of StoryArkAI
115 Followers 319 FollowingDeveloper & Builder
🧠 AI/ML Enthusiast
🌐 Web Architect
Building https://t.co/7A39NAumWs to make stock market education accessible.
451K Followers 77 FollowingTensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
44K Followers 1K FollowingCTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
10K Followers 67 FollowingDelta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!
10K Followers 48 FollowingAn open-source declarative framework for building modular AI software. Programming—not prompting—LLMs via higher-level abstractions & optimizers.
31K Followers 877 FollowingVP GenAI @Databricks. Former CEO/cofounder MosaicML & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.
3K Followers 2K FollowingWe're a Community Creating #OpenSource Solutions for #FinancialServices & #Fintech. #OSinFinance #OSFF2024
Join us at https://t.co/a6FCcx19c7
18K Followers 1K FollowingWomen in Machine Learning organization. Maintains a list of women in ML. Profiles the research of women in ML. Annual workshop and other events.
16K Followers 9K FollowingWomen+ in Machine Learning & Data Science (WiMLDS) Org. | meetup community of women & non-binary folks | Est 2013 👩🏿💻👩💻👩🏽💻 #GenderEquality #Inclusion
43K Followers 313 FollowingBlack in AI empowers a global community of AI professionals of African descent to be full partners in shaping our technological and economic future.
112K Followers 25K FollowingBringing together the global data science community to help foster the exchange of innovative ideas and encourage the growth of open source software.
20K Followers 759 Following#DataAISummit (formerly #SparkAISummit) is the global event for the data community. The conference is organized by @Databricks.
10K Followers 0 FollowingI'm a software engineer, author of the book Hands-on Scala Programming https://t.co/jCMgqCKhpN
Bluesky https://t.co/2IJXLiM3YG
2K Followers 934 FollowingDeveloper@heart; Advocate by nature; Communicator & Cosmopolitan by choice | Arsenal Fan by Inheritance| Love Reading, Writing, Coding | Tweets R Mine
3K Followers 2K Followinggeek, scribe, coffee snob, and wanna-be cyclist. Contributor to Apache Spark and Delta Lake maintainer. Developer Relations at Databricks (opinions r my own)