Observability in Foundry Control Plane now in public preview for agents with a GA pre-announcement for model evals is a comprehensive suite of capabilities that enable developers to evaluate, monitor, and optimize the quality, performance, and safety of multi-agent AI systems. These capabilities are integrated throughout the agent development lifecycle—spanning both build and operate experiences—empowering teams to deliver production-grade AI with confidence and speed.
Observability in Foundry Control Plane empowers teams to build and manage reliable agents with integrated evaluations (adhoc, continuous on production traffic and scheduled to detect drift), synthetic datasets, and visual cluster analysis for rapid improvement. It provides actionable insights through customizable dashboards, end-to-end OpenTelemetry based tracing, and model upgrade recommendations to optimize cost and performance. Unified observability across agents offers a single view of cost, performance, and security for agents built on Foundry or third-party platforms. Additionally, AI Red Teaming enables continuous safety testing with automated adversarial simulations to uncover vulnerabilities such as data leaks and jailbreaks, ensuring robust and secure AI deployments.