AZ563656 - Public Preview: Rubric evaluator in Microsoft Foundry

Azure Updates

Discussionpowered by zap.ms

Published

Jun 3, 2026

Status

In preview

Timeline

  • June 2026
    Preview

Product

Microsoft Foundry

Tag

Microsoft Build
Feature

Category

AI + machine learning

Description

Microsoft Foundry introduces rubric evaluators for measuring agent quality, now in public preview for single-turn and multi-turn agent flows. Rubric evaluators enable developers to define context-specific evaluation criteria using agent prompts, production traces and context-specific files with weighted dimensions and optional human review, ensuring that quality is measured against what truly matters for each scenario. This establishes a reliable baseline that is powering downstream workflows, including evaluation, optimization, regression testing and deployment gates.