AZ525957 - Public Preview: Bring Your Own AI Gateway to Foundry Agent Service

Azure Updates

Discussionpowered by zap.ms

Published

Nov 18, 2025

Status

In preview

Timeline

  • November 2025
    Preview

Product

Microsoft Foundry

Tag

Microsoft Ignite
Features

Category

AI + machine learning

Description

The BYO AI Model Gateway feature allows enterprises to connect Foundry-hosted models through any AI gateway services like Azure API Management, Mulesoft, and Kong, to Foundry Agent Service. The Agent Service honors pre/post‑LLM hooks, policy‑based model selection, and multi‑region/multi‑provider load‑balancing with automatic failover, so teams can optimize for latency, cost, compliance, and availability without changing application code. This enables organizations to build agents using their own managed endpoints while maintaining enterprise-grade governance, security, and compliance.