AZ491980 - Generally Available: Import from Azure AI Foundry to Azure API Management’s AI Gateway

Azure Updates

Discussionpowered by zap.ms

Published

May 23, 2025

Status

Launched

Timeline

  • May 2025
    General Availability

Product

API Management

Tag

Features
Microsoft Build

Category

Integration
Internet of Things
Mobile
Web

Description

Announcing the general availability of importing model endpoints from Azure AI Foundry directly into Azure API Management’s AI Gateway. This capability simplifies onboarding of large language model (LLM) APIs by enabling seamless integration through the Azure portal. 

 

Key benefits:  

  • Rapid onboarding of LLM endpoints from Azure AI Foundry  
  • Configure token limiting, token tracking, semantic caching, and content safety  
  • Centralized API governance and observability for generative AI workloads  

Learn more.