Announcing
expanded support for AWS Bedrock model endpoints across all Generative AI
policies in Azure API Management’s AI Gateway. This release enables you to
apply advanced management and optimization features such as Token Limit Policy,
Token Metric Policy, and Semantic Caching Policy to AWS Bedrock models,
empowering you to seamlessly manage and optimize your multi-cloud AI
workloads.
Key
benefits:
- Apply token limiting,
tracking, and logging to AWS Bedrock APIs for better control
- Enable semantic caching to
enhance performance and response times for Bedrock models
- Achieve unified observability
and governance across multi-cloud AI endpoints
Learn more.