Announcing
the general availability of LLM logging in Azure API Management’s AI Gateway.
This capability allows you to capture and store LLM prompts, completions, and
token usage metrics, enabling deeper insights into AI usage and the performance
of intelligent applications.
By
enabling this feature through diagnostic settings, you can send logs to Azure
Monitor, Azure Storage, or Azure Event Hubs for long-term retention, real-time
processing, and advanced analytics.
Key
benefits:
- End-to-end visibility into LLM
usage across your applications
- Support for streaming
completions without disrupting user experience
- Enterprise-grade observability
aligned with your compliance and monitoring requirements
Learn more.