Generally Available: LLM Logging in AI Gateway Capabilities in Azure API Management

Announcing the general availability of LLM logging in Azure API Management’s AI Gateway. This capability allows you to capture and store LLM prompts, completions, and token usage metrics, enabling deeper insights into AI usage and the performance of intelligent applications.  

By enabling this feature through diagnostic settings, you can send logs to Azure Monitor, Azure Storage, or Azure Event Hubs for long-term retention, real-time processing, and advanced analytics.  

Key benefits:  

• End-to-end visibility into LLM usage across your applications  
• Support for streaming completions without disrupting user experience  
• Enterprise-grade observability aligned with your compliance and monitoring requirements  

Learn more.