Public Preview: Bring Your Own AI Gateway to Foundry Agent Service

The BYO AI Model Gateway feature allows enterprises to connect Foundry-hosted models through any AI gateway services like Azure API Management, Mulesoft, and Kong, to Foundry Agent Service. The Agent Service honors pre/post‑LLM hooks, policy‑based model selection, and multi‑region/multi‑provider load‑balancing with automatic failover, so teams can optimize for latency, cost, compliance, and availability without changing application code. This enables organizations to build agents using their own managed endpoints while maintaining enterprise-grade governance, security, and compliance.
Learn more.