Generally Available: MCP support for AI toolchain operator add-on in AKS

MCP support for AI toolchain operator add-on is now Generally Available.   

The AI Toolchain Operator add-on now supports KAITO inference workspaces with integrated tool calling and Model Context Protocol (MCP), addressing key challenges around dynamic model interaction and real-time data integration.  

Previously, developers faced friction deploying LLM-based services that needed external tool access, such as APIs or custom functions, often requiring bespoke orchestration. Now, you can benefit from seamless integration of KAITO’s vLLM-based tool calling with supported models, along with MCP support for connecting models to external systems in real time – to enable smarter, more context-aware AI services directly within AKS. 

Learn more:

• about Integrate tool calling with LLM Inference with the AI toolchain operator add-on on Azure Kubernetes Service (AKS)
  
• about Integrate an MCP server with an LLM Inference Service on Azure Kubernetes Service (AKS)