Skip to content
Back to feed

November 11, 2026 · Google CloudFeature

Apigee hybrid SanitizeUserPrompt and SanitizeModelResponse support function calling

SanitizeUserPrompt and SanitizeModelResponse policies now support function calling

The SanitizeUserPrompt and SanitizeModelResponse policies now handle LLM function calling (tool use) flows. Two new optional XML elements extract function calling content for Model Armor sanitization:

  • <FunctionResponseSource> in SanitizeUserPrompt: extracts function/tool response data from user turns. Used as a fallback when <UserPromptSource> returns empty on function calling turns.
  • <FunctionCallSource> in SanitizeModelResponse: extracts function call arguments from model responses. Used as a fallback when <LLMResponseSource> returns empty.

Default templates target the Gemini format and require no additional configuration. For OpenAI and Anthropic formats, configure custom JSONPath templates. For more information, see FunctionResponseSource and FunctionCallSource.

Text from the Google Cloud release notes, licensed under CC BY 4.0. Source: Google Cloud release notes.

All Apigee hybrid changes