Skip to content
Back to feed

April 22, 2026 · Cerebras

Cerebras Inference adds prompt_cache_key parameter to chat completions and completions

/v1/chat/completions and /v1/completions now accept an optional prompt_cache_key parameter. Requests that share the same key are routed together so they reuse the same prompt cache, increasing cache hits and reducing time to first token. Set it to your conversation ID for chat sessions, your user or session ID for per-user workloads, or a hash of your shared prefix for RAG and agentic workloads.

Latest Cerebras Inference changes

All Cerebras Inference changes