Skip to content
Back to feed

March 25, 2026 · Cerebras

Logprobs computed before temperature scaling, so they no longer vary with temperature

Logprobs are now computed from the model's raw output, before applying temperature scaling. Previously, logprob values would vary with temperature — they now remain consistent regardless of the temperature used. This aligns with standard behavior across major inference providers and vLLM. Sampled outputs are unaffected.

Latest Cerebras Inference changes

All Cerebras Inference changes