June 1, 2026 · Together AI
Compare evaluator adds disable_position_bias_correction, halving judge cost and latency
The compare evaluator now accepts a disable_position_bias_correction parameter. By default, the judge runs each comparison twice (A→B then B→A) and reconciles verdicts to cancel position bias. Setting disable_position_bias_correction to true runs a single pass, cutting judge cost and latency in half. See the evaluations reference for details.