Skip to content
Back to feed

August 29, 2026 · Together AI

Dedicated endpoint autoscaling adds active_sessions metric for TTS WebSocket sessions

Dedicated endpoint autoscaling now accepts active_sessions, which targets concurrent open client WebSocket sessions per replica on a TTS deployment (AVERAGE_VALUE only). The default inflight_requests metric also covers TTS handlers, so HTTP TTS traffic can keep scaling without a policy change.

See Configure autoscaling.

All Together AI platform changes