August 29, 2026 · Together AI
Dedicated endpoint autoscaling adds active_sessions metric for TTS WebSocket sessions
Dedicated endpoint autoscaling now accepts active_sessions, which targets concurrent open client WebSocket sessions per replica on a TTS deployment (AVERAGE_VALUE only). The default inflight_requests metric also covers TTS handlers, so HTTP TTS traffic can keep scaling without a policy change.