Skip to content
Back to feed

November 16, 2026 · Together AI

tg endpoints rollout adds --max-surge and --max-unavailable capacity flags

What's new:

  • Rollout capacity budgets: tg endpoints rollout takes two flags that set a rollout's capacity budgets. --max-surge caps how many replicas each canary step adds to the target. --max-unavailable lets a rollout start from a DEGRADED source, or shut down source replicas to make room for the target.
  • Config revision lookup: tg models configs get returns a config revision by its ID (cr_...).
  • New shared volumes in scripted cluster creates: tg clusters create takes --shared-volume-name and --shared-volume-size-tib, which create a shared volume with the cluster. Before this release, a --non-interactive create could only attach an existing volume.
  • Attached model resources keep running: An attached ModelResourcesClient handle used as a context manager now detaches on exit and leaves the resource running. Before this release, it stopped the resource.

All Together AI platform changes