November 16, 2026 · Together AI
tg endpoints rollout adds --max-surge and --max-unavailable capacity flags
What's new:
- Rollout capacity budgets:
tg endpoints rollouttakes two flags that set a rollout's capacity budgets.--max-surgecaps how many replicas each canary step adds to the target.--max-unavailablelets a rollout start from aDEGRADEDsource, or shut down source replicas to make room for the target. - Config revision lookup:
tg models configs getreturns a config revision by its ID (cr_...). - New shared volumes in scripted cluster creates:
tg clusters createtakes--shared-volume-nameand--shared-volume-size-tib, which create a shared volume with the cluster. Before this release, a--non-interactivecreate could only attach an existing volume. - Attached model resources keep running: An attached
ModelResourcesClienthandle used as a context manager now detaches on exit and leaves the resource running. Before this release, it stopped the resource.
Related updates
Rollouts shift endpoint traffic between deployments with canary, blue-green or rolling
Together CLI and Python SDK 2.34.0 adds rollouts, rejects oversized Parquet files
Public Preview: maxUnavailable Setting for Upgrades in AKS · Azure
Amazon ECS now supports built-in Linear and Canary deployments · AWS
Amazon SageMaker Inference now supports rolling update for inference component endpoints · AWS