Together Python SDK 3.0, TypeScript SDK 1.0 and CLI 3.0 released with breaking changes

Together Python SDK 3.0, TypeScript SDK 1.0, and Together CLI 3.0 are now available.

3.0 is a major release with breaking changes. The beta paths for dedicated model inference and GPU clusters no longer work, the SDK base URL drops /v1, and whoami returns a new response shape. Read SDK v3 migration before you upgrade.

What's new:

• Dedicated model inference and GPU clusters out of beta: Manage dedicated model inference and GPU clusters with client.endpoints, client.models, and client.clusters, or with tg endpoints, tg models, and tg clusters in the CLI.
• Faster chat completions: The SDKs send chat completions directly to the inference host, https://api-inference.together.ai, by default.
• Identity for any credential: client.whoami() returns a typed identity for project API keys, organization API keys, and user sessions, including credentials that aren't scoped to a project.
• Billing usage in the SDK: client.organization.usage.costs.list() returns your organization's cost line items by day or hour from the billing usage API, which is in beta and enabled per organization.