'%3e%3crect%20x='16'%20y='51'%20width='68'%20height='27'%20rx='13.5'/%3e%3ccircle%20cx='32'%20cy='53'%20r='15'/%3e%3ccircle%20cx='53'%20cy='43'%20r='20'/%3e%3ccircle%20cx='71'%20cy='57'%20r='12'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Cloud Changelog
September 15, 2025 · Together AI
Batch inference adds UI and all serverless models, with 30B enqueued token limit
- Streamlined UI: Create and track batch jobs in an intuitive interface. No complex API calls required.
- Universal model access: The batch inference API now supports all serverless models and private deployments, so you can run batch workloads on exactly the models you need.
- Massive scale jump: Rate limits are up from 10M to 30B enqueued tokens per model per user, a 3,000x increase. Need more? Together will work with you to customize.
- Lower cost: For most serverless models, the batch inference API runs at 50% the cost of the real-time API, making it the most economical way to process high-throughput workloads.