Batch API and Files API: up to 50,000 requests per batch at 50% lower cost

Process large-scale inference workloads asynchronously with the new Batch API and Files API. Submit up to 50,000 requests in a single batch job and get 50% cost savings.

Learn more in our Batch guide.