Skip to content
Back to feed

July 23, 2026 · Together AI

Dedicated container inference supports HTTP server mode for OpenAI-compatible endpoints

Dedicated container inference now supports HTTP server mode for synchronous, OpenAI-compatible endpoints. Run your worker without the --queue flag, wire an OpenAI route with Sprocket, and call it with the OpenAI SDK or plain HTTP, with no Together-specific request shapes.

See Serve an OpenAI-compatible endpoint.

Latest Together AI platform changes

All Together AI platform changes