July 23, 2026 · Together AI
Dedicated container inference supports HTTP server mode for OpenAI-compatible endpoints
Dedicated container inference now supports HTTP server mode for synchronous, OpenAI-compatible endpoints. Run your worker without the --queue flag, wire an OpenAI route with Sprocket, and call it with the OpenAI SDK or plain HTTP, with no Together-specific request shapes.