Real-time streaming for TTS and STT, new TTS models, and speaker diarization

Together AI expands audio capabilities with real-time streaming for both TTS and STT, new models, and speaker diarization.

• Real-time text-to-speech: WebSocket API for lowest-latency interactive applications.
• New TTS models: Orpheus 3B (canopylabs/orpheus-3b-0.1-ft) and Kokoro 82M (hexgrad/Kokoro-82M), supporting REST, streaming, and WebSocket endpoints.
• Real-time speech-to-text: WebSocket streaming transcription with Whisper for live audio applications.
• Voxtral model: New Mistral AI speech recognition model (mistralai/Voxtral-Mini-3B-2507) for audio transcriptions.
• Speaker diarization: Identify and label different speakers in audio transcriptions with a free diarize flag.
• TTS WebSocket endpoint: /v1/audio/speech/websocket.
• STT WebSocket endpoint: /v1/realtime.

See the Text-to-speech guide and Speech-to-text guide.