Realtime WebSocket reference
Message-level AsyncAPI reference for every AllModels WebSocket channel.
Explore every AllModels WebSocket channel, the frames clients send and receive, their payload schemas, and examples.
Channels
Native streaming TTS
Stream text in, receive binary audio out, using a simple JSON command protocol.
Native streaming STT
Stream binary audio in and receive normalized, sequenced STT events.
ElevenLabs SDK-compatible streaming-input TTS
ElevenLabs stream-input protocol across supported TTS providers.
ElevenLabs SDK-compatible realtime STT
ElevenLabs realtime STT protocol across supported STT providers.
OpenAI SDK-compatible realtime transcription
GA OpenAI Realtime transcription events across supported STT providers.
ElevenLabs-compatible Speech Engine conversation
Direct client STT, application response, and streamed TTS conversation.
AllModels Realtime voice session
Direct client audio, normalized transcription, application text, and synthesized audio.
OpenAI Realtime speech-to-speech
OpenAI Realtime speech-to-speech events for OpenAI and Grok Voice models, passed through unchanged.
OpenAI GPT-Live speech-to-speech
GPT-Live speech-to-speech events for gpt-live-1 and gemini-3.8-live, client delegation only.
Reference documents
- The raw AsyncAPI document is available at
/asyncapi.yaml. - The API also serves its own copy at
https://api.allmodels.io/asyncapi.yaml. - HTTP upgrade parameters, headers, and error responses are covered in the API reference.
Using WebSockets
See the streaming and realtime guide for complete SDK examples and message flows.
OpenAI SDK-compatible GPT-Live speech-to-speech GET
Holds a speech-to-speech conversation over the OpenAI GPT-Live protocol; `gpt-live-1` and `gemini-3.8-live` share its frames. Set the OpenAI SDK base URL to `https://api.allmodels.io/oai` and authenticate with your AllModels API key.
Native TTS client frames RECEIVE
Reference for the JSON command frames a client sends on the native /v1/tts WebSocket: text chunks, flush, and close, with schemas and examples.