Sign up freeSign in
allmodels.ioDocs
Realtime WebSocket referenceElevenLabs-compatible Speech Engine conversation

Speech Engine client frames

Reference for the frames a client device sends in an ElevenLabs-compatible Speech Engine conversation: audio input, pong, and typed user messages.

The raw document is available at /audio/docs/asyncapi.yaml and from the API at api.allmodels.io/asyncapi.yaml.

Reference for the frames a client device sends in an ElevenLabs-compatible Speech Engine conversation: audio input, pong, and typed user messages.

ElevenLabs-compatible Speech Engine conversation

Address

/el/v1/convai/conversation

Description

Direct client STT, application response, and streamed TTS conversation.

Authorization

conversation_signature
conversation_signature<token>

Opaque grant returned in the signed conversation URL.

In: query

Messages

OpenAI realtime server events SEND

Reference for the OpenAI GA transcription events AllModels returns on /oai/realtime: session, speech detection, transcript delta, and error events.

Speech Engine server frames SEND

Reference for the frames AllModels sends in a Speech Engine conversation: metadata, user transcripts, agent text and audio, latency, and errors.