Sign up freeSign in
allmodels.ioDocs
Realtime WebSocket referenceElevenLabs-compatible Speech Engine conversation

Speech Engine server frames

Reference for the frames AllModels sends in a Speech Engine conversation: metadata, user transcripts, agent text and audio, latency, and errors.

The raw document is available at /audio/docs/asyncapi.yaml and from the API at api.allmodels.io/asyncapi.yaml.

Reference for the frames AllModels sends in a Speech Engine conversation: metadata, user transcripts, agent text and audio, latency, and errors.

ElevenLabs-compatible Speech Engine conversation

Address

/el/v1/convai/conversation

Description

Direct client STT, application response, and streamed TTS conversation.

Authorization

conversation_signature
conversation_signature<token>

Opaque grant returned in the signed conversation URL.

In: query

Messages

Speech Engine client frames RECEIVE

Reference for the frames a client device sends in an ElevenLabs-compatible Speech Engine conversation: audio input, pong, and typed user messages.

AllModels Realtime client events RECEIVE

Reference for the events a client sends in an AllModels Realtime voice session on /v1/realtime: audio, commit, cancellation, heartbeat, and close.