Sign up freeSign in
allmodels.ioDocs
Realtime WebSocket referenceAllModels Realtime voice session

AllModels Realtime client events

Reference for the events a client sends in an AllModels Realtime voice session on /v1/realtime: audio, commit, cancellation, heartbeat, and close.

The raw document is available at /audio/docs/asyncapi.yaml and from the API at api.allmodels.io/asyncapi.yaml.

Reference for the events a client sends in an AllModels Realtime voice session on /v1/realtime: audio, commit, cancellation, heartbeat, and close.

AllModels Realtime voice session

Address

/v1/realtime

Description

Direct client audio, normalized transcription, application text, and synthesized audio.

Authorization

client_secret<token>

Single-use client secret returned by POST /v1/realtime/client-secrets.

In: query

Messages

Speech Engine server frames SEND

Reference for the frames AllModels sends in a Speech Engine conversation: metadata, user transcripts, agent text and audio, latency, and errors.

AllModels Realtime server events SEND

Reference for the events AllModels returns in a /v1/realtime voice session: session, speech, transcript, response, metric, heartbeat, and error.