Sign up freeSign in
allmodels.ioDocs
Realtime WebSocket referenceAllModels Realtime voice session

AllModels Realtime server events

Reference for the events AllModels returns in a /v1/realtime voice session: session, speech, transcript, response, metric, heartbeat, and error.

The raw document is available at /audio/docs/asyncapi.yaml and from the API at api.allmodels.io/asyncapi.yaml.

Reference for the events AllModels returns in a /v1/realtime voice session: session, speech, transcript, response, metric, heartbeat, and error.

AllModels Realtime voice session

Address

/v1/realtime

Description

Direct client audio, normalized transcription, application text, and synthesized audio.

Authorization

client_secret<token>

Single-use client secret returned by POST /v1/realtime/client-secrets.

In: query

Messages

AllModels Realtime client events RECEIVE

Reference for the events a client sends in an AllModels Realtime voice session on /v1/realtime: audio, commit, cancellation, heartbeat, and close.

OpenAI Realtime speech-to-speech client events RECEIVE

Reference for the OpenAI Realtime client events a client sends on /oai/realtime with a speech-to-speech model.