Conçu pour les agents vocaux qui ne peuvent pas attendre 600ms

xAI : Grok Voice 3.0

xai/grok-voice-3-0
actif speech-to-speech 1 fournisseur
Playground

xAI's flagship realtime speech-to-speech voice agent over WebSockets, with reasoning on by default, low-latency turn-taking, interruptions and tool use such as web search.

AuteurxAI
Langues20 langues
Formats de réponseStreaming : PCM · µ-law · A-law · Opus
Modèles variantes2 ID
Statutactif

Modèles variantes

Il s’agit d’ID de modèles natifs acceptés par l’auteur ou le fournisseur pour la même famille de modèles canonique.

Grok Voice 3.0 Default

Pinned Grok Voice 3.0 release, selected via the model query param on /v1/realtime.

grok-voice-3.0
Grok Voice (latest) Alias

Alias that xAI points at its current flagship voice model, grok-voice-3.0 since 2026-10-14.

grok-voice-latest

Fournisseurs

Plusieurs fournisseurs peuvent héberger le même modèle. Choisissez-en un lorsque vous avez besoin d’un backend fixe, ou laissez le routage choisir parmi eux.

FournisseurSlugPar heureLatenceiPour le TTS, la latence correspond au délai jusqu’au premier octet audio. Pour le STT, elle correspond au délai jusqu’au premier token.ModesDisponibilité
xAI 5 paramètres
grok
$4,8
—
Streaming

Langues prises en charge

20 langues
English en
Arabic (Egypt) ar-EG
Arabic (Saudi Arabia) ar-SA
Arabic (United Arab Emirates) ar-AE
Bengali bn
Chinese (Simplified) zh
French fr
German de
Hindi hi
Indonesian id
Italian it
Japanese ja
Korean ko
Portuguese (Brazil) pt-BR
Portuguese (Portugal) pt-PT
Russian ru
Spanish (Mexico) es-MX
Spanish (Spain) es-ES
Turkish tr
Vietnamese vi

Fonctionnalités

Speech to speech

Bidirectional realtime speech-to-speech over WebSocket.

speech_to_speech
Low-latency turn-taking

Natural conversational turn-taking.

turn_taking
Tool use

Integrated tool calling (e.g. web search) during conversation.

tool_use
Input transcription

Optional transcription of input audio, biased by a language hint and key terms.

input_transcription
Configurable reasoning effort

Reasoning is on by default and can be turned off per session with reasoning.effort none.

reasoning_effort

Code

Langage

Voix à voix temps réel avec l’OpenAI SDK

Envoie question.pcm (PCM mono 16 bits à 24 kHz) en un seul tour via le protocole OpenAI Realtime et enregistre la réponse parlée dans reply.pcm.

import { once } from "node:events";
import { readFile, writeFile } from "node:fs/promises";
import OpenAI from "openai";
import { OpenAIRealtimeWS } from "openai/realtime/ws";

const client = new OpenAI({
  apiKey: process.env.ALLMODELS_API_KEY,
  baseURL: "https://api.allmodels.io/oai"
});
const realtime = new OpenAIRealtimeWS({ model: "grok-voice-3.0" }, client);
const reply = [];

realtime.on("response.output_audio.delta", ({ delta }) => reply.push(Buffer.from(delta, "base64")));
realtime.on("response.done", async () => {
  await writeFile("reply.pcm", Buffer.concat(reply));
  realtime.close();
});
realtime.on("error", console.error);

if (realtime.socket.readyState !== 1) await once(realtime.socket, "open");
const format = { type: "audio/pcm", rate: 24000 };
realtime.send({
  type: "session.update",
  session: {
    voice: "eve",
    output_modalities: ["audio"],
    turn_detection: { type: null },
    audio: { input: { format }, output: { format } }
  }
});
realtime.send({ type: "input_audio_buffer.append", audio: (await readFile("question.pcm")).toString("base64") });
realtime.send({ type: "input_audio_buffer.commit" });
realtime.send({ type: "response.create" });