AssemblyAI: Universal-Streaming Multilingual

Name: Universal-Streaming Multilingual
Author: AssemblyAI

assemblyai/universal-streaming-multilingual

active stt 1 provider

Playground

Realtime speech-to-text across 6 languages in one unified streaming model.

AuthorAssemblyAI

Languages6 languages

Statusactive

Quick start

Universal-Streaming Multilingual

Create an API key

Create API key

Make a request

Pick an SDK, request mode, and language. The model and provider route are already filled in.

ElevenLabs SDK streaming STT

Streams microphone or file audio through the ElevenLabs-compatible allmodels route.

import { ElevenLabsClient } from "elevenlabs";

const client = new ElevenLabsClient({
  apiKey: process.env.ALLMODELS_API_KEY,
  baseUrl: "https://api.allmodels.io/el"
});

const connection = await client.speechToText.realtime.connect({
  modelId: "assemblyai/universal-streaming-multilingual",
  languageCode: "en"
}, {
  queryParams: {
    provider: {
      "only": [
        "assemblyai"
      ]
    }
  }
});

// Send audio frames to connection, then handle transcript events.

Pass provider parameters

Pass provider preferences through the compatible SDK request options when you want to pin a route to a provider.

{
  queryParams: {
    provider: {
      only: ["assemblyai"]
    }
  }
}

Providers

Different providers can host the same model. Choose one provider when you need a fixed backend, or let routing select among them.

ProviderSlugPer hourLatencyiModesUptime

AssemblyAI 14 params

assemblyai

$0.15

—

Streaming

AssemblyAI

14 documented provider parameters for this route.

Pricing

ModeLanguagePer hour

Streaming Any $0.15

+ Speaker Diarization (Streaming) Any $0.12

+ Medical Mode Any $0.15

+ Keyterms Prompting Any $0.04

Parameters

domain body · unknown · optional

Mapped from allmodels parameter "domain".

encoding body · unknown · optional

Mapped from allmodels parameter "response_format".

end_of_turn_confidence_threshold body · unknown · optional

Mapped from allmodels parameter "end_of_turn_confidence_threshold".

format_turns body · unknown · optional

Mapped from allmodels parameter "format_turns".

inactivity_timeout body · unknown · optional

Mapped from allmodels parameter "inactivity_timeout".

keyterms_prompt body · unknown · optional

Mapped from allmodels parameter "keyterms_prompt".

language_detection body · unknown · optional

Mapped from allmodels parameter "language_detection".

max_speakers body · unknown · optional

Mapped from allmodels parameter "max_speakers".

max_turn_silence body · unknown · optional

Mapped from allmodels parameter "max_turn_silence".

min_turn_silence body · unknown · optional

Mapped from allmodels parameter "min_turn_silence".

sample_rate body · unknown · optional

Mapped from allmodels parameter "sample_rate".

speaker_labels body · unknown · optional

Mapped from allmodels parameter "diarization".

speech_model body · unknown · optional

Mapped from allmodels parameter "model".

vad_threshold body · unknown · optional

Mapped from allmodels parameter "vad_threshold".

Supported languages

6 languages

English en

Spanish es

French fr

German de

Italian it

Portuguese pt

Features

Speech to text

Transcribes spoken audio to text.

speech_to_text

Streaming

Real-time streaming transcription over WebSocket.

streaming

Multilingual transcription

Supports 6 languages (en, es, fr, de, it, pt).

multilingual_transcription

Speaker diarization

Identifies and labels multiple speakers.

speaker_diarization

Word-level timestamps

Returns word-level timestamps.

word_timestamps

Code

ElevenLabs SDK streaming STT

Streams microphone or file audio through the ElevenLabs-compatible allmodels route.

import { ElevenLabsClient } from "elevenlabs";

const client = new ElevenLabsClient({
  apiKey: process.env.ALLMODELS_API_KEY,
  baseUrl: "https://api.allmodels.io/el"
});

const connection = await client.speechToText.realtime.connect({
  modelId: "assemblyai/universal-streaming-multilingual",
  languageCode: "en"
}, {
  queryParams: {
    provider: {
      "only": [
        "assemblyai"
      ]
    }
  }
});

// Send audio frames to connection, then handle transcript events.