OpenAI: Whisper Large v3
OpenAI multilingual speech-to-text and speech-translation model: the large-v3 checkpoint, with improved multilingual performance over large-v2 and a new Cantonese language token.
Providers
Different providers can host the same model. Choose one provider when you need a fixed backend, or let routing select among them.
Supported languages
en
zh
de
es
ru
ko
fr
ja
pt
tr
pl
ca
nl
ar
sv
it
id
hi
fi
vi
he
uk
el
ms
cs
ro
da
hu
ta
no
th
ur
hr
bg
lt
la
mi
ml
cy
sk
te
fa
lv
bn
sr
az
sl
kn
et
mk
br
eu
is
hy
ne
mn
bs
kk
sq
sw
gl
mr
pa
si
km
sn
yo
so
af
oc
ka
be
tg
sd
gu
am
yi
lo
uz
fo
ht
ps
tk
nn
mt
sa
lb
my
bo
tl
mg
as
tt
haw
ln
ha
ba
jw
su
yue
Features
Transcribes spoken audio into text.
speech_to_text
Real-time streaming transcription over a WebSocket connection.
streaming
Transcribes a fully-submitted audio file in a single synchronous request.
synchronous
Supports transcription across the Whisper multilingual language set.
multilingual_transcription
Can translate supported source-language speech into English text.
translation_to_english
Can infer the source language automatically when the runtime/provider supports the Whisper language detection path.
automatic_language_detection
Supports timestamped transcription output at segment level, with word-level timestamps available in common Whisper inference pipelines.
timestamps
Code
ElevenLabs SDK streaming STT
Streams microphone or file audio through the ElevenLabs-compatible allmodels route.
import { ElevenLabsClient } from "elevenlabs";
const client = new ElevenLabsClient({
apiKey: process.env.ALLMODELS_API_KEY,
baseUrl: "https://api.allmodels.io/el"
});
const connection = await client.speechToText.realtime.connect({
modelId: "openai/whisper-large-v3",
languageCode: "en"
}, {
queryParams: {
provider: {
"only": [
"fal"
]
}
}
});
// Send audio frames to connection, then handle transcript events.