OpenAI : Whisper Large v3
OpenAI multilingual speech-to-text and speech-translation model: the large-v3 checkpoint, with improved multilingual performance over large-v2 and a new Cantonese language token.
Fournisseurs
Plusieurs fournisseurs peuvent héberger le même modèle. Choisissez-en un lorsque vous avez besoin d’un backend fixe, ou laissez le routage choisir parmi eux.
Langues prises en charge
en
zh
de
es
ru
ko
fr
ja
pt
tr
pl
ca
nl
ar
sv
it
id
hi
fi
vi
he
uk
el
ms
cs
ro
da
hu
ta
no
th
ur
hr
bg
lt
la
mi
ml
cy
sk
te
fa
lv
bn
sr
az
sl
kn
et
mk
br
eu
is
hy
ne
mn
bs
kk
sq
sw
gl
mr
pa
si
km
sn
yo
so
af
oc
ka
be
tg
sd
gu
am
yi
lo
uz
fo
ht
ps
tk
nn
mt
sa
lb
my
bo
tl
mg
as
tt
haw
ln
ha
ba
jw
su
yue
Fonctionnalités
Transcribes spoken audio into text.
speech_to_text
Real-time streaming transcription over a WebSocket connection.
streaming
Transcribes a fully-submitted audio file in a single synchronous request.
synchronous
Supports transcription across the Whisper multilingual language set.
multilingual_transcription
Can translate supported source-language speech into English text.
translation_to_english
Can infer the source language automatically when the runtime/provider supports the Whisper language detection path.
automatic_language_detection
Supports timestamped transcription output at segment level, with word-level timestamps available in common Whisper inference pipelines.
timestamps
Code
STT en streaming avec l’ElevenLabs SDK
Diffuse l’audio du micro ou d’un fichier via la route AllModels compatible ElevenLabs.
import { ElevenLabsClient } from "elevenlabs";
const client = new ElevenLabsClient({
apiKey: process.env.ALLMODELS_API_KEY,
baseUrl: "https://api.allmodels.io/el"
});
const connection = await client.speechToText.realtime.connect({
modelId: "openai/whisper-large-v3",
languageCode: "en"
}, {
queryParams: {
provider: {
"only": [
"fal"
]
}
}
});
// Send audio frames to connection, then handle transcript events.