600msも待てない音声エージェントのために

OpenAI: Whisper Large v3 Turbo

openai/whisper-large-v3-turbo
提供中 stt 1プロバイダー
Playground

OpenAI speed-optimized Whisper Large v3 derivative: a pruned and finetuned large-v3 model with decoder layers reduced from 32 to 4 for faster inference at minor quality degradation.

作成者OpenAI
言語100言語
ステータス提供中

プロバイダー

同じモデルを複数のプロバイダーがホストしている場合があります。バックエンドを固定したい場合は1つのプロバイダーを選び、そうでなければルーティングに選択を任せられます。

プロバイダーSlug1時間あたりレイテンシiTTSのレイテンシは音声の最初のバイトが届くまでの時間、STTのレイテンシは最初のトークンが届くまでの時間で計測しています。モード稼働率
Groq 7個のパラメーター
groq
$0.04
—
同期

対応言語

100言語
English en
Chinese zh
German de
Spanish es
Russian ru
Korean ko
French fr
Japanese ja
Portuguese pt
Turkish tr
Polish pl
Catalan ca
Dutch nl
Arabic ar
Swedish sv
Italian it
Indonesian id
Hindi hi
Finnish fi
Vietnamese vi
Hebrew he
Ukrainian uk
Greek el
Malay ms
Czech cs
Romanian ro
Danish da
Hungarian hu
Tamil ta
Norwegian no
Thai th
Urdu ur
Croatian hr
Bulgarian bg
Lithuanian lt
Latin la
Maori mi
Malayalam ml
Welsh cy
Slovak sk
Telugu te
Persian fa
Latvian lv
Bengali bn
Serbian sr
Azerbaijani az
Slovenian sl
Kannada kn
Estonian et
Macedonian mk
Breton br
Basque eu
Icelandic is
Armenian hy
Nepali ne
Mongolian mn
Bosnian bs
Kazakh kk
Albanian sq
Swahili sw
Galician gl
Marathi mr
Punjabi pa
Sinhala si
Khmer km
Shona sn
Yoruba yo
Somali so
Afrikaans af
Occitan oc
Georgian ka
Belarusian be
Tajik tg
Sindhi sd
Gujarati gu
Amharic am
Yiddish yi
Lao lo
Uzbek uz
Faroese fo
Haitian Creole ht
Pashto ps
Turkmen tk
Nynorsk nn
Maltese mt
Sanskrit sa
Luxembourgish lb
Myanmar my
Tibetan bo
Tagalog tl
Malagasy mg
Assamese as
Tatar tt
Hawaiian haw
Lingala ln
Hausa ha
Bashkir ba
Javanese jw
Sundanese su
Cantonese yue

機能

Speech to text

Transcribes spoken audio into text.

speech_to_text
Synchronous

Transcribes a fully-submitted audio file in a single synchronous request.

synchronous
Multilingual transcription

Supports transcription across the Whisper multilingual language set.

multilingual_transcription
Translation to English

Can translate supported source-language speech into English text.

translation_to_english
Automatic language detection

Can infer the source language automatically when the runtime/provider supports the Whisper language detection path.

automatic_language_detection
Timestamps

Supports timestamped transcription output at segment level, with word-level timestamps available in common Whisper inference pipelines.

timestamps
Speed optimized

Uses a reduced decoder depth for faster inference compared with the full Whisper Large v3 checkpoint.

speed_optimized

コード

クライアント
モード
言語

ElevenLabs SDKでのストリーミングSTT

マイクまたはファイルの音声を、ElevenLabs互換のAllModelsルート経由でストリーミングします。

import { ElevenLabsClient } from "elevenlabs";

const client = new ElevenLabsClient({
  apiKey: process.env.ALLMODELS_API_KEY,
  baseUrl: "https://api.allmodels.io/el"
});

const connection = await client.speechToText.realtime.connect({
  modelId: "openai/whisper-large-v3-turbo",
  languageCode: "en"
}, {
  queryParams: {
    provider: {
      "only": [
        "groq"
      ]
    }
  }
});

// Send audio frames to connection, then handle transcript events.