600msも待てない音声エージェントのために

Google Gemini: Gemini 3.5 Transcribe Live

gemini/gemini-3-5-transcribe-live
提供中 stt 1プロバイダー
Playground

Streaming variant of Gemini 3.5 Transcribe (launched 2026-08-26): continuous low-latency speech recognition over the Live API (bidiGenerateContent) with 85+ auto-detected languages and sessions capped at 10 minutes.

作成者Google Gemini
言語83言語
ステータス提供中

プロバイダー

同じモデルを複数のプロバイダーがホストしている場合があります。バックエンドを固定したい場合は1つのプロバイダーを選び、そうでなければルーティングに選択を任せられます。

プロバイダーSlug1時間あたりレイテンシiTTSのレイテンシは音声の最初のバイトが届くまでの時間、STTのレイテンシは最初のトークンが届くまでの時間で計測しています。モード稼働率
Google Gemini 3個のパラメーター
gemini
$0.54
—
ストリーミング

対応言語

83言語
Afrikaans af-ZA
Amharic am-ET
Arabic (Egypt) ar-EG
Armenian hy-AM
Assamese as-IN
Azerbaijani az-AZ
Belarusian be-BY
Bengali (Bangladesh) bn-BD
Bengali (India) bn-IN
Bosnian bs-BA
Bulgarian bg-BG
Bulgarian (Aromanian) rup-BG
Burmese my-MM
Catalan ca-ES
Cebuano ceb
Central Khmer km-KH
Croatian hr-HR
Czech cs-CZ
Danish da-DK
Dutch nl-NL
English (Great Britain) en-GB
English (India) en-IN
English (United States) en-US
Estonian et-EE
Farsi fa-IR
Filipino fil-PH
Finnish fi-FI
French fr-FR
Galician gl-ES
Georgian ka-GE
German de-DE
Greek el-GR
Gujarati gu-IN
Hausa ha-NG
Hebrew he-IL
Hindi hi-IN
Hungarian hu-HU
Icelandic is-IS
Indonesian id-ID
Italian it-IT
Japanese ja-JP
Javanese jv-ID
Kabuverdianu kea-CV
Kannada kn-IN
Kazakh kk-KZ
Korean ko-KR
Kyrgyz ky-KG
Latvian lv-LV
Lingala ln-CD
Lithuanian lt-LT
Macedonian mk-MK
Malay ms-MY
Malayalam ml-IN
Maltese mt-MT
Mandarin Chinese (Simplified) cmn-Hans-CN
Marathi mr-IN
Mongolian mn-MN
Nepali ne-NP
Norwegian nb-NO
Oriya or-IN
Polish pl-PL
Portuguese (Brazil) pt-BR
Portuguese (Portugal) pt-PT
Punjabi pa-IN
Punjabi (Gurmukhi script) pa-Guru-IN
Romanian ro-RO
Russian ru-RU
Serbian sr-RS
Sindhi (Arabic script) sd-Arab-IN
Slovak sk-SK
Slovenian sl-SI
Spanish (Latin America) es-419
Spanish (United States) es-US
Swahili (Kenya) sw-KE
Swedish sv-SE
Tajik tg-TJ
Telugu te-IN
Thai th-TH
Turkish tr-TR
Ukrainian uk-UA
Uzbek uz-UZ
Vietnamese vi-VN
Cantonese (Traditional) yue-Hant-HK

機能

Speech to text

Transcribes live audio streams to text over the Live API.

speech_to_text
Streaming

Continuous bidirectional streaming over the Live API (bidiGenerateContent) with speculative interim transcripts (interim_input_transcription) ahead of finalized ones (input_transcription), no published latency SLA, and sessions up to 10 minutes.

streaming
Multilingual transcription

Automatically detects and transcribes 85+ languages, including code-switching.

multilingual_transcription
Interim transcripts

Emits speculative interim_input_transcription events while the speaker is talking, followed by finalized input_transcription events when speech is finalized.

interim_transcripts
Custom vocabulary

Biases recognition toward up to 1,000 supplied terms, acronyms, brand names, or proper nouns (best results with up to 100).

custom_vocabulary
Smart transcription

Optional SMART mode removes filler words, stuttering, and false starts and applies structured formatting; default is VERBATIM.

smart_transcription
Voice activity detection modes

Automatic server-side VAD (default), hybrid (server detects speech start, client ends via audio_stream_end), or manual push-to-talk (automatic_activity_detection.disabled with explicit activity_start/activity_end signals).

vad_modes

コード

クライアント
モード
言語

ElevenLabs SDKでのストリーミングSTT

マイクまたはファイルの音声を、ElevenLabs互換のAllModelsルート経由でストリーミングします。

import { ElevenLabsClient } from "elevenlabs";

const client = new ElevenLabsClient({
  apiKey: process.env.ALLMODELS_API_KEY,
  baseUrl: "https://api.allmodels.io/el"
});

const connection = await client.speechToText.realtime.connect({
  modelId: "gemini/gemini-3-5-transcribe-live",
  languageCode: "en"
}, {
  queryParams: {
    provider: {
      "only": [
        "gemini"
      ]
    }
  }
});

// Send audio frames to connection, then handle transcript events.