Skip to content
OpenAI

gpt-realtime-whisper

gpt-realtime-whisper is a streaming speech-to-text model for realtime transcription, returning transcript text while audio is still arriving, with a tunable latency and accuracy tradeoff and pricing based on audio duration rather than tokens. Your use is subject to OpenAI's Terms & Privacy Policies.

Websockets
Use with AI GatewayView docs
import { experimental_streamTranscribe as streamTranscribe } from 'ai';
import { createGateway, gateway } from '@ai-sdk/gateway';
import { readFile } from 'node:fs/promises';


const modelId = 'openai/gpt-realtime-whisper';


// Mint this on your server, then send only the short-lived token to the client.
const { token } = await gateway.experimental_transcription.getToken({
  model: modelId,
});
const clientGateway = createGateway({ apiKey: token });


// Raw 24 kHz, 16-bit signed little-endian mono PCM audio.
const bytes = await readFile('audio.pcm');
const audio = new ReadableStream<Uint8Array>({
  start(controller) {
    controller.enqueue(new Uint8Array(bytes));
    controller.close();
  },
});


const result = streamTranscribe({
  model: clientGateway.transcription(modelId),
  audio,
  inputAudioFormat: { type: 'audio/pcm', rate: 24000 },
});


for await (const part of result.fullStream) {
  if (part.type === 'transcript-delta') {
    process.stdout.write(part.delta);
  }
}


console.log('\nFinal:', await result.text);
Read docs
OverviewAboutProvidersSimilarFAQ

About gpt-realtime-whisper

gpt-realtime-whisper arrived on May 7, 2026 as OpenAI's streaming speech-to-text model for realtime transcription. Whisper-generation models transcribe completed audio, which suits recordings and post-session processing. gpt-realtime-whisper is the streaming counterpart, built for live audio where the transcript has to appear during the conversation.

Latency and accuracy are tunable rather than fixed. A delay setting controls how much audio gpt-realtime-whisper hears before emitting text: lower values surface partial text sooner, and higher values give the model more context and improve transcript quality. You can also pass the languages you expect and vocabulary hints, so product names, acronyms, and identifiers come through correctly.

gpt-realtime-whisper accepts audio and text input and returns text, with a context window of 0 tokens and up to varies of transcript output per turn. Pricing is based on audio duration rather than text tokens, so cost tracks minutes of speech and forecasts cleanly from call volume. Current rates are listed on this page.

Audio support on AI Gateway is in beta through AI SDK 7. Your server mints a short-lived token and the client streams audio over a WebSocket connection, so your AI Gateway API key never reaches the browser. You get the same authentication, observability, and spend controls as your text models, with no markup on provider pricing.