gpt-realtime-2.1
gpt-realtime-2.1 updates GPT-Realtime-2 with better alphanumeric recognition, steadier silence and noise handling, and improved interruption behavior, keeping speech-to-speech interaction, configurable reasoning effort, instruction following, and tool use for complex voice-agent workflows. Your use is subject to OpenAI's Terms & Privacy Policies.
import { gateway } from '@ai-sdk/gateway';
export async function POST() { const { token, url } = await gateway.experimental_realtime.getToken({ model: 'openai/gpt-realtime-2.1', });
return Response.json({ token, url, tools: [] });}Playground
Try out gpt-realtime-2.1 by OpenAI. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
Voice agent
Talk to a realtime agent. It listens to your voice and replies with audio.
Providers
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
| Provider |
|---|
More models by OpenAI
| Model |
|---|
About gpt-realtime-2.1
gpt-realtime-2.1 became available on July 9, 2026 as an update to gpt-realtime-2. OpenAI improved three behaviors that decide whether a voice call succeeds: alphanumeric recognition, silence and noise handling, and interruption handling. Speech-to-speech interaction, configurable reasoning effort, instruction following, and tool use all carry over.
Alphanumeric recognition covers order numbers, account IDs, postal codes, and confirmation codes, which is where voice agents most often lose a call. Better silence and noise handling reduces false turn boundaries in loud rooms and over phone lines, so the agent talks over the caller less. Improved interruption behavior lets a caller cut in without derailing the session.
Reasoning effort stays configurable, so you decide how much thinking each session gets. Higher effort raises answer quality on complex turns and increases latency and output token usage. OpenAI also improved caching across the realtime voice models, which brings tail latency down. See the live metrics on this page for current numbers.
gpt-realtime-2.1 takes text, audio, and image input and returns text and audio, with a context window of 128K tokens and up to 32K tokens of output. Function calling works mid-conversation, so an agent can look up an order or update a record while the caller is still talking. Through AI Gateway, you get the same authentication, observability, and spend controls as your text models, with no markup on provider pricing.
What To Consider When Choosing a Provider
- Configuration: Reasoning effort is the main tuning decision. Higher effort improves answers on complex turns and raises latency and output token usage, so start low for production voice agents and increase it only where your transcripts show the model struggling.
- Configuration: Realtime support on AI Gateway is in beta through AI SDK 7. The integration runs over WebSocket: your server mints a short-lived token, and the browser connects with the AI SDK's realtime hook, which handles microphone capture and playback. Your AI Gateway API key never reaches the client.
- Zero Data Retention: AI Gateway does not currently support Zero Data Retention for this model. See the documentation for models that support ZDR.
- Authentication: AI Gateway authenticates requests using an API key or OIDC token. You do not need to manage provider credentials directly.
When to Use gpt-realtime-2.1
Best for
- Production Voice Agents: Support and phone workflows that need reliable instruction following and tool use
- Spoken Identifier Capture: Order numbers, account codes, and postal codes read aloud by callers
- Noisy Call Environments: Contact centers, vehicles, and public spaces where background sound is constant
- Interruption-Heavy Conversations: Callers who cut in mid-response and expect the agent to keep up
- Mixed-Difficulty Sessions: Reasoning effort tuned to match compute to the task in front of the agent
Consider alternatives when
- Live Transcription Only:
gpt-realtime-whisperstreams text from audio without a spoken reply - High-Volume Voice Features:
gpt-realtime-minicovers lightweight interactions at a lower rate - Recorded Audio Jobs:
gpt-4o-transcribeandwhisper-1transcribe files rather than live streams - Speech Generation Only:
tts-1andtts-1-hdturn written text into spoken audio
Conclusion
gpt-realtime-2.1 is a direct upgrade path for anything already running on GPT-Realtime-2. The gains land on spoken identifiers, noisy audio, and interruptions, which is where production voice agents fail. Start at low reasoning effort and raise it only for the turns that need it.