Skip to content
Dashboard

gpt-realtime-2.1

gpt-realtime-2.1 updates GPT-Realtime-2 with better alphanumeric recognition, steadier silence and noise handling, and improved interruption behavior, keeping speech-to-speech interaction, configurable reasoning effort, instruction following, and tool use for complex voice-agent workflows. Your use is subject to OpenAI's Terms & Privacy Policies.

import { gateway } from '@ai-sdk/gateway';
export async function POST() {
const { token, url } = await gateway.experimental_realtime.getToken({
model: 'openai/gpt-realtime-2.1',
});
return Response.json({ token, url, tools: [] });
}
Read docs

Frequently Asked Questions

  • What changed between gpt-realtime-2.1 and GPT-Realtime-2?

    Alphanumeric recognition, silence and noise handling, and interruption behavior all improved. Speech-to-speech interaction, configurable reasoning effort, instruction following, and tool use carry over from GPT-Realtime-2.

  • How do I access gpt-realtime-2.1 through AI Gateway?

    Realtime support is in beta through AI SDK 7. Mint a short-lived token on your server with the AI SDK's gateway provider, then connect from the browser with the AI SDK's realtime hook over WebSocket. The hook manages microphone capture and audio playback.

  • How should I set reasoning effort for gpt-realtime-2.1?

    Start low for production voice agents. Higher effort improves reasoning on complex turns and increases both latency and output token usage, so raise it only for the sessions or turns where transcripts show the agent struggling.

  • Why does alphanumeric recognition matter for a voice agent?

    Order numbers, account IDs, postal codes, and confirmation codes are the details a call turns on. gpt-realtime-2.1 captures them more reliably than GPT-Realtime-2, which reduces the repeat-back loops that frustrate callers.

  • Can gpt-realtime-2.1 call tools during a live conversation?

    Yes. Function calling works mid-conversation, so the agent can look up an order or update a record while the caller is still talking, then answer with the result.

  • What inputs and outputs does gpt-realtime-2.1 support?

    Text, audio, and image input, with text and audio output. The context window is 128K tokens, with up to 32K tokens of output.

  • How is gpt-realtime-2.1 priced?

    Pricing is listed on this page and covers text, audio, and image tokens separately. Rates reflect the providers routing through AI Gateway and update when those providers change list prices.

  • Does gpt-realtime-2.1 support zero data retention through AI Gateway?

    Zero Data Retention is not currently available for this model. Zero Data Retention is offered on a per-provider basis. See https://vercel.com/docs/ai-gateway/capabilities/zdr for details.

  • What are typical latency characteristics?

    This page shows live performance metrics measured across real AI Gateway traffic. Higher reasoning effort settings add thinking time before the agent speaks.