Baseten models
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
| Model | Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Regional Inference | Free Tier | Released |
|---|
| 1M | 0.5s | 284tps | $0.01/M | $0.03/M | Read:$0.0/M Write:— | — | +5 | 07/31/2026 | |||||||
| 1M | 0.9s | 307tps | $0.50/M | $1.20/M | Read:$0.1/M Write:— | — | +2 | 07/30/2026 | |||||||
| 1M | 1.0s | 107tps | $2.90/MFast $4.50/M | $14/MFast $22.50/M | Read:$0.29/M Write:— | — | +2 | +4 | US | 07/16/2026 | |||||
| 256K | 0.2s | 232tps | $1/M | $4.05/M | Read:$0.17/M Write:— | — | +1 | US | 07/15/2026 | ||||||
| 1M | 0.5s | 468tps | $2.10/M | $6.60/M | Read:$0.21/M Write:— | — | +1 | US | 06/23/2026 | ||||||
| 1M | 0.3s | 508tps | $0.80/MFast $2.10/M | $2.52/MFast $6.60/M | Read:$0.14/M Write:— | — | +12 | US | 06/16/2026 | ||||||
| 262K | 0.2s | 110tps | $0.74/MFast $1.90/M | $3.50/MFast $8/M | Read:$0.15/M Write:— | — | +2 | +1 | US | 06/12/2026 | |||||
| 1M | 0.2s | 249tps | $0.37/M | $1.08/M | Read:$0.12/M Write:— | — | +1 | US | 06/04/2026 | ||||||
| 1M | 0.4s | 311tps | $0.01/M | $0.03/M | Read:$0.0/M Write:— | — | +7 | 04/23/2026 | |||||||
| 1M | 0.4s | 188tps | $1.74/M$0.43/M | $3.48/M$0.87/M | Read:$0.0/M Write:— | — | +5 | US | 04/23/2026 | ||||||
| 262K | 0.3s | 415tps | $0.95/M | $4/M | Read:$0.16/M Write:— | — | +1 | +2 | US | 04/20/2026 | |||||
| 205K | 0.1s | 580tps | $2.25/M | $2.75/M | Read:$2.25/M Write:— | — | +3 | US | 12/22/2025 | ||||||
| 131K | 0.1s | 484tps | $0.35/M | $0.75/M | Read:$0.25/M Write:— | — | +5 | US | 08/05/2025 |