Baseten models
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
| Model | Context | Input | Output | Latency | Throughput | Cache | Web Search | Capabilities | ZDR | No Training | Regional Inference | Free Tier | Released |
|---|
| 1M | $0.30/M | $1.20/M | 1.1 s | 313 tps | Read$0.03/M | — | +1 | US | 09/08/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | US | 09/02/2026 | |||||
| 1M | $0.15/M | $0.50/M | 1.0 s | 69 tps | Read$0.03/M | — | +1 | US | 08/26/2026 | ||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 1.6 s | 109 tps | Read$0.14/M | — | US | 08/18/2026 | |||||
| 1M | $1.32/M | $3.96/M | 1.8 s | 138 tps | Read$0.13/M | — | US | 08/12/2026 | |||||
| 1M | $0.13/M | $0.26/M | 1.3 s | 400 tps | Read$0.03/M | — | US | 07/31/2026 | |||||
| 1M | $0.50/M | $1.20/M | 0.5 s | 300 tps | Read$0.10/M | — | +2 | US | 07/30/2026 | ||||
| 1M | $3/M | $15/M | 6.0 s | 110 tps | Read$0.30/M | — | +1 | US | 07/16/2026 | ||||
| 256K | $1/M | $4.05/M | 0.4 s | 219 tps | Read$0.17/M | — | +1 | US | 07/15/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | US | 06/23/2026 | |||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 3.3 s | 119 tps | Read$0.14/M | — | US | 06/16/2026 | |||||
| 256K | $0.95/M | $4/M | 0.7 s | 207 tps | Read$0.16/M | — | +2 | US | 06/12/2026 | ||||
| 1M | $0.60/M | $2.40/M | 0.6 s | 357 tps | Read$0.12/M | — | US | 06/04/2026 | |||||
| 1M | $0.13/M | $0.26/M | 0.4 s | 353 tps | Read$0.03/M | — | US | 04/23/2026 | |||||
| 1M | $1.32/M | $3.96/M | 1.3 s | 113 tps | Read$0.13/M | — | US | 04/23/2026 | |||||
| 262K | $0.95/M | $4/M | 0.3 s | 133 tps | Read$0.16/M | — | +1 | US | 04/20/2026 | ||||
| 200K | $0.60/M | $2.20/M | 0.2 s | 115 tps | Read$0.12/M | — | US | 12/22/2025 | |||||
| 131K | $0.10/M | $0.50/M | 0.3 s | 196 tps | — | — | US | 08/05/2025 |