Skip to content
Vercel Live

Nov 12: Intro to AI Gateway

Baseten models

Get API keyRead the docs
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
Model
Context
Input
Output
Latency
Throughput
Cache
Search
Capabilities
ZDR
No Training
Regional Inference
Free AI Gateway Credit
Released
baseten/joey-1
16K
$0.01/M
—
————
US
10/29/2026
moonshotai/kimi-k3.1-pro
1M
$2/M
$10/M
1.1 s182 tps
Read$0.20/M
—
+2
—10/23/2026
baseten/mammoth-1
16K
$0.10/M
—
————
US
10/21/2026
baseten/elephant-1
16K
$0.04/M
—
————
US
10/21/2026
deepseek/deepseek-v4.1-flash-1017
1M
$0.30/M+1 more
$1.20/M+1 more
0.5 s114 tps
Read$0.007/M
—
+2
US
10/17/2026
deepseek/deepseek-v4.1-flash-1017-fast
1M
$0.60/M
$2.40/M
0.5 s1024 tps
Read$0.01/M
—
+2
US
10/17/2026
reflection/beam
1M
$0.40/M
$1.20/M
0.7 s394 tps
Read$0.04/M
—
+1
—10/16/2026
nvidia/nemotron-3.5-super-vl
1M
$0.20/M
$0.50/M
0.5 s646 tps
Read$0.04/M
—
+2
US
10/15/2026
meta/muse-spark-open
1M
$1.25/M
$4.25/M
0.2 s246 tps
Read$0.15/M
—
+2
US
10/15/2026
deepseek/deepseek-v4.1-flash-fast
1M
$0.60/M
$2.40/M
0.3 s1017 tps
Read$0.01/M
—
+2
US
09/29/2026
deepseek/deepseek-v4.1-flash
1M
$0.30/M+1 more
$1.20/M+1 more
0.4 s190 tps
Read$0.007/M
—
+2
US
09/08/2026
zai/glm-5.3-fast
1M
$2.10/M
$6.60/M
0.8 s272 tps
Read$0.21/M
—
+1
US
09/02/2026
zai/glm-5.3-flash
1M
$0.15/M
$0.50/M
0.8 s87 tps
Read$0.03/M
—
+2
US
08/26/2026
zai/glm-5.3
1M
$1.40/M+1 more
$4.40/M+1 more
2.5 s94 tps
Read$0.14/M
—
+1
US
08/18/2026
deepseek/deepseek-v4-pro-0813
1M
$1.32/M
$3.96/M
1.0 s113 tps
Read$0.13/M
—
+1
US
08/12/2026
deepseek/deepseek-v4-flash-0731
1M
$0.13/M
$0.26/M
0.5 s190 tps
Read$0.03/M
—
+1
US
07/31/2026
moonshotai/kimi-k3
1M
$3/M
$15/M
1.3 s58 tps
Read$0.30/M
—
+3
US
07/16/2026
zai/glm-5.2-fast
1M
$2.10/M
$6.60/M
0.2 s289 tps
Read$0.21/M
—
+1
US
06/23/2026
zai/glm-5.2
1M
$1.40/M+1 more
$4.40/M+1 more
1.7 s71 tps
Read$0.14/M
—
+1
US
06/16/2026
nvidia/nemotron-3-ultra-550b-a55b
1M
$0.60/M
$2.40/M
0.4 s222 tps
Read$0.12/M
—
US
06/04/2026
deepseek/deepseek-v4-flash
1M
$0.13/M
$0.26/M
0.3 s149 tps
Read$0.03/M
—
US
04/23/2026
deepseek/deepseek-v4-pro
1M
$1.32/M
$3.96/M
0.8 s110 tps
Read$0.13/M
—
US
04/23/2026
openai/gpt-oss-120b
131K
$0.10/M
$0.50/M
0.2 s195 tps
Read$0.10/M
—
US
08/05/2025