DeepSeek V4 Pro 1.6T
8K/1K
Inference Cost per Million Tokens
Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 AI Cloud TCO Model
| Model · Scenario | B200 | MI355X | B300 | GB200 NVL72 | GB300 NVL72 |
|---|---|---|---|---|---|
DeepSeek V4 Pro 1.6T8K/1K | TRTLLM · FP4 | — cannot reach @200 | TRTLLM · FP4 | Dynamo SGLang · FP4 | Dynamo TRTLLM · FP4 |
DeepSeek V4 Pro 1.6TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | — cannot reach @200 | — cannot reach @200 | — cannot reach @200 | — no data for this scenario | — cannot reach @200 |
Kimi K3 2.8TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | — cannot reach @200 | — no data for this scenario | — cannot reach @200 | — cannot reach @200 | — no data for this scenario |
MiniMax M3 428B8K/1K | ATOM¹ · FP4 | — cannot reach @200 | Dynamo vLLM · FP8 | ||
MiniMax M3 428BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | vLLM · FP4 | — no data for this scenario | — cannot reach @200 | — no data for this scenario | — no data for this scenario |
GLM5.2Long Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP4 | — no data for this scenario | — cannot reach @200 | — no data for this scenario | — no data for this scenario |
Qwen3.5 397B8K/1K | ATOM¹ · FP8 | Dynamo SGLang · FP8 | |||
Qwen3.5 397BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP8 | — no data for this scenario | SGLang · FP4 | — no data for this scenario | Dynamo SGLang · FP4 |
DeepSeek V4 Pro 1.6T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
B200—cannot reach @200MI355X—cannot reach @200B300—cannot reach @200GB200 NVL72—no data for this scenarioGB300 NVL72—cannot reach @200Kimi K3 2.8T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
B200—cannot reach @200MI355X—no data for this scenarioB300—cannot reach @200GB200 NVL72—cannot reach @200GB300 NVL72—no data for this scenarioMiniMax M3 428B
8K/1K
B200MI355XATOM¹ · FP4B300GB200 NVL72—cannot reach @200GB300 NVL72Dynamo vLLM · FP8MiniMax M3 428B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
B200vLLM · FP4MI355X—no data for this scenarioB300—cannot reach @200GB200 NVL72—no data for this scenarioGB300 NVL72—no data for this scenarioGLM5.2
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
B200SGLang · FP4MI355X—no data for this scenarioB300—cannot reach @200GB200 NVL72—no data for this scenarioGB300 NVL72—no data for this scenarioQwen3.5 397B
8K/1K
B200MI355XATOM¹ · FP8B300GB200 NVL72Dynamo SGLang · FP8GB300 NVL72Qwen3.5 397B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
Current cost and change versus the latest validated platform result 30–60 days earlier.
Platforms without a valid 30-day comparison show current cost only.
If a chip does not have FP4 spec decoding available, the next best available configuration is used.