Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 AI Cloud TCO Model
| Model · Scenario | B200 · Reference | MI355X | B300 | GB200 NVL72 | GB300 NVL72 |
|---|---|---|---|---|---|
DeepSeek V4 Pro 1.6T8K/1K | TRTLLM · FP4 | — cannot reach @200 | $1.3929% cheaper than B200 TRTLLM · FP4 | $5.922287% more expensive than B200 Dynamo SGLang · FP4 | $1.79717% more expensive than B200 Dynamo TRTLLM · FP4 |
DeepSeek V4 Pro 1.6TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | — cannot reach @200 | — cannot reach @200 | — cannot reach @200 | — no data for this scenario | — cannot reach @200 |
Kimi K3 2.8TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | — cannot reach @200 | — no data for this scenario | — cannot reach @200 | — cannot reach @200 | — no data for this scenario |
MiniMax M3 428B8K/1K | vLLM · FP4 | $0.15418% more expensive than B200 ATOM¹ · FP4 | $0.15620% more expensive than B200 Dynamo vLLM · FP4 | — cannot reach @200 | $0.487275% more expensive than B200 Dynamo vLLM · FP8 |
MiniMax M3 428BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | vLLM · FP4 | — no data for this scenario | — cannot reach @200 | — no data for this scenario | — no data for this scenario |
GLM5.2Long Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP4 | — no data for this scenario | — cannot reach @200 | — no data for this scenario | — no data for this scenario |
Qwen3.5 397B8K/1K | SGLang · FP4 | $0.332213% more expensive than B200 ATOM¹ · FP8 | $0.11912% more expensive than B200 SGLang · FP4 | $0.546414% more expensive than B200 Dynamo SGLang · FP8 | $0.0988% cheaper than B200 Dynamo TRTLLM · FP4 |
Qwen3.5 397BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP8 | — no data for this scenario | $0.01933% cheaper than B200 SGLang · FP4 | — no data for this scenario | $0.01451% cheaper than B200 Dynamo SGLang · FP4 |
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
— = no result. ∞ = B200 baseline unavailable.
If a chip does not have FP4 spec decoding available, the next best available configuration is used.
