Agentic Inference Costs

Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 Pricing Surveys & AI Cloud TCO Model

  • Muse Spark Open 816B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
  • DeepSeek V4 Pro 0813 1.6T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    $0.007About the same cost as this platform’s Sep 19 result
    vLLM · FP4
    Compare curves
    MI355X
    $0.01138% cheaper than this platform’s Sep 16 result
    SGLang · FP4
    Compare curves
    B300
    $0.00920% cheaper than this platform’s Sep 15 result
    vLLM · FP4
    Compare curves
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
  • DeepSeek V4.1 Flash 552B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    $0.00271% cheaper than this platform’s Sep 21 result
    vLLM · FP4
    Compare curves
  • Kimi K3 2.8T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    $0.07429% cheaper than this platform’s Sep 12 result
    Dynamo vLLM · FP4
    Compare curves
    MI355X
    $0.04528% cheaper than this platform’s Sep 17 result
    vLLM · FP4
    Compare curves
    B300
    vLLM · FP4
    GB200 NVL72
    $0.06147% cheaper than this platform’s Sep 19 result
    Dynamo vLLM · FP4
    Compare curves
    GB300 NVL72
    —
    no exact @50 result
  • MiniMax M3 428B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
  • MiniMax M3.1 Flash 428B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    vLLM · FP4
    B300
    —
    no data for this scenario
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
  • GLM5.2/GLM5.3 744B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    SGLang · FP8
    MI355X
    $0.023About the same cost as this platform’s Sep 22 result
    SGLang · FP4
    Compare curves
    B300
    Dynamo SGLang · FP4
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
  • Qwen3.5 397B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    $0.019About the same cost as this platform’s Sep 16 result
    SGLang · FP8
    Compare curves
    MI355X
    $0.00823% more expensive than this platform’s Sep 16 result
    SGLang · FP8
    Compare curves
    B300
    Dynamo SGLang · FP4
    GB200 NVL72
    $0.006About the same cost as this platform’s Sep 11 result
    Dynamo SGLang · FP4
    Compare curves
    GB300 NVL72
    —
    no exact @50 result
  • Qwen3.8 Flash Next 176B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no data for this scenario
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no data for this scenario
    GB300 NVL72
    SGLang · FP4
  • Qwen3.5 397B

    8K/1K

    B200
    SGLang · FP8
    MI355X
    $0.051About the same cost as this platform’s Sep 14 result
    SGLang · FP4
    Compare curves
    B300
    $0.035About the same cost as this platform’s Sep 10 result
    SGLang · FP4
    Compare curves
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result

Current cost and change versus the latest validated platform result 30–60 days earlier.

Platforms without a valid 30-day comparison show current cost only.

If a chip does not have FP4 spec decoding available, the next best available configuration is used.