Agentic Inference Costs

Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 Pricing Surveys & AI Cloud TCO Model

  • Muse Spark Open 816B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details
  • DeepSeek V4 Pro 0813 1.6T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    vLLM · FP4
    MI355X
    $0.01148% more expensive than B200
    SGLang · FP4
    B300
    $0.00920% more expensive than B200
    vLLM · FP4
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details
  • DeepSeek V4.1 Flash 552B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    $0.002No B200 baseline to compare against
    vLLM · FP4
    View details
  • Kimi K3 2.8T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    Dynamo vLLM · FP4
    MI355X
    $0.04539% cheaper than B200
    vLLM · FP4
    B300
    $0.10340% more expensive than B200
    vLLM · FP4
    GB200 NVL72
    $0.06118% cheaper than B200
    Dynamo vLLM · FP4
    GB300 NVL72
    —
    no exact @50 result
    View details
  • MiniMax M3 428B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no exact @50 result
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details
  • MiniMax M3.1 Flash 428B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    $0.007No B200 baseline to compare against
    vLLM · FP4
    B300
    —
    no data for this scenario
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details
  • GLM5.2/GLM5.3 744B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    SGLang · FP8
    MI355X
    $0.02336% cheaper than B200
    SGLang · FP4
    B300
    $0.01849% cheaper than B200
    Dynamo SGLang · FP4
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details
  • Qwen3.5 397B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    SGLang · FP8
    MI355X
    $0.00858% cheaper than B200
    SGLang · FP8
    B300
    $0.00668% cheaper than B200
    Dynamo SGLang · FP4
    GB200 NVL72
    $0.00669% cheaper than B200
    Dynamo SGLang · FP4
    GB300 NVL72
    —
    no exact @50 result
    View details
  • Qwen3.8 Flash Next 176B

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    —
    no exact @50 result
    MI355X
    —
    no data for this scenario
    B300
    —
    no exact @50 result
    GB200 NVL72
    —
    no data for this scenario
    GB300 NVL72
    $0.005No B200 baseline to compare against
    SGLang · FP4
    View details
  • Qwen3.5 397B

    8K/1K

    B200
    SGLang · FP8
    MI355X
    $0.051About the same cost as B200
    SGLang · FP4
    B300
    $0.03529% cheaper than B200
    SGLang · FP4
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    —
    no exact @50 result
    View details

— = no result. ∞ = B200 baseline unavailable.

If a chip does not have FP4 spec decoding available, the next best available configuration is used.