InferenceX
中文

Agentic Inference Costs

Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 Pricing Surveys & AI Cloud TCO Model

  • DeepSeek V4 Pro 0813 1.6T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    $0.02453% cheaper than this platform’s Aug 8 result
    vLLM · FP4
    Compare curves
    MI355X
    $0.03568% cheaper than this platform’s Aug 8 result
    ATOM¹ · FP4
    Compare curves
    B300
    $0.01945% cheaper than this platform’s Aug 7 result
    vLLM · FP4
    Compare curves
    GB200 NVL72
    —
    no exact @50 result
    GB300 NVL72
    $0.011
    Dynamo vLLM · FP4

  • Kimi K3 2.8T

    Long Context Multi-Turn Realistic Agentic Scenario (AgentX)

    B200
    $0.10592% cheaper than this platform’s Jul 29 result
    Dynamo vLLM · FP4
    Compare curves
    MI355X
    $0.094
    vLLM · FP4
    B300
    $0.103
    vLLM · FP4
    GB200 NVL72
    $0.11379% cheaper than this platform’s Aug 7 result
    Dynamo vLLM · FP4
    Compare curves
    GB300 NVL72
    $0.075
    Dynamo vLLM · FP4

  • Qwen3.5 397B

    8K/1K

    B200
    $0.036
    TRTLLM · FP4
    MI355X
    $0.05617% cheaper than this platform’s Aug 6 result
    SGLang · FP4
    Compare curves
    B300
    $0.040
    SGLang · FP4
    GB200 NVL72
    $0.142
    Dynamo SGLang · FP8STP
    GB300 NVL72
    $0.04070% cheaper than this platform’s Jul 13 result
    Dynamo TRTLLM · FP4STP
    Compare curves

Current cost and change versus the latest validated platform result 30–60 days earlier.

Platforms without a valid 30-day comparison show current cost only.

If a chip does not have FP4 spec decoding available, the next best available configuration is used.