gpt-oss 120B — B200 vs GB200 NVL72 Performance per Dollar
Cost per million tokens of B200 (NVIDIA Blackwell) versus GB200 NVL72 (NVIDIA Blackwell) on gpt-oss 120B. Owning-hyperscaler TCO normalized by output tokens — performance per dollar across LLM workloads. Pick the more cost-efficient SKU at every target interactivity level. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.
Push gpt-oss 120B to 152 tok/s/user and B200 lands at $0.03 per million tokens against GB200 NVL72's $0.03 — B200 pulls ahead by 18%.
B200: $0.08 per million tokens. GB200 NVL72: $0.09. Both at 245 tok/s/user on gpt-oss 120B, with B200 16% cheaper.
Toward the upper edge of the 59–431 tok/s/user interactivity band — at 338 tok/s/user — B200 runs $0.28 per million tokens on gpt-oss 120B while GB200 NVL72 runs $0.27. GB200 NVL72 is the cheaper choice by 3%. (Numbers reflect the default 1k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)
GPU pricing (owning hyperscaler): B200 $1.95/GPU/hr · GB200 NVL72 $2.21/GPU/hr. Source: SemiAnalysis Market August 2025 Pricing Surveys & AI Cloud TCO Model.
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Dollar per Million Tokens | B200:$0.029GB200 NVL72:$0.034 | B200:$0.079GB200 NVL72:$0.092 | B200:$0.276GB200 NVL72:$0.268 |
| Concurrency | B200:~130GB200 NVL72:~3024 | B200:~63GB200 NVL72:~71 | B200:~12GB200 NVL72:~16 |
Inference Performance
Inference performance metrics across different models, hardware configurations, and serving parameters.