gpt-oss 120B · Performance per Dollar

gpt-oss 120B — B200 vs H100 Performance per Dollar

Cost per million tokens of B200 (NVIDIA Blackwell) versus H100 (NVIDIA Hopper) on gpt-oss 120B. Owning-hyperscaler TCO normalized by output tokens — performance per dollar across LLM workloads. Pick the more cost-efficient SKU at every target interactivity level. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

B200: $0.03 per million tokens. H100: $0.14. Both at 117 tok/s/user on gpt-oss 120B, with B200 417% cheaper.

Around the middle of the 67–266 tok/s/user interactivity band — at 166 tok/s/user — B200 runs $0.04 per million tokens on gpt-oss 120B while H100 runs $0.26. B200 is the cheaper choice by 625%.

On gpt-oss 120B at 216 tok/s/user, the per-million math comes out to $0.06 for B200 and $0.49 for H100; B200 delivers 702% more output per dollar. (Numbers reflect the default 1k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

GPU pricing (owning hyperscaler): B200 $1.95/GPU/hr · H100 $1.30/GPU/hr. Source: SemiAnalysis Market August 2025 Pricing Surveys & AI Cloud TCO Model.

View full latency + throughput comparison →

gpt-oss 120B: B200 versus H100 cost per million tokens at matched interactivity levels
B200 versus H100 cost per million tokens for this comparison's canonical default workload. Lower cost indicates better performance per dollar.
Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Dollar per Million Tokens
B200:$0.027H100:$0.139
B200:$0.036H100:$0.262
B200:$0.061H100:$0.487
Concurrency
B200:~219H100:~64
B200:~92H100:~17
B200:~64H100:~8

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.