gpt-oss 120B · Chip comparison

gpt-oss 120B — B200 vs MI300X

Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and MI300X (AMD CDNA 3) on gpt-oss 120B. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

At 83 tok/s/user interactivity on gpt-oss 120B, B200 delivers 37,880 tok/s/chip at $0.013 per million tokens; MI300X delivers 5,465 tok/s/chip at $0.048. B200 is 74% cheaper per token; B200 delivers 6.9× the tok/s/chip at this point.

B200 posts 25,790 tok/s/chip for $0.019 per million tokens at 138 tok/s/user on gpt-oss 120B; MI300X posts 3,491 tok/s/chip for $0.076. B200 is 75% cheaper per token; B200 delivers 7.4× the tok/s/chip.

Throughput at 192 tok/s/user on gpt-oss 120B: B200 hits 17,979 tok/s/chip, MI300X hits 1,133. Costs per million tokens land at $0.027 and $0.23 respectively. B200 is 89% cheaper per token; B200 delivers 16× the tok/s/chip. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

View performance per dollar →

Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.

Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Throughput (tok/s/chip)
B20037,880MI300X5,465
B20025,790MI300X3,491
B20017,979MI300X1,133
Cost ($/M tok)
B200$0.013MI300X$0.048
B200$0.019MI300X$0.076
B200$0.027MI300X$0.23
tok/s/MW
B20022,151,917MI300X3,931,798
B20015,081,733MI300X2,511,856
B20010,513,787MI300X815,020
Concurrency
B200~49MI300X~15
B200~32MI300X~5
B200~20MI300X~7