gpt-oss 120B · Chip comparison
gpt-oss 120B — B200 vs MI300X
Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and MI300X (AMD CDNA 3) on gpt-oss 120B. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.
At 83 tok/s/user interactivity on gpt-oss 120B, B200 delivers 37,880 tok/s/chip at $0.013 per million tokens; MI300X delivers 5,465 tok/s/chip at $0.048. B200 is 74% cheaper per token; B200 delivers 6.9× the tok/s/chip at this point.
B200 posts 25,790 tok/s/chip for $0.019 per million tokens at 138 tok/s/user on gpt-oss 120B; MI300X posts 3,491 tok/s/chip for $0.076. B200 is 75% cheaper per token; B200 delivers 7.4× the tok/s/chip.
Throughput at 192 tok/s/user on gpt-oss 120B: B200 hits 17,979 tok/s/chip, MI300X hits 1,133. Costs per million tokens land at $0.027 and $0.23 respectively. B200 is 89% cheaper per token; B200 delivers 16× the tok/s/chip. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)
Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/chip) | B20037,880MI300X5,465 | B20025,790MI300X3,491 | B20017,979MI300X1,133 |
| Cost ($/M tok) | B200$0.013MI300X$0.048 | B200$0.019MI300X$0.076 | B200$0.027MI300X$0.23 |
| tok/s/MW | B20022,151,917MI300X3,931,798 | B20015,081,733MI300X2,511,856 | B20010,513,787MI300X815,020 |
| Concurrency | B200~49MI300X~15 | B200~32MI300X~5 | B200~20MI300X~7 |