GPU comparison
GB300 NVL72 vs MI325X
Head-to-head AI inference benchmark comparison of GB300 NVL72 (NVIDIA Blackwell) and MI325X (AMD CDNA 3). Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch models, sequences, precisions, and metrics — same interactions as the main inference chart.
Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/gpu) | GB300 NVL72:8771.1MI325X:258.8 | GB300 NVL72:8374.0MI325X:167.1 | GB300 NVL72:7966.0MI325X:93.9 |
| Cost ($/M tok) | GB300 NVL72:$0.084MI325X:$1.338 | GB300 NVL72:$0.087MI325X:$2.127 | GB300 NVL72:$0.092MI325X:$3.664 |
| tok/s/MW | GB300 NVL72:4176735MI325X:118710 | GB300 NVL72:3987630MI325X:76630 | GB300 NVL72:3793328MI325X:43092 |
| Concurrency | GB300 NVL72:~5236MI325X:~41 | GB300 NVL72:~4090MI325X:~22 | GB300 NVL72:~3255MI325X:~11 |
Inference Performance
Inference performance metrics across different models, hardware configurations, and serving parameters.