GPU comparison
B300 vs GB300 NVL72
Head-to-head AI inference benchmark comparison of B300 (NVIDIA Blackwell) and GB300 NVL72 (NVIDIA Blackwell). Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch models, sequences, precisions, and metrics — same interactions as the main inference chart.
Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/gpu) | B300:4850.6GB300 NVL72:10008.0 | B300:541.8GB300 NVL72:1966.9 | B300:234.3GB300 NVL72:232.4 |
| Cost ($/M tok) | B300:$0.134GB300 NVL72:$0.073 | B300:$1.182GB300 NVL72:$0.377 | B300:$2.765GB300 NVL72:$3.275 |
| tok/s/MW | B300:2235282GB300 NVL72:4765719 | B300:249692GB300 NVL72:936607 | B300:107973GB300 NVL72:110644 |
| Concurrency | B300:~386GB300 NVL72:~1716 | B300:~73GB300 NVL72:~286 | B300:~22GB300 NVL72:~18 |
Inference Performance
Inference performance metrics across different models, hardware configurations, and serving parameters.