Llama 3.3 70B · Chip comparison
Llama 3.3 70B — MI325X vs MI355X
Head-to-head AI inference benchmark comparison of MI325X (AMD CDNA 3) and MI355X (AMD CDNA 4) on Llama 3.3 70B. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.
Near the low end of the 14–107 tok/s/user interactivity band, at 37 tok/s/user on Llama 3.3 70B: MI325X runs 1,712 tok/s/chip at $0.18 per million tokens, MI355X runs 4,326 at $0.096. MI355X is 46% cheaper per token; MI355X delivers 153% more tok/s/chip.
Setting 61 tok/s/user as the target on Llama 3.3 70B, MI325X produces 1,301 tok/s/chip ($0.23 per million tokens) and MI355X produces 2,613 ($0.16). MI355X is 32% cheaper per token; MI355X delivers 101% more tok/s/chip.
At 84 tok/s/user interactivity on Llama 3.3 70B, MI325X delivers 734 tok/s/chip at $0.42 per million tokens; MI355X delivers 1,086 tok/s/chip at $0.38. MI355X is 8% cheaper per token; MI355X delivers 48% more tok/s/chip at this point. (Numbers reflect the default 8k/1k · fp8 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)
Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/chip) | MI325X1,712MI355X4,326 | MI325X1,301MI355X2,613 | MI325X734MI355X1,086 |
| Cost ($/M tok) | MI325X$0.18MI355X$0.096 | MI325X$0.23MI355X$0.16 | MI325X$0.42MI355X$0.38 |
| tok/s/MW | MI325X1,012,893MI355X2,069,965 | MI325X769,539MI355X1,250,014 | MI325X434,251MI355X519,473 |
| Concurrency | MI325X~24MI355X~18 | MI325X~22MI355X~22 | MI325X~8MI355X~6 |