Kimi K2.5/K2.6/K2.7-Code 1T · GPU comparison

Kimi K2.5/K2.6/K2.7-Code 1T — MI300X vs MI355X

Head-to-head AI inference benchmark comparison of MI300X (AMD CDNA 3) and MI355X (AMD CDNA 4) on Kimi K2.5/K2.6/K2.7-Code 1T. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

MI300X posts 112 tok/s/GPU for $2.75 per million tokens at 27 tok/s/user on Kimi K2.5/K2.6/K2.7-Code 1T; MI355X posts 825 tok/s/GPU for $0.50. MI355X is 454% cheaper per token; MI355X delivers 634% more tok/s/GPU.

Throughput at 34 tok/s/user on Kimi K2.5/K2.6/K2.7-Code 1T: MI300X hits 90 tok/s/GPU, MI355X hits 628. Per-million costs land at $3.47 and $0.65 respectively. MI355X is 430% cheaper per token; MI355X delivers 598% more tok/s/GPU.

MI300X / MI355X on Kimi K2.5/K2.6/K2.7-Code 1T at 42 tok/s/user: 65 / 480 tok/s/GPU, $4.86 / $0.85 per million tokens. MI355X is 471% cheaper per token; MI355X delivers 639% more tok/s/GPU. (Numbers reflect the default 1k/1k · int4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

View performance-per-dollar view →

Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Throughput (tok/s/gpu)
MI300X:112.4MI355X:825.2
MI300X:90.1MI355X:628.5
MI300X:64.9MI355X:479.5
Cost ($/M tok)
MI300X:$2.754MI355X:$0.497
MI300X:$3.468MI355X:$0.654
MI300X:$4.863MI355X:$0.852
tok/s/MW
MI300X:62771MI355X:311393
MI300X:50323MI355X:237158
MI300X:36270MI355X:180947
Concurrency
MI300X:~17MI355X:~62
MI300X:~11MI355X:~38
MI300X:~6MI355X:~23

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.

Vendor:
Aggregation:
Spec Decoding: