GLM 5.3 744B · MI355X · Precision Comparison

MI355X: FP4 vs FP8 Precision Comparison

How FP4 and FP8 precision affect GLM 5.3 744B inference on MI355X (AMD CDNA 4). Throughput, latency, and cost across LLM workloads. Use the chart controls below to switch sequences and metrics — same interactions as the main inference chart.

GLM 5.3 744B: FP4 versus FP8 throughput and cost at matched interactivity levels on MI355X
FP4 versus FP8 throughput and cost per million tokens on MI355X for this comparison's canonical default workload.
No interpolated comparison data available for this precision pair. Use the chart controls below to select a different sequence with benchmark data for both precisions.

Inference Performance

Agentic inference metrics from the AgentX scenario and fixed-sequence inference metrics across models, hardware configurations, and serving parameters.

Benchmark Config