DeepSeek V4 Pro 1.6T
8 组投机解码对比具有 DeepSeek V4 Pro 1.6T 的基准测试数据。
B200 FP4 — MTP vs Off
NVIDIA · Blackwell
B300 FP4 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
H200 FP8 — MTP vs Off
NVIDIA · Hopper
MI300X FP8 — MTP vs Off
AMD · CDNA 3
MI325X FP8 — MTP vs Off
AMD · CDNA 3
MI355X FP4 — MTP vs Off
AMD · CDNA 4
DeepSeek R1
13 组投机解码对比具有 DeepSeek R1 的基准测试数据。
B200 FP4 — MTP vs Off
NVIDIA · Blackwell
B200 FP8 — MTP vs Off
NVIDIA · Blackwell
B300 FP4 — MTP vs Off
NVIDIA · Blackwell
B300 FP8 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
H100 FP8 — MTP vs Off
NVIDIA · Hopper
H200 FP8 — MTP vs Off
NVIDIA · Hopper
MI325X FP8 — MTP vs Off
AMD · CDNA 3
MI355X FP4 — MTP vs Off
AMD · CDNA 4
MI355X FP8 — MTP vs Off
AMD · CDNA 4
Kimi K3 2.8T
1 组投机解码对比具有 Kimi K3 2.8T 的基准测试数据。
GLM 5/5.1
11 组投机解码对比具有 GLM 5/5.1 的基准测试数据。
B200 FP4 — MTP vs Off
NVIDIA · Blackwell
B200 FP8 — MTP vs Off
NVIDIA · Blackwell
B300 FP4 — MTP vs Off
NVIDIA · Blackwell
B300 FP8 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
H200 FP8 — MTP vs Off
NVIDIA · Hopper
MI325X FP8 — MTP vs Off
AMD · CDNA 3
MI355X FP8 — MTP vs Off
AMD · CDNA 4
MiniMax M3 428B
11 组投机解码对比具有 MiniMax M3 428B 的基准测试数据。
B200 FP4 — M3 EAGLE vs Off
NVIDIA · Blackwell
B200 FP8 — M3 EAGLE vs Off
NVIDIA · Blackwell
B300 FP4 — M3 EAGLE vs Off
NVIDIA · Blackwell
B300 FP8 — M3 EAGLE vs Off
NVIDIA · Blackwell
GB300 NVL72 FP8 — M3 EAGLE vs Off
NVIDIA · Blackwell
H100 FP8 — M3 EAGLE vs Off
NVIDIA · Hopper
H200 FP8 — M3 EAGLE vs Off
NVIDIA · Hopper
MI300X FP8 — M3 EAGLE vs Off
AMD · CDNA 3
MI325X FP8 — M3 EAGLE vs Off
AMD · CDNA 3
MI355X FP4 — M3 EAGLE vs Off
AMD · CDNA 4
MI355X FP8 — M3 EAGLE vs Off
AMD · CDNA 4
Qwen 3.5 397B-A17B
18 组投机解码对比具有 Qwen 3.5 397B-A17B 的基准测试数据。
B200 FP4 — MTP vs Off
NVIDIA · Blackwell
B200 FP8 — MTP vs Off
NVIDIA · Blackwell
B200 BF16 — MTP vs Off
NVIDIA · Blackwell
B300 FP4 — MTP vs Off
NVIDIA · Blackwell
B300 FP8 — MTP vs Off
NVIDIA · Blackwell
B300 BF16 — MTP vs Off
NVIDIA · Blackwell
GB200 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP4 — MTP vs Off
NVIDIA · Blackwell
GB300 NVL72 FP8 — MTP vs Off
NVIDIA · Blackwell
H100 FP8 — MTP vs Off
NVIDIA · Hopper
H200 FP8 — MTP vs Off
NVIDIA · Hopper
MI300X FP8 — MTP vs Off
AMD · CDNA 3
MI325X FP8 — MTP vs Off
AMD · CDNA 3
MI325X BF16 — MTP vs Off
AMD · CDNA 3
MI355X FP4 — MTP vs Off
AMD · CDNA 4
MI355X FP8 — MTP vs Off
AMD · CDNA 4
MI355X BF16 — MTP vs Off
AMD · CDNA 4
RTX PRO 6000 FP4 — MTP vs Off
NVIDIA · Blackwell