Historical trends

Interpolated performance metrics over time at a fixed interactivity operating point

Benchmark config

Llama 3.3 70B historical inference trends

Historical trends for Llama 3.3 70B track how inference performance has changed over time on each chip and framework, quantifying the gains from software stack optimizations.