Prefix Cache Reuse

Benchmark Config

Model

Scenario

8K / 1K (deprecated)

Precision

Chart Config

Configuration

Continuous open-source AI accelerator system benchmarking. Real-world, reproducible, auditable performance data trusted by trillion dollar AI infrastructure operators like OpenAI, Meta, Oracle, Microsoft, etc.

SemiAnalysis

Main Site Newsletter About

Legal

Land Acknowledgement Privacy Policy Cookie Policy

Contribute

Benchmarks AgentX Harness Visualization

More

Supporters AgentX Telemetry Comparisons Articles Whitepapers API Reference Historical Trends TCO Calculator Fleet Lifecycle First-Token Limits Prefix Cache Reuse Chip Reliability Chip Specs Dashboard Performance per Dollar Model Architectures AI Inference Glossary Chip Specs & Pricing GPU Rankings Model on GPU Results

If this data helps your work, consider starring us on GitHub or sharing with your network.