Prefix Cache Reuse

Benchmark Config
Chart Config

Prefix Cache Reuse

Prefix cache reuse splits prompt tokens at each concurrency level into chip HBM cache hits, host-tier cache hits and recomputed tokens, with an optional trace upper bound. All values are runtime cache counters traceable to their GitHub Actions run.