Prefix Cache Reuse
Prefix Cache Reuse
Prefix cache reuse splits prompt tokens at each concurrency level into chip HBM cache hits, host-tier cache hits and recomputed tokens, with an optional trace upper bound. All values are runtime cache counters traceable to their GitHub Actions run.