GPU rankings

Kimi K3.1 Pro 2.8T

Fastest GPU for Kimi K3.1 Pro

GB300 NVL72 leads at 35,172 tokens/s per GPU, 56% ahead of B300.

Measured on the AgentX agentic coding workload at a matched interactivity target of 50 tokens/s per user. Hardware without a measurement at this operating point is not ranked.

Fastest GPU for Kimi K3.1 Pro: live benchmark ranking
RankGPUTokens/s per GPU$ / 1M tokensPrecisionEngine
1GB300 NVL7235,172$0.018fp4Dynamo SGLang
2B30022,563$0.028fp4Dynamo SGLang
3MI355X17,614$0.024fp4vLLM
4B2006,383$0.075fp4Dynamo SGLang
5GB200 NVL723,660$0.14fp4vLLM

Optimizing for cost instead of speed? See the cheapest GPU for Kimi K3.1 Pro

Methodology

Every number on this page is a measurement, not a spec-sheet estimate. The InferenceX fleet serves Kimi K3.1 Pro on real hardware with community serving engines, sweeping concurrency to trace each platform's throughput-versus-interactivity frontier.

Platforms are then read at the same operating point (50 tokens/s per user) so the comparison is iso-interactivity: a GPU cannot win by quoting throughput at an unusably slow per-user speed. Rankings default to 125 tokens/s per user, the speed current runs cover on the most hardware, and use another speed only when it ranks more GPUs for this model. Cost converts measured throughput to $ per million total tokens using $/GPU/hr rates from the SemiAnalysis AI Cloud TCO model.

The derivation is shared with the InferenceX overview leaderboard, and results re-run continuously, so this ranking updates as new engine releases and configs land.

Frequently asked questions

What is the fastest GPU for Kimi K3.1 Pro inference?
As of the latest benchmark runs, GB300 NVL72 leads at 35,172 tokens/s per GPU on the AgentX agentic coding workload, measured at a matched interactivity target of 50 tokens/s per user.
How is "fastest" measured?
Every platform is read at the same interactivity tier (50 tokens/s per user) on the AgentX agentic coding workload, then ranked by measured throughput per GPU. This is the same derivation the InferenceX overview leaderboard renders, so the ranking can never disagree with the dashboard.
How often is this ranking updated?
Benchmarks re-run continuously on the InferenceX cluster fleet; the newest result feeding this ranking landed on 2026-11-17. The page always renders the latest data.

Explore the data