公开数据 API

InferenceX API 参考文档

读取为 InferenceX 提供数据的基准、来源、数据集、CollectiveX 和诊断信息。

机器可读契约

OpenAPI 3.1 JSON

查看标准数据结构，或将其直接传入开发工具。

打开 OpenAPI JSON

规范版本: v1 · OpenAPI 3.1
身份验证: 身份验证已发布的只读端点不需要身份验证。
响应格式: 响应格式除非端点明确说明 CSV，否则响应均为 JSON。日期使用 YYYY-MM-DD，时间戳使用 UTC ISO 8601。
基础 URL: https://inferencex.semianalysis.com

01 / 快速入门

快速入门

只需几步，即可从查看契约到获得真实响应。

01
发现可用配置
先读取可用配置，以选择真实的模型、硬件、框架和序列值。
```
curl "https://inferencex.semianalysis.com/api/v1/availability"
```

获取基准行

然后为受支持的展示模型请求最新原始基准行。

curl "https://inferencex.semianalysis.com/api/v1/benchmarks?model=DeepSeek-R1-0528"

02 / 约定

约定

适用于受支持接口的通用请求、错误与缓存行为。

错误: JSON 错误包含 error 字符串。400 表示参数缺失或无效，404 表示请求的记录不存在，500 表示服务器查询失败。
缓存: 只读端点可能由共享缓存提供。CollectiveX 使用较短的刷新窗口，框架版本使用一小时共享缓存。
标识符: 基准结果 ID 和 GitHub 运行 ID 为正整数。批量诊断端点接受以逗号分隔并去重的 ID。

03 / 数据结构

BenchmarkRow 与指标

理解主要基准测试响应数据及其中的实测字段。

BenchmarkRow

配置字段与 metrics 映射并列。指标键可独立演进；值为数字，时间指标单位为秒，吞吐指标默认为每 GPU 每秒 token，除非名称另有说明。

结构

BenchmarkRows

示例

{
  "id": 421,
  "hardware": "h200_sxm",
  "framework": "vllm",
  "model": "dsr1",
  "precision": "fp8",
  "spec_method": "none",
  "disagg": false,
  "is_multinode": false,
  "prefill_tp": 8,
  "prefill_ep": 1,
  "prefill_dp_attention": false,
  "prefill_num_workers": 1,
  "decode_tp": 8,
  "decode_ep": 1,
  "decode_dp_attention": false,
  "decode_num_workers": 1,
  "num_prefill_gpu": 0,
  "num_decode_gpu": 8,
  "benchmark_type": "single_turn",
  "isl": 1024,
  "osl": 1024,
  "conc": 32,
  "offload_mode": "off",
  "image": "vllm/vllm-openai:v0.10.2",
  "metrics": {
    "median_ttft": 0.42,
    "median_tpot": 0.018,
    "tput_per_gpu": 128.4
  },
  "date": "2026-08-08",
  "run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789"
}

以 ID 为键的映射

批量诊断响应是以十进制基准结果 ID 为键的 JSON 对象。缺少某个键表示该 ID 没有可用值。

结构

Record<string, value>

示例

{
  "421": true
}

CollectiveX 版本

CollectiveX 读取需要明确指定受支持的契约版本。受支持版本：1。

结构

CollectiveXDataset

04 / 参考

端点参考

展开操作，查看参数、状态码与完整示例。

25 项操作

核心基准数据

基准结果、可用配置、工作流来源、评测与可靠性数据。

GET稳定/api/v1/availability列出可用的基准配置

返回已有基准数据的模型、序列、精度、硬件、框架、推测方法、基准类型和日期组合。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/availability'

响应

AvailabilityRows

200

可用配置行。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "model": {
        "type": "string"
      },
      "isl": {
        "type": [
          "number",
          "null"
        ]
      },
      "osl": {
        "type": [
          "number",
          "null"
        ]
      },
      "precision": {
        "type": "string"
      },
      "hardware": {
        "type": "string"
      },
      "framework": {
        "type": "string"
      },
      "spec_method": {
        "type": "string"
      },
      "disagg": {
        "type": "boolean"
      },
      "benchmark_type": {
        "type": "string"
      },
      "date": {
        "type": "string",
        "format": "date"
      }
    },
    "required": [
      "model",
      "isl",
      "osl",
      "precision",
      "hardware",
      "framework",
      "spec_method",
      "disagg",
      "benchmark_type",
      "date"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "model": "dsr1",
    "isl": 1024,
    "osl": 1024,
    "precision": "fp8",
    "hardware": "h200_sxm",
    "framework": "vllm",
    "spec_method": "none",
    "disagg": false,
    "benchmark_type": "single_turn",
    "date": "2026-08-08"
  }
]

500

可用配置查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/benchmarks读取基准结果

按展示模型返回原始基准行。可用 date 获取截至该日的快照，exact=true 限定该日，runId 约束最新查询，或将 exactRun=true 与数字 runId 组合以仅返回该工作流运行。页面专用的计算器视图不属于此公开契约。

参数

GET /api/v1/benchmarks: 参数
名称	位置	类型	要求	说明	示例
model	query	string	必填	展示模型名称。	DeepSeek-R1-0528
date	query	date	可选	YYYY-MM-DD 当日或之前的最新数据，exact 为 true 时仅限当日。	2026-08-08
exact	query	boolean	可选	设为 true 时严格匹配所给日期。	false
runId	query	integer	可选	GitHub Actions 数字运行 ID。非数字值会被忽略。	123456789
exactRun	query	boolean	可选	与数字 runId 一起使用时，仅返回该次运行而非截至日期的结果。	false

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmarks?model=DeepSeek-R1-0528'

响应

BenchmarkRows

200

基准行，标量指标位于 metrics 对象中。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "hardware": {
        "type": "string"
      },
      "framework": {
        "type": "string"
      },
      "model": {
        "type": "string"
      },
      "precision": {
        "type": "string"
      },
      "spec_method": {
        "type": "string"
      },
      "disagg": {
        "type": "boolean"
      },
      "is_multinode": {
        "type": "boolean"
      },
      "prefill_tp": {
        "type": "integer"
      },
      "prefill_ep": {
        "type": "integer"
      },
      "prefill_dp_attention": {
        "type": "boolean"
      },
      "prefill_num_workers": {
        "type": "integer"
      },
      "decode_tp": {
        "type": "integer"
      },
      "decode_ep": {
        "type": "integer"
      },
      "decode_dp_attention": {
        "type": "boolean"
      },
      "decode_num_workers": {
        "type": "integer"
      },
      "num_prefill_gpu": {
        "type": "integer"
      },
      "num_decode_gpu": {
        "type": "integer"
      },
      "benchmark_type": {
        "type": "string"
      },
      "isl": {
        "type": [
          "number",
          "null"
        ]
      },
      "osl": {
        "type": [
          "number",
          "null"
        ]
      },
      "conc": {
        "type": "integer"
      },
      "offload_mode": {
        "type": "string"
      },
      "image": {
        "type": [
          "string",
          "null"
        ]
      },
      "metrics": {
        "type": "object",
        "additionalProperties": {
          "type": "number"
        }
      },
      "workers": {
        "type": "array",
        "items": {
          "type": "object",
          "properties": {
            "role": {
              "type": "string"
            },
            "worker_idx": {
              "type": "integer"
            },
            "hosts": {
              "type": "array",
              "items": {
                "type": "string"
              }
            },
            "num_gpus": {
              "type": "integer"
            },
            "avg_power_w": {
              "type": "number"
            },
            "avg_temp_c": {
              "type": "number"
            },
            "peak_temp_c": {
              "type": "number"
            },
            "avg_util_pct": {
              "type": "number"
            },
            "avg_mem_used_mb": {
              "type": "number"
            }
          },
          "required": [
            "role",
            "worker_idx",
            "num_gpus",
            "avg_power_w"
          ],
          "additionalProperties": false
        }
      },
      "date": {
        "type": "string",
        "format": "date"
      },
      "run_url": {
        "type": [
          "string",
          "null"
        ]
      }
    },
    "required": [
      "id",
      "hardware",
      "framework",
      "model",
      "precision",
      "spec_method",
      "disagg",
      "is_multinode",
      "prefill_tp",
      "prefill_ep",
      "prefill_dp_attention",
      "prefill_num_workers",
      "decode_tp",
      "decode_ep",
      "decode_dp_attention",
      "decode_num_workers",
      "num_prefill_gpu",
      "num_decode_gpu",
      "benchmark_type",
      "isl",
      "osl",
      "conc",
      "offload_mode",
      "image",
      "metrics",
      "date",
      "run_url"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "id": 421,
    "hardware": "h200_sxm",
    "framework": "vllm",
    "model": "dsr1",
    "precision": "fp8",
    "spec_method": "none",
    "disagg": false,
    "is_multinode": false,
    "prefill_tp": 8,
    "prefill_ep": 1,
    "prefill_dp_attention": false,
    "prefill_num_workers": 1,
    "decode_tp": 8,
    "decode_ep": 1,
    "decode_dp_attention": false,
    "decode_num_workers": 1,
    "num_prefill_gpu": 0,
    "num_decode_gpu": 8,
    "benchmark_type": "single_turn",
    "isl": 1024,
    "osl": 1024,
    "conc": 32,
    "offload_mode": "off",
    "image": "vllm/vllm-openai:v0.10.2",
    "metrics": {
      "median_ttft": 0.42,
      "median_tpot": 0.018,
      "tput_per_gpu": 128.4
    },
    "date": "2026-08-08",
    "run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789"
  }
]

400

模型缺失或不受支持。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unknown model"
}

500

基准查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/benchmarks/history读取基准历史

返回某个模型和固定输入/输出 token 组合的全部历史基准行。

参数

GET /api/v1/benchmarks/history: 参数
名称	位置	类型	要求	说明	示例
model	query	string	必填	展示模型名称。	DeepSeek-R1-0528
isl	query	integer	必填	正整数输入序列长度，单位为 token。	1024
osl	query	integer	必填	正整数输出序列长度，单位为 token。	1024

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmarks/history?model=DeepSeek-R1-0528&isl=1024&osl=1024'

响应

BenchmarkRows

200

历史基准行。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "hardware": {
        "type": "string"
      },
      "framework": {
        "type": "string"
      },
      "model": {
        "type": "string"
      },
      "precision": {
        "type": "string"
      },
      "spec_method": {
        "type": "string"
      },
      "disagg": {
        "type": "boolean"
      },
      "is_multinode": {
        "type": "boolean"
      },
      "prefill_tp": {
        "type": "integer"
      },
      "prefill_ep": {
        "type": "integer"
      },
      "prefill_dp_attention": {
        "type": "boolean"
      },
      "prefill_num_workers": {
        "type": "integer"
      },
      "decode_tp": {
        "type": "integer"
      },
      "decode_ep": {
        "type": "integer"
      },
      "decode_dp_attention": {
        "type": "boolean"
      },
      "decode_num_workers": {
        "type": "integer"
      },
      "num_prefill_gpu": {
        "type": "integer"
      },
      "num_decode_gpu": {
        "type": "integer"
      },
      "benchmark_type": {
        "type": "string"
      },
      "isl": {
        "type": [
          "number",
          "null"
        ]
      },
      "osl": {
        "type": [
          "number",
          "null"
        ]
      },
      "conc": {
        "type": "integer"
      },
      "offload_mode": {
        "type": "string"
      },
      "image": {
        "type": [
          "string",
          "null"
        ]
      },
      "metrics": {
        "type": "object",
        "additionalProperties": {
          "type": "number"
        }
      },
      "workers": {
        "type": "array",
        "items": {
          "type": "object",
          "properties": {
            "role": {
              "type": "string"
            },
            "worker_idx": {
              "type": "integer"
            },
            "hosts": {
              "type": "array",
              "items": {
                "type": "string"
              }
            },
            "num_gpus": {
              "type": "integer"
            },
            "avg_power_w": {
              "type": "number"
            },
            "avg_temp_c": {
              "type": "number"
            },
            "peak_temp_c": {
              "type": "number"
            },
            "avg_util_pct": {
              "type": "number"
            },
            "avg_mem_used_mb": {
              "type": "number"
            }
          },
          "required": [
            "role",
            "worker_idx",
            "num_gpus",
            "avg_power_w"
          ],
          "additionalProperties": false
        }
      },
      "date": {
        "type": "string",
        "format": "date"
      },
      "run_url": {
        "type": [
          "string",
          "null"
        ]
      }
    },
    "required": [
      "id",
      "hardware",
      "framework",
      "model",
      "precision",
      "spec_method",
      "disagg",
      "is_multinode",
      "prefill_tp",
      "prefill_ep",
      "prefill_dp_attention",
      "prefill_num_workers",
      "decode_tp",
      "decode_ep",
      "decode_dp_attention",
      "decode_num_workers",
      "num_prefill_gpu",
      "num_decode_gpu",
      "benchmark_type",
      "isl",
      "osl",
      "conc",
      "offload_mode",
      "image",
      "metrics",
      "date",
      "run_url"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "id": 421,
    "hardware": "h200_sxm",
    "framework": "vllm",
    "model": "dsr1",
    "precision": "fp8",
    "spec_method": "none",
    "disagg": false,
    "is_multinode": false,
    "prefill_tp": 8,
    "prefill_ep": 1,
    "prefill_dp_attention": false,
    "prefill_num_workers": 1,
    "decode_tp": 8,
    "decode_ep": 1,
    "decode_dp_attention": false,
    "decode_num_workers": 1,
    "num_prefill_gpu": 0,
    "num_decode_gpu": 8,
    "benchmark_type": "single_turn",
    "isl": 1024,
    "osl": 1024,
    "conc": 32,
    "offload_mode": "off",
    "image": "vllm/vllm-openai:v0.10.2",
    "metrics": {
      "median_ttft": 0.42,
      "median_tpot": 0.018,
      "tput_per_gpu": 128.4
    },
    "date": "2026-08-08",
    "run_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789"
  }
]

400

必填参数缺失或模型不受支持。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Missing required parameters"
}

500

历史查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/workflow-info读取工作流来源

返回工作流运行、变更记录、可用配置以及每次运行的配置覆盖。省略 date 可读取全部日期。

参数

GET /api/v1/workflow-info: 参数
名称	位置	类型	要求	说明	示例
date	query	date	可选	可选的 YYYY-MM-DD 筛选条件。	2026-08-08

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/workflow-info?date=2026-08-08'

响应

WorkflowInfo

200

按四个数组组织的工作流来源数据。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "runs": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "github_run_id": {
            "type": "integer"
          },
          "name": {
            "type": "string"
          },
          "conclusion": {
            "type": [
              "string",
              "null"
            ]
          },
          "run_attempt": {
            "type": "integer"
          },
          "html_url": {
            "type": [
              "string",
              "null"
            ]
          },
          "created_at": {
            "type": "string",
            "format": "date-time"
          },
          "date": {
            "type": "string",
            "format": "date"
          }
        },
        "required": [
          "github_run_id",
          "name",
          "conclusion",
          "run_attempt",
          "html_url",
          "created_at",
          "date"
        ],
        "additionalProperties": false
      }
    },
    "changelogs": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "configs": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "runConfigs": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    }
  },
  "required": [
    "runs",
    "changelogs",
    "configs",
    "runConfigs"
  ],
  "additionalProperties": false
}

响应示例

{
  "runs": [
    {
      "github_run_id": 123456789,
      "name": "nightly-h200",
      "conclusion": "success",
      "run_attempt": 1,
      "html_url": "https://github.com/semianalysis/inference-benchmarks/actions/runs/123456789",
      "created_at": "2026-08-08T03:00:00Z",
      "date": "2026-08-08"
    }
  ],
  "changelogs": [],
  "configs": [],
  "runConfigs": []
}

400

date 不是 YYYY-MM-DD。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Invalid date format"
}

500

工作流查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/evaluations列出评测汇总

返回最新尝试的评测结果，包含配置、任务、来源和指标值。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/evaluations'

响应

EvaluationRows

200

评测结果行。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "config_id": {
        "type": "integer"
      },
      "hardware": {
        "type": "string"
      },
      "framework": {
        "type": "string"
      },
      "model": {
        "type": "string"
      },
      "precision": {
        "type": "string"
      },
      "spec_method": {
        "type": "string"
      },
      "disagg": {
        "type": "boolean"
      },
      "is_multinode": {
        "type": "boolean"
      },
      "prefill_tp": {
        "type": "integer"
      },
      "prefill_ep": {
        "type": "integer"
      },
      "prefill_dp_attention": {
        "type": "boolean"
      },
      "prefill_num_workers": {
        "type": "integer"
      },
      "decode_tp": {
        "type": "integer"
      },
      "decode_ep": {
        "type": "integer"
      },
      "decode_dp_attention": {
        "type": "boolean"
      },
      "decode_num_workers": {
        "type": "integer"
      },
      "num_prefill_gpu": {
        "type": "integer"
      },
      "num_decode_gpu": {
        "type": "integer"
      },
      "task": {
        "type": "string"
      },
      "date": {
        "type": "string",
        "format": "date"
      },
      "conc": {
        "type": [
          "number",
          "null"
        ]
      },
      "metrics": {
        "type": "object",
        "additionalProperties": {
          "type": "number"
        }
      },
      "timestamp": {
        "type": "string",
        "format": "date-time"
      },
      "run_url": {
        "type": [
          "string",
          "null"
        ]
      }
    },
    "required": [
      "id",
      "config_id",
      "hardware",
      "framework",
      "model",
      "precision",
      "spec_method",
      "disagg",
      "is_multinode",
      "prefill_tp",
      "prefill_ep",
      "prefill_dp_attention",
      "prefill_num_workers",
      "decode_tp",
      "decode_ep",
      "decode_dp_attention",
      "decode_num_workers",
      "num_prefill_gpu",
      "num_decode_gpu",
      "task",
      "date",
      "conc",
      "metrics",
      "timestamp",
      "run_url"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "id": 72,
    "config_id": 11,
    "hardware": "h200_sxm",
    "framework": "vllm",
    "model": "dsr1",
    "precision": "fp8",
    "spec_method": "none",
    "disagg": false,
    "is_multinode": false,
    "prefill_tp": 8,
    "prefill_ep": 1,
    "prefill_dp_attention": false,
    "prefill_num_workers": 1,
    "decode_tp": 8,
    "decode_ep": 1,
    "decode_dp_attention": false,
    "decode_num_workers": 1,
    "num_prefill_gpu": 0,
    "num_decode_gpu": 8,
    "task": "gpqa",
    "date": "2026-08-08",
    "conc": null,
    "metrics": {
      "accuracy": 0.78
    },
    "timestamp": "2026-08-08T03:00:00Z",
    "run_url": null
  }
]

500

评测查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/reliability列出基准可靠性

按硬件和日期返回成功运行数与总运行数。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/reliability'

响应

ReliabilityRows

200

可靠性计数行。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "hardware": {
        "type": "string"
      },
      "date": {
        "type": "string",
        "format": "date"
      },
      "n_success": {
        "type": "integer"
      },
      "total": {
        "type": "integer"
      }
    },
    "required": [
      "hardware",
      "date",
      "n_success",
      "total"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "hardware": "h200_sxm",
    "date": "2026-08-08",
    "n_success": 18,
    "total": 20
  }
]

500

可靠性查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

外部数据源

面向电子表格、版本跟踪、提交记录和运行镜像的稳定数据源。

GET稳定/api/v1/tco-feed计算 TCO 数据源

为电子表格 TCO 模型计算帕累托前沿吞吐点或加权分数。所有评分假设都编码在 URL 中。CSV 会将同一所选视图返回为平面表格。

参数

GET /api/v1/tco-feed: 参数
名称	位置	类型	要求	说明	示例
model	query	string	可选	数据库模型键或展示模型名称。	dsv4
workloads	query	CSV workload list	可选	以逗号分隔的 <isl>x<osl> token 组合。	1024x1024,8192x1024
tiers	query	CSV number list	可选	正数交互性目标，单位为每用户每秒输出 token。	30,50,75,100
date	query	date	可选	使用 YYYY-MM-DD 当日或之前的数据。省略则使用最新数据。	2026-08-08
format	query	enum	可选	响应编码。	json
view	query	enum	可选	points 为每个硬件、负载和档位返回一行。scores 为每个硬件返回一行。	points
weights	query	CSV number list	可选	仅用于 scores。每个档位一个非负权重，并归一化为总和 1。	0.35,0.4,0.2,0.05
workload_weights	query	CSV number list	可选	仅用于 scores。每个负载一个非负权重，并归一化为总和 1。默认等权。	0.5,0.5
alpha	query	number	可选	仅用于 scores。输入 token 价值比，范围为 [0, 10]。	0.25

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/tco-feed?model=dsv4&workloads=1024x1024,8192x1024&tiers=30,50,75,100&view=points&format=json'

响应

TcoFeed

200

所选 points 或 scores 数据包。

媒体类型: application/json

响应结构

{
  "oneOf": [
    {
      "type": "object",
      "properties": {
        "model": {
          "type": "string"
        },
        "db_model_keys": {
          "type": "array",
          "items": {
            "type": "string"
          }
        },
        "date": {
          "type": [
            "string",
            "null"
          ],
          "format": "date"
        },
        "workloads": {
          "type": "array",
          "items": {
            "type": "string"
          }
        },
        "tiers": {
          "type": "array",
          "items": {
            "type": "number"
          }
        },
        "rows": {
          "type": "array",
          "items": {
            "type": "object",
            "additionalProperties": true
          }
        }
      },
      "required": [
        "model",
        "db_model_keys",
        "date",
        "workloads",
        "tiers",
        "rows"
      ],
      "additionalProperties": false
    },
    {
      "type": "object",
      "properties": {
        "model": {
          "type": "string"
        },
        "db_model_keys": {
          "type": "array",
          "items": {
            "type": "string"
          }
        },
        "date": {
          "type": [
            "string",
            "null"
          ],
          "format": "date"
        },
        "workloads": {
          "type": "array",
          "items": {
            "type": "string"
          }
        },
        "tiers": {
          "type": "array",
          "items": {
            "type": "number"
          }
        },
        "weights": {
          "type": "array",
          "items": {
            "type": "number"
          }
        },
        "workload_weights": {
          "type": "array",
          "items": {
            "type": "number"
          }
        },
        "alpha": {
          "type": "number"
        },
        "rows": {
          "type": "array",
          "items": {
            "type": "object",
            "additionalProperties": true
          }
        }
      },
      "required": [
        "model",
        "db_model_keys",
        "date",
        "workloads",
        "tiers",
        "weights",
        "workload_weights",
        "alpha",
        "rows"
      ],
      "additionalProperties": false
    }
  ]
}

响应示例

{
  "model": "dsv4",
  "db_model_keys": [
    "dsv4"
  ],
  "date": null,
  "workloads": [
    "1024x1024"
  ],
  "tiers": [
    50
  ],
  "rows": [
    {
      "hardware": "h200_sxm",
      "workload": "1024x1024",
      "tier": 50,
      "tput_per_gpu": 118.2,
      "is_interpolated": true
    }
  ]
}

其他表示格式: text/csv

响应结构

{
  "type": "string"
}

响应示例

model,hardware,workload,tier,tput_per_gpu
dsv4,h200_sxm,1024x1024,50,118.2

400

模型、日期、视图、格式、负载、档位、权重或 alpha 值无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Invalid tiers: expected comma-separated positive numbers"
}

500

TCO 计算失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/submissions读取提交覆盖

返回配置级提交汇总和每日硬件提交量。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/submissions'

响应

Submissions

200

提交汇总和数量数组。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "summary": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "hardware": {
            "type": "string"
          },
          "framework": {
            "type": "string"
          },
          "precision": {
            "type": "string"
          },
          "spec_method": {
            "type": "string"
          },
          "disagg": {
            "type": "boolean"
          },
          "is_multinode": {
            "type": "boolean"
          },
          "num_prefill_gpu": {
            "type": "integer"
          },
          "num_decode_gpu": {
            "type": "integer"
          },
          "date": {
            "type": "string",
            "format": "date"
          },
          "total_datapoints": {
            "type": "integer"
          },
          "distinct_sequences": {
            "type": "integer"
          },
          "distinct_concurrencies": {
            "type": "integer"
          },
          "max_concurrency": {
            "type": "integer"
          },
          "image": {
            "type": [
              "string",
              "null"
            ]
          }
        },
        "required": [
          "model",
          "hardware",
          "framework",
          "precision",
          "spec_method",
          "disagg",
          "is_multinode",
          "num_prefill_gpu",
          "num_decode_gpu",
          "date",
          "total_datapoints",
          "distinct_sequences",
          "distinct_concurrencies",
          "max_concurrency",
          "image"
        ],
        "additionalProperties": false
      }
    },
    "volume": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "date": {
            "type": "string",
            "format": "date"
          },
          "hardware": {
            "type": "string"
          },
          "datapoints": {
            "type": "integer"
          }
        },
        "required": [
          "date",
          "hardware",
          "datapoints"
        ],
        "additionalProperties": false
      }
    }
  },
  "required": [
    "summary",
    "volume"
  ],
  "additionalProperties": false
}

响应示例

{
  "summary": [
    {
      "model": "dsr1",
      "hardware": "h200_sxm",
      "framework": "vllm",
      "precision": "fp8",
      "spec_method": "none",
      "disagg": false,
      "is_multinode": false,
      "num_prefill_gpu": 0,
      "num_decode_gpu": 8,
      "date": "2026-08-08",
      "total_datapoints": 24,
      "distinct_sequences": 3,
      "distinct_concurrencies": 8,
      "max_concurrency": 256,
      "image": "vllm/vllm-openai:v0.10.2"
    }
  ],
  "volume": [
    {
      "date": "2026-08-08",
      "hardware": "h200_sxm",
      "datapoints": 24
    }
  ]
}

500

提交查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/framework-releases读取最新框架版本

返回 vLLM 和 SGLang 最新的非草稿、非预发布 GitHub 版本标签。null 表示上游查询没有可用版本。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/framework-releases'

响应

FrameworkReleases

200

框架键映射到版本标签或 null。

媒体类型: application/json

响应结构

{
  "type": "object",
  "additionalProperties": {
    "type": [
      "string",
      "null"
    ]
  }
}

响应示例

{
  "vllm": "v0.10.2",
  "sglang": "v0.4.10"
}

500

版本查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/latest-images读取最新运行镜像

返回每个基准配置和序列最近观测到的容器镜像。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/latest-images'

响应

LatestImageRows

200

数据集

数据集目录、元数据、会话索引与会话结构。

GET稳定/api/v1/datasets列出已导入的数据集

返回数据集目录卡片，不包含较大的 chart_data 字段。

参数

无需参数。

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets'

响应

DatasetRecords

200

数据集目录记录。

媒体类型: application/json

响应结构

{
  "type": "array",
  "items": {
    "type": "object",
    "properties": {
      "id": {
        "type": "string"
      },
      "slug": {
        "type": "string"
      },
      "label": {
        "type": "string"
      },
      "variant": {
        "type": "string"
      },
      "description": {
        "type": [
          "string",
          "null"
        ]
      },
      "hf_url": {
        "type": [
          "string",
          "null"
        ]
      },
      "license": {
        "type": [
          "string",
          "null"
        ]
      },
      "conversation_count": {
        "type": "integer"
      },
      "summary": {
        "type": "object",
        "additionalProperties": true
      },
      "ingested_at": {
        "type": "string",
        "format": "date-time"
      }
    },
    "required": [
      "id",
      "slug",
      "label",
      "variant",
      "description",
      "hf_url",
      "license",
      "conversation_count",
      "summary",
      "ingested_at"
    ],
    "additionalProperties": false
  }
}

响应示例

[
  {
    "id": "ds_01",
    "slug": "cc-traces-weka",
    "label": "CC Traces Weka",
    "variant": "default",
    "description": "Agentic coding traces",
    "hf_url": "https://huggingface.co/datasets/example/cc-traces-weka",
    "license": "Apache-2.0",
    "conversation_count": 1200,
    "summary": {
      "totalIn": 8200000,
      "totalOut": 1700000
    },
    "ingested_at": "2026-08-08T03:00:00Z"
  }
]

500

数据集目录查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/datasets/{slug}读取数据集详情

返回一条数据集目录记录及其预计算的 chart_data 分布。

参数

GET /api/v1/datasets/{slug}: 参数
名称	位置	类型	要求	说明	示例
slug	path	string	必填	目录中的数据集 slug。	cc-traces-weka

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka'

响应

DatasetDetail

200

包含 chart_data 的数据集元数据。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "id": {
      "type": "string"
    },
    "slug": {
      "type": "string"
    },
    "label": {
      "type": "string"
    },
    "variant": {
      "type": "string"
    },
    "description": {
      "type": [
        "string",
        "null"
      ]
    },
    "hf_url": {
      "type": [
        "string",
        "null"
      ]
    },
    "license": {
      "type": [
        "string",
        "null"
      ]
    },
    "conversation_count": {
      "type": "integer"
    },
    "summary": {
      "type": "object",
      "additionalProperties": true
    },
    "ingested_at": {
      "type": "string",
      "format": "date-time"
    },
    "chart_data": {
      "type": "object",
      "additionalProperties": true
    }
  },
  "required": [
    "id",
    "slug",
    "label",
    "variant",
    "description",
    "hf_url",
    "license",
    "conversation_count",
    "summary",
    "ingested_at",
    "chart_data"
  ],
  "additionalProperties": false
}

响应示例

{
  "id": "ds_01",
  "slug": "cc-traces-weka",
  "label": "CC Traces Weka",
  "variant": "default",
  "description": "Agentic coding traces",
  "hf_url": null,
  "license": "Apache-2.0",
  "conversation_count": 1200,
  "summary": {},
  "ingested_at": "2026-08-08T03:00:00Z",
  "chart_data": {
    "tokens": {
      "bins": [
        0,
        1000,
        2000
      ],
      "counts": [
        140,
        320
      ]
    }
  }
}

404

没有使用此 slug 的数据集。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

数据集查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/datasets/{slug}/conversations列出数据集会话

返回可搜索、排序和分页的会话索引。只包含计数，不包含完整会话结构。

参数

GET /api/v1/datasets/{slug}/conversations: 参数
名称	位置	类型	要求	说明	示例
slug	path	string	必填	目录中的数据集 slug。	cc-traces-weka
search	query	string	可选	按会话 ID 搜索，会先去除首尾空格，最多 100 个字符。	trace-018
limit	query	integer	可选	每页数量，限制在 1 到 200。	50
offset	query	integer	可选	从 0 开始的行偏移。负数会变为 0。	0
sort	query	enum	可选	按 tokens、turns、subagents 或 id 排序。未知值回退到 tokens。	tokens

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka/conversations?limit=50&offset=0&sort=tokens'

响应

ConversationList

200

总数和会话索引项。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "total": {
      "type": "integer"
    },
    "items": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "conv_id": {
            "type": "string"
          },
          "models": {
            "type": "array",
            "items": {
              "type": "string"
            }
          },
          "num_turns": {
            "type": "integer"
          },
          "num_subagent_groups": {
            "type": "integer"
          },
          "total_in": {
            "type": "integer"
          },
          "total_out": {
            "type": "integer"
          },
          "total_cached": {
            "type": "integer"
          }
        },
        "required": [
          "conv_id",
          "models",
          "num_turns",
          "num_subagent_groups",
          "total_in",
          "total_out",
          "total_cached"
        ],
        "additionalProperties": false
      }
    }
  },
  "required": [
    "total",
    "items"
  ],
  "additionalProperties": false
}

响应示例

{
  "total": 1200,
  "items": [
    {
      "conv_id": "trace-018",
      "models": [
        "claude-sonnet-4"
      ],
      "num_turns": 42,
      "num_subagent_groups": 3,
      "total_in": 18200,
      "total_out": 4200,
      "total_cached": 9600
    }
  ]
}

400

search 超过 100 个字符。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "search too long"
}

404

没有使用此 slug 的数据集。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

会话查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET稳定/api/v1/datasets/{slug}/conversations/{convId}读取会话结构

返回单个会话及可用于火焰图的嵌套结构。App Router 对每个路径值解码一次。

参数

GET /api/v1/datasets/{slug}/conversations/{convId}: 参数
名称	位置	类型	要求	说明	示例
slug	path	string	必填	目录中的数据集 slug。	cc-traces-weka
convId	path	string	必填	会话索引中列出的原始会话 ID。	trace-018

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/datasets/cc-traces-weka/conversations/trace-018'

响应

ConversationDetail

200

会话计数和嵌套结构。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "conv_id": {
      "type": "string"
    },
    "models": {
      "type": "array",
      "items": {
        "type": "string"
      }
    },
    "num_turns": {
      "type": "integer"
    },
    "num_subagent_groups": {
      "type": "integer"
    },
    "total_in": {
      "type": "integer"
    },
    "total_out": {
      "type": "integer"
    },
    "total_cached": {
      "type": "integer"
    },
    "structure": {
      "type": "object",
      "additionalProperties": true
    }
  },
  "required": [
    "conv_id",
    "models",
    "num_turns",
    "num_subagent_groups",
    "total_in",
    "total_out",
    "total_cached",
    "structure"
  ],
  "additionalProperties": false
}

响应示例

{
  "conv_id": "trace-018",
  "models": [
    "claude-sonnet-4"
  ],
  "num_turns": 42,
  "num_subagent_groups": 3,
  "total_in": 18200,
  "total_out": 4200,
  "total_cached": 9600,
  "structure": {
    "name": "trace-018",
    "children": []
  }
}

404

数据集或会话不存在。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

会话查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

CollectiveX

带版本的集合通信扫描结果与运行发现数据。

GET测试版/api/v1/collectivex/latest读取最新 CollectiveX 数据集

按需发现并导入最新扫描，然后返回带版本的中立数据集。若刷新失败，会返回已存储的运行。

参数

GET /api/v1/collectivex/latest: 参数
名称	位置	类型	要求	说明	示例
version	query	enum	必填	CollectiveX 契约版本。	1

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/latest?version=1'

响应

CollectiveXDataset

200

最新 CollectiveX 运行、覆盖、序列和可选 KV 案例。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "version": {
      "type": "integer"
    },
    "run": {
      "type": "object",
      "properties": {
        "run_id": {
          "type": "string"
        },
        "run_attempt": {
          "type": "integer"
        },
        "generated_at": {
          "type": "string",
          "format": "date-time"
        },
        "conclusion": {
          "type": [
            "string",
            "null"
          ]
        },
        "source_sha": {
          "type": "string"
        },
        "requested_cases": {
          "type": "integer"
        },
        "terminal_cases": {
          "type": "integer"
        },
        "measured_cases": {
          "type": "integer"
        },
        "unsupported_cases": {
          "type": "integer"
        },
        "failed_cases": {
          "type": "integer"
        },
        "requested_points": {
          "type": "integer"
        },
        "terminal_points": {
          "type": "integer"
        },
        "measured_points": {
          "type": "integer"
        },
        "covered_skus": {
          "type": "array",
          "items": {
            "type": "string"
          }
        }
      },
      "required": [
        "run_id",
        "run_attempt",
        "generated_at",
        "conclusion",
        "source_sha",
        "requested_cases",
        "terminal_cases",
        "measured_cases",
        "unsupported_cases",
        "failed_cases",
        "requested_points",
        "terminal_points",
        "measured_points",
        "covered_skus"
      ],
      "additionalProperties": false
    },
    "coverage": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "series": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    }
  },
  "required": [
    "version",
    "run",
    "coverage",
    "series"
  ],
  "additionalProperties": false
}

响应示例

{
  "version": 1,
  "run": {
    "run_id": "123456789",
    "run_attempt": 1,
    "generated_at": "2026-08-08T03:00:00Z",
    "conclusion": "success",
    "source_sha": "0123456789abcdef",
    "requested_cases": 12,
    "terminal_cases": 12,
    "measured_cases": 10,
    "unsupported_cases": 2,
    "failed_cases": 0,
    "requested_points": 48,
    "terminal_points": 48,
    "measured_points": 40,
    "covered_skus": [
      "h200_sxm"
    ]
  },
  "coverage": [],
  "series": []
}

400

version 缺失或不受支持。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unknown version"
}

404

没有已存储或可发现的运行。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

502

上游扫描发现不可用，且没有已存储的回退数据。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

503

上游扫描处理暂时不可用。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

500

已存储运行查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/collectivex/runs列出 CollectiveX 运行

返回逐步发现的运行汇总。discovery_complete=false 表示仍在发现更早的运行，客户端可以轮询。

参数

GET /api/v1/collectivex/runs: 参数
名称	位置	类型	要求	说明	示例
version	query	enum	必填	CollectiveX 契约版本。	1

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/runs?version=1'

响应

CollectiveXRunList

200

版本、运行汇总和发现状态。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "version": {
      "type": "integer"
    },
    "runs": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "run_id": {
            "type": "string"
          },
          "run_attempt": {
            "type": "integer"
          },
          "generated_at": {
            "type": "string",
            "format": "date-time"
          },
          "conclusion": {
            "type": [
              "string",
              "null"
            ]
          },
          "covered_skus": {
            "type": "array",
            "items": {
              "type": "string"
            }
          },
          "requested_cases": {
            "type": "integer"
          },
          "measured_cases": {
            "type": "integer"
          },
          "requested_points": {
            "type": "integer"
          },
          "terminal_points": {
            "type": "integer"
          },
          "terminal_counts": {
            "type": "object",
            "properties": {
              "measured": {
                "type": "integer"
              },
              "unsupported": {
                "type": "integer"
              },
              "failed": {
                "type": "integer"
              }
            },
            "required": [
              "measured",
              "unsupported",
              "failed"
            ],
            "additionalProperties": false
          }
        },
        "required": [
          "run_id",
          "run_attempt",
          "generated_at",
          "conclusion",
          "covered_skus",
          "requested_cases",
          "measured_cases",
          "requested_points",
          "terminal_points",
          "terminal_counts"
        ],
        "additionalProperties": false
      }
    },
    "discovery_complete": {
      "type": "boolean"
    }
  },
  "required": [
    "version",
    "runs",
    "discovery_complete"
  ],
  "additionalProperties": false
}

响应示例

{
  "version": 1,
  "runs": [
    {
      "run_id": "123456789",
      "run_attempt": 1,
      "generated_at": "2026-08-08T03:00:00Z",
      "conclusion": "success",
      "covered_skus": [
        "h200_sxm"
      ],
      "requested_cases": 12,
      "measured_cases": 10,
      "requested_points": 48,
      "terminal_points": 48,
      "terminal_counts": {
        "measured": 40,
        "unsupported": 8,
        "failed": 0
      }
    }
  ],
  "discovery_complete": true
}

400

version 缺失或不受支持。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unknown version"
}

502

发现失败，且没有已存储的运行列表。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

503

发现暂时不可用。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

500

已存储运行列表查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/collectivex/runs/{runId}读取 CollectiveX 运行

按正整数运行 ID 返回带版本的 CollectiveX 数据集，并在可能时按需发现和导入。

参数

GET /api/v1/collectivex/runs/{runId}: 参数
名称	位置	类型	要求	说明	示例
runId	path	integer	必填	GitHub Actions 正整数运行 ID。	123456789
version	query	enum	必填	CollectiveX 契约版本。	1

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/collectivex/runs/123456789?version=1'

响应

CollectiveXDataset

200

请求的 CollectiveX 数据集。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "version": {
      "type": "integer"
    },
    "run": {
      "type": "object",
      "properties": {
        "run_id": {
          "type": "string"
        },
        "run_attempt": {
          "type": "integer"
        },
        "generated_at": {
          "type": "string",
          "format": "date-time"
        },
        "conclusion": {
          "type": [
            "string",
            "null"
          ]
        },
        "source_sha": {
          "type": "string"
        },
        "requested_cases": {
          "type": "integer"
        },
        "terminal_cases": {
          "type": "integer"
        },
        "measured_cases": {
          "type": "integer"
        },
        "unsupported_cases": {
          "type": "integer"
        },
        "failed_cases": {
          "type": "integer"
        },
        "requested_points": {
          "type": "integer"
        },
        "terminal_points": {
          "type": "integer"
        },
        "measured_points": {
          "type": "integer"
        },
        "covered_skus": {
          "type": "array",
          "items": {
            "type": "string"
          }
        }
      },
      "required": [
        "run_id",
        "run_attempt",
        "generated_at",
        "conclusion",
        "source_sha",
        "requested_cases",
        "terminal_cases",
        "measured_cases",
        "unsupported_cases",
        "failed_cases",
        "requested_points",
        "terminal_points",
        "measured_points",
        "covered_skus"
      ],
      "additionalProperties": false
    },
    "coverage": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "series": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    }
  },
  "required": [
    "version",
    "run",
    "coverage",
    "series"
  ],
  "additionalProperties": false
}

响应示例

{
  "version": 1,
  "run": {
    "run_id": "123456789",
    "run_attempt": 1,
    "generated_at": "2026-08-08T03:00:00Z",
    "conclusion": "success",
    "source_sha": "0123456789abcdef",
    "requested_cases": 12,
    "terminal_cases": 12,
    "measured_cases": 10,
    "unsupported_cases": 2,
    "failed_cases": 0,
    "requested_points": 48,
    "terminal_points": 48,
    "measured_points": 40,
    "covered_skus": [
      "h200_sxm"
    ]
  },
  "coverage": [],
  "series": []
}

400

version 或 runId 无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unknown version or run id"
}

404

该运行不存在。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

502

无法从上游来源获取该运行。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

503

上游处理暂时不可用。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Unavailable"
}

500

运行查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

诊断读取

按结果提供跟踪、缓存、请求、同组结果和服务器指标诊断。

GET测试版/api/v1/agentic-aggregates读取智能体汇总百分位

按基准结果 ID 返回 ISL、OSL、KV 缓存利用率和前缀缓存命中率百分位。ID 会去重，最多接受 200 个。

参数

GET /api/v1/agentic-aggregates: 参数
名称	位置	类型	要求	说明	示例
ids	query	comma-separated integers	必填	1 到 200 个正整数基准结果 ID。	421,422

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/agentic-aggregates?ids=421,422'

响应

AgenticAggregateMap

200

结果 ID 映射到汇总百分位或 null 指标组。

媒体类型: application/json

响应结构

{
  "type": "object",
  "additionalProperties": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "isl": {
        "oneOf": [
          {
            "type": "object",
            "properties": {
              "mean": {
                "type": "number"
              },
              "p50": {
                "type": "number"
              },
              "p75": {
                "type": "number"
              },
              "p90": {
                "type": "number"
              },
              "p99": {
                "type": "number"
              }
            },
            "required": [
              "mean",
              "p50",
              "p75",
              "p90",
              "p99"
            ],
            "additionalProperties": false
          },
          {
            "type": "null"
          }
        ]
      },
      "osl": {
        "oneOf": [
          {
            "type": "object",
            "properties": {
              "mean": {
                "type": "number"
              },
              "p50": {
                "type": "number"
              },
              "p75": {
                "type": "number"
              },
              "p90": {
                "type": "number"
              },
              "p99": {
                "type": "number"
              }
            },
            "required": [
              "mean",
              "p50",
              "p75",
              "p90",
              "p99"
            ],
            "additionalProperties": false
          },
          {
            "type": "null"
          }
        ]
      },
      "kvCacheUtil": {
        "oneOf": [
          {
            "type": "object",
            "properties": {
              "mean": {
                "type": "number"
              },
              "p50": {
                "type": "number"
              },
              "p75": {
                "type": "number"
              },
              "p90": {
                "type": "number"
              },
              "p99": {
                "type": "number"
              }
            },
            "required": [
              "mean",
              "p50",
              "p75",
              "p90",
              "p99"
            ],
            "additionalProperties": false
          },
          {
            "type": "null"
          }
        ]
      },
      "prefixCacheHitRate": {
        "oneOf": [
          {
            "type": "object",
            "properties": {
              "mean": {
                "type": "number"
              },
              "p50": {
                "type": "number"
              },
              "p75": {
                "type": "number"
              },
              "p90": {
                "type": "number"
              },
              "p99": {
                "type": "number"
              }
            },
            "required": [
              "mean",
              "p50",
              "p75",
              "p90",
              "p99"
            ],
            "additionalProperties": false
          },
          {
            "type": "null"
          }
        ]
      }
    },
    "required": [
      "id",
      "isl",
      "osl",
      "kvCacheUtil",
      "prefixCacheHitRate"
    ],
    "additionalProperties": false
  }
}

响应示例

{
  "421": {
    "id": 421,
    "isl": {
      "mean": 18320,
      "p50": 16440,
      "p75": 20110,
      "p90": 24880,
      "p99": 31900
    },
    "osl": null,
    "kvCacheUtil": null,
    "prefixCacheHitRate": null
  }
}

400

ids 缺失、格式错误或超过 200 个唯一 ID。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected ids as comma-separated positive integers"
}

500

汇总查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/benchmark-siblings读取同组基准点

返回基准 SKU，以及同一硬件、框架、模型、精度、方法、基准类型和工作流运行中的全部点。

参数

GET /api/v1/benchmark-siblings: 参数
名称	位置	类型	要求	说明	示例
id	query	integer	必填	正整数基准结果 ID。	421

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/benchmark-siblings?id=421'

响应

BenchmarkSiblings

200

SKU 元数据和同组导航行。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "sku": {
      "type": "object",
      "additionalProperties": true
    },
    "siblings": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    }
  },
  "required": [
    "sku",
    "siblings"
  ],
  "additionalProperties": false
}

响应示例

{
  "sku": {
    "hardware": "h200_sxm",
    "framework": "vllm",
    "model": "dsr1",
    "precision": "fp8",
    "spec_method": "none",
    "benchmark_type": "agentic_traces",
    "github_run_id": 123456789,
    "date": "2026-08-08",
    "dataset_slug": "cc-traces-weka"
  },
  "siblings": [
    {
      "id": 421,
      "conc": 32,
      "offload_mode": "off",
      "decode_tp": 8,
      "decode_ep": 1,
      "decode_pp": null,
      "decode_dp_attention": false,
      "decode_num_workers": 1,
      "prefill_tp": 8,
      "prefill_ep": 1,
      "prefill_pp": null,
      "prefill_dp_attention": false,
      "prefill_num_workers": 1,
      "num_prefill_gpu": 0,
      "num_decode_gpu": 8,
      "disagg": false,
      "is_multinode": false,
      "tput_per_gpu": 128.4,
      "total_requests": 320,
      "is_current": true,
      "has_trace": true
    }
  ]
}

400

id 缺失或无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected a positive numeric id"
}

404

没有使用此 ID 的基准结果。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

同组查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/derived-agentic-metrics读取派生智能体指标

按基准结果 ID 返回归一化交互性百分位。ID 会去重，最多接受 200 个。

参数

GET /api/v1/derived-agentic-metrics: 参数
名称	位置	类型	要求	说明	示例
ids	query	comma-separated integers	必填	1 到 200 个正整数基准结果 ID。	421,422

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/derived-agentic-metrics?ids=421,422'

响应

DerivedAgenticMetricMap

200

结果 ID 映射到 p75 和 p90 归一化交互性。

媒体类型: application/json

响应结构

{
  "type": "object",
  "additionalProperties": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "p75_e2e_norm_intvty": {
        "type": [
          "number",
          "null"
        ]
      },
      "p90_e2e_norm_intvty": {
        "type": [
          "number",
          "null"
        ]
      }
    },
    "required": [
      "id",
      "p75_e2e_norm_intvty",
      "p90_e2e_norm_intvty"
    ],
    "additionalProperties": false
  }
}

响应示例

{
  "421": {
    "id": 421,
    "p75_e2e_norm_intvty": 31.2,
    "p90_e2e_norm_intvty": 24.8
  }
}

400

ids 缺失、格式错误或超过 200 个唯一 ID。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected ids as comma-separated positive integers"
}

500

派生指标查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/request-timeline读取请求时间线

返回带版本的基准窗口，以及每个请求的调度、确认、完成、token、阶段、工作进程和取消时间。

参数

GET /api/v1/request-timeline: 参数
名称	位置	类型	要求	说明	示例
id	query	integer	必填	正整数基准结果 ID。	421

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/request-timeline?id=421'

响应

RequestTimeline

200

时间线元数据和请求记录。纳秒事件字段是相对 startNs 的偏移。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "version": {
      "type": "integer"
    },
    "startNs": {
      "type": "integer"
    },
    "endNs": {
      "type": "integer"
    },
    "durationS": {
      "type": "number"
    },
    "requests": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "cid": {
            "type": "string"
          },
          "ti": {
            "type": "integer"
          },
          "wid": {
            "type": "string"
          },
          "ad": {
            "type": "integer"
          },
          "phase": {
            "type": "string"
          },
          "credit": {
            "type": "integer"
          },
          "start": {
            "type": "integer"
          },
          "ack": {
            "type": [
              "number",
              "null"
            ]
          },
          "end": {
            "type": "integer"
          },
          "ttftMs": {
            "type": [
              "number",
              "null"
            ]
          },
          "tpotMs": {
            "type": [
              "number",
              "null"
            ]
          },
          "isl": {
            "type": [
              "number",
              "null"
            ]
          },
          "osl": {
            "type": [
              "number",
              "null"
            ]
          },
          "cancelled": {
            "type": "boolean"
          }
        },
        "required": [
          "cid",
          "ti",
          "wid",
          "ad",
          "phase",
          "credit",
          "start",
          "ack",
          "end",
          "ttftMs",
          "tpotMs",
          "isl",
          "osl",
          "cancelled"
        ],
        "additionalProperties": false
      }
    }
  },
  "required": [
    "version",
    "startNs",
    "endNs",
    "durationS",
    "requests"
  ],
  "additionalProperties": false
}

响应示例

{
  "version": 5,
  "startNs": 1000000000,
  "endNs": 2400000000,
  "durationS": 1.4,
  "requests": [
    {
      "cid": "trace-018",
      "ti": 0,
      "wid": "7",
      "ad": 0,
      "phase": "profiling",
      "credit": 0,
      "start": 1200000,
      "ack": 1800000,
      "end": 420000000,
      "ttftMs": 42.3,
      "tpotMs": 18.1,
      "isl": 18320,
      "osl": 410,
      "cancelled": false
    }
  ]
}

400

id 缺失或无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected a positive numeric id"
}

404

该结果没有时间线。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

时间线查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/server-log读取基准服务器日志

返回某个基准结果 ID 已存储的纯文本服务器日志。

参数

GET /api/v1/server-log: 参数
名称	位置	类型	要求	说明	示例
id	query	integer	必填	正整数基准结果 ID。	421

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/server-log?id=421'

响应

ServerLog

200

基准结果 ID 和服务器日志文本。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "id": {
      "type": "integer"
    },
    "serverLog": {
      "type": "string"
    }
  },
  "required": [
    "id",
    "serverLog"
  ],
  "additionalProperties": false
}

响应示例

{
  "id": 421,
  "serverLog": "INFO engine initialized\nINFO benchmark complete"
}

400

id 缺失或无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Invalid id"
}

404

该结果没有服务器日志。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

服务器日志查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/trace-availability检查跟踪可用性

仅返回具有已存储跟踪的基准结果 ID。ID 会去重，最多接受 500 个。

参数

GET /api/v1/trace-availability: 参数
名称	位置	类型	要求	说明	示例
ids	query	comma-separated integers	必填	1 到 500 个正整数基准结果 ID。	421,422

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-availability?ids=421,422'

响应

TraceAvailabilityMap

200

可用结果 ID 映射为 true。缺失的键表示没有跟踪。

媒体类型: application/json

响应结构

{
  "type": "object",
  "additionalProperties": {
    "type": "boolean"
  }
}

响应示例

{
  "421": true
}

400

ids 缺失、格式错误或超过 500 个唯一 ID。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected ids as comma-separated positive integers"
}

500

跟踪可用性查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/trace-histograms读取跟踪直方图

按基准结果 ID 返回输入和输出 token 计数数组。ID 会去重，最多接受 200 个。

参数

GET /api/v1/trace-histograms: 参数
名称	位置	类型	要求	说明	示例
ids	query	comma-separated integers	必填	1 到 200 个正整数基准结果 ID。	421,422

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-histograms?ids=421,422'

响应

TraceHistogramMap

200

结果 ID 映射到原始 ISL 和 OSL 样本。

媒体类型: application/json

响应结构

{
  "type": "object",
  "additionalProperties": {
    "type": "object",
    "properties": {
      "id": {
        "type": "integer"
      },
      "isl": {
        "type": "array",
        "items": {
          "type": "number"
        }
      },
      "osl": {
        "type": "array",
        "items": {
          "type": "number"
        }
      }
    },
    "required": [
      "id",
      "isl",
      "osl"
    ],
    "additionalProperties": false
  }
}

响应示例

{
  "421": {
    "id": 421,
    "isl": [
      18220,
      19340,
      15110
    ],
    "osl": [
      410,
      380,
      512
    ]
  }
}

400

ids 缺失、格式错误或超过 200 个唯一 ID。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected ids as comma-separated positive integers"
}

500

直方图查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

GET测试版/api/v1/trace-server-metrics读取跟踪服务器指标

返回点元数据，以及缓存使用率、队列深度、预填充和解码吞吐、提示 token 来源与指标来源的图表时间序列。

参数

GET /api/v1/trace-server-metrics: 参数
名称	位置	类型	要求	说明	示例
id	query	integer	必填	正整数基准结果 ID。	421

请求

curl -sS 'https://inferencex.semianalysis.com/api/v1/trace-server-metrics?id=421'

响应

TraceServerMetrics

200

点元数据、窗口边界和服务器指标序列。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "meta": {
      "type": "object",
      "additionalProperties": true
    },
    "startNs": {
      "type": "integer"
    },
    "endNs": {
      "type": "integer"
    },
    "durationS": {
      "type": "number"
    },
    "timeslicesCount": {
      "type": "integer"
    },
    "kvCacheUsage": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "prefixCacheHitRate": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "queueDepth": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "promptTokensBySource": {
      "type": "object",
      "additionalProperties": {
        "type": "array",
        "items": {
          "type": "object",
          "additionalProperties": true
        }
      }
    },
    "prefillTps": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "decodeTps": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "prefixCacheHitsTps": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "hostKvCacheUsage": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "kvCacheUsageByEngine": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    },
    "kvCachePoolTokens": {
      "type": [
        "number",
        "null"
      ]
    },
    "metricSources": {
      "type": "array",
      "items": {
        "type": "object",
        "additionalProperties": true
      }
    }
  },
  "required": [
    "meta",
    "startNs",
    "endNs",
    "durationS",
    "timeslicesCount",
    "kvCacheUsage",
    "prefixCacheHitRate",
    "queueDepth",
    "promptTokensBySource",
    "prefillTps",
    "decodeTps",
    "prefixCacheHitsTps",
    "hostKvCacheUsage",
    "kvCacheUsageByEngine",
    "kvCachePoolTokens",
    "metricSources"
  ],
  "additionalProperties": false
}

响应示例

{
  "meta": {
    "id": 421,
    "hardware": "h200_sxm",
    "framework": "vllm",
    "model": "dsr1",
    "conc": 32,
    "date": "2026-08-08"
  },
  "startNs": 1000000000,
  "endNs": 2400000000,
  "durationS": 1.4,
  "timeslicesCount": 2,
  "kvCacheUsage": [
    {
      "t": 0,
      "v": 0.44
    }
  ],
  "prefixCacheHitRate": [],
  "queueDepth": [],
  "promptTokensBySource": {},
  "prefillTps": [],
  "decodeTps": [],
  "prefixCacheHitsTps": [],
  "hostKvCacheUsage": [],
  "kvCacheUsageByEngine": [],
  "kvCachePoolTokens": 983040,
  "metricSources": []
}

400

id 缺失或无效。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Expected a positive numeric id"
}

404

该结果没有服务器指标。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Not found"
}

500

服务器指标查询失败。

媒体类型: application/json

响应结构

{
  "type": "object",
  "properties": {
    "error": {
      "type": "string"
    }
  },
  "required": [
    "error"
  ],
  "additionalProperties": true
}

响应示例

{
  "error": "Internal server error"
}

快速入门

发现可用配置

获取基准行

约定

BenchmarkRow 与指标

端点参考

核心基准数据

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

外部数据源

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

数据集

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

CollectiveX

参数

请求

响应

参数

请求

响应

参数

请求

响应

诊断读取

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应

参数

请求

响应