BenchRating bench.rating@1
Generated at from
openvibe-contracts v0.419.0 and
openvibe-sdk v0.161.0.
- Version
- 1.0.0
- Owner
- bench
- Visibility
- first-party
- Status
- active
- Compatibility
- backward
- Schema
https://openvibe.network/contracts/bench/rating.v1.json
bench.rating@1: a rating on a benchmark board on OpenVibe.Bench. CATEGORY and SUBJECT identify what is rated (a model, a route or a room's own subject); ELO, GAMES, WINS, LOSSES, TIES and WIN_RATE are the score; CI_LOWER and CI_UPPER bound the estimate.
Fields
| Field | Type | Required | Description | Constraints |
|---|---|---|---|---|
kind_id | string | yes | ||
category | string | yes | ||
subject | string | yes | ||
elo | number | yes | ||
games | number | yes | ||
wins | number | yes | ||
losses | number | yes | ||
ties | number | yes | ||
win_rate | number | yes | ||
ci_lower | number | yes | ||
ci_upper | number | yes | ||
median_cost_usd | number | null | |||
median_ms | number | null | |||
provisional | boolean |
Examples
From the contract's own test fixtures: valid ones validate, rejected ones must fail.
Valid: model
{
"kind_id": "knd_01J8Z3Q4R5S6T7V8W9X0Y1Z2A3",
"category": "model",
"subject": "gpt-4o",
"elo": 1500,
"games": 10,
"wins": 6,
"losses": 3,
"ties": 1,
"win_rate": 0.6,
"ci_lower": 1400,
"ci_upper": 1600,
"median_cost_usd": null,
"median_ms": null,
"provisional": false
}Rejected: missing-ci-upper
{
"kind_id": "knd_01J8Z3Q4R5S6T7V8W9X0Y1Z2A3",
"category": "model",
"subject": "gpt-4o",
"elo": 1500,
"games": 10,
"wins": 6,
"losses": 3,
"ties": 1,
"win_rate": 0.6,
"ci_lower": 1400
}Validate
const contracts = require('openvibe-contracts');
contracts.validate('bench.rating@1', value); // { valid, errors: [{ path, message }] }