BenchEntry bench.entry@1

Generated at from openvibe-contracts v0.419.0 and openvibe-sdk v0.161.0.

Version
1.0.0
Owner
bench
Visibility
first-party
Status
active
Compatibility
backward
Schema
https://openvibe.network/contracts/bench/entry.v1.json

bench.entry@1: one submitted entry in a benchmark round on OpenVibe.Bench. PROVIDER and MODEL name the offer; ROUTE is the exact route taken; PAYLOAD is the entry's output; COST_USD, MS and TOKENS are the measured use.

Fields

FieldTypeRequiredDescriptionConstraints
idstringyes
round_idstringyes
providerstringyes
modelstringyes
routeobjectyes
payloadobjectyes
cost_usdnumberyes
msnumberyes
tokensnumberyes
errorstring | null
ui_checkobject | null
run_idstring | null

Examples

From the contract's own test fixtures: valid ones validate, rejected ones must fail.

Valid: answer
{
  "id": "ent_01J8Z3Q4R5S6T7V8W9X0Y1Z2A7",
  "round_id": "rnd_01J8Z3Q4R5S6T7V8W9X0Y1Z2A6",
  "provider": "openai",
  "model": "gpt-4o",
  "route": {
    "provider": "openai",
    "model": "gpt-4o"
  },
  "payload": {
    "text": "It is a page about benchmarks."
  },
  "cost_usd": 0.01,
  "ms": 1200,
  "tokens": 42,
  "error": null,
  "ui_check": null,
  "run_id": null
}
Rejected: missing-tokens
{
  "id": "ent_01J8Z3Q4R5S6T7V8W9X0Y1Z2A7",
  "round_id": "rnd_01J8Z3Q4R5S6T7V8W9X0Y1Z2A6",
  "provider": "openai",
  "model": "gpt-4o",
  "route": {
    "provider": "openai",
    "model": "gpt-4o"
  },
  "payload": {
    "text": "It is a page about benchmarks."
  },
  "cost_usd": 0.01,
  "ms": 1200
}

Validate

const contracts = require('openvibe-contracts');
contracts.validate('bench.entry@1', value);   // { valid, errors: [{ path, message }] }