Retrieve Benchmark Results
Definition
Under the organization/project/Benchmark/Version prefix, current gateway routes include:
External Group/child reads additionally use their returned nested links.
GET /version-context GET /runs/{runId} GET /runs/{runId}/evaluation-context GET /runs/{runId}/evaluation-results GET /runs/{runId}/evaluation-instructions GET /comparison/{runId}/summary GET /comparison/{runId}/cases
Read the exact population
Verify that the individual Run belongs to the selected Benchmark Version. Read available Case outputs, rubric judgments, native interpretation, rationale and incomplete state. Page through the authoritative filtered result population rather than treating the first page as all results.
Instructions and context orient the coding agent; neither is a mutation or a completed evaluation.
Compare
Comparisons preserve individual Run grain and recorded conditions. Missing outputs, profile drift or unavailable native results can prevent a definitive comparison. A later independent Run does not silently replace the reference chosen before outcomes were known.
Record the exact starting and candidate Run IDs. Do not interpret legacy compatibility columns as mandatory binary rules when the current Regime supplies native point/gate meaning.
Read a bounded page
Use the child Trial's runId. The data payload holds the page. limit accepts 1–100 (default 20); offset is nonnegative. Page through the returned population instead of treating one page as all results.
| Query | Selection |
|---|---|
result | passed, failed or missing rubric observations |
case_id, policy_id | One Case or Policy |
case_rubric_pair_id | One Case/Rubric pair |
dimension_id, ontology_id | Declared coverage population |
The same filters apply to evaluation-context. Unknown/repeated parameters are rejected. Run and instruction reads take no query parameters.
curl --fail-with-body \
--header "Authorization: Bearer ${TEAMMATELY_API_KEY}" \
"${BENCHMARK_URL}/runs/${RUN_ID}/evaluation-results?limit=20&offset=0"
Compare two Trials
Use /cases for paged changes, with limit and offset. Both child IDs must belong to the scope. Inspect comparability and incompleteness before interpreting a delta.
curl --fail-with-body --get \
--header "Authorization: Bearer ${TEAMMATELY_API_KEY}" \
--data-urlencode "target_run_id=${TARGET_RUN_ID}" \
"${BENCHMARK_URL}/comparison/${BASELINE_RUN_ID}/summary"