{"query":"Map External Evaluation Outputs","corpusVersion":"local","generatedAt":"2026-09-13T04:37:54.213Z","results":[{"blockId":"benchmark-evaluations.output-mapping#map-external-evaluation-outputs","pageId":"benchmark-evaluations.output-mapping","title":"Map External Evaluation Outputs","pageTitle":"Map External Evaluation Outputs","url":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","humanUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping#map-external-evaluation-outputs","markdownUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","sectionId":"map-external-evaluation-outputs","kind":"task","productArea":"benchmark_evaluations","score":3349.532653350959,"reasons":["search_match","title_match","display_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"# Map External Evaluation Outputs"},{"blockId":"integrations.connect-model-outputs#map-outputs","pageId":"integrations.connect-model-outputs","title":"Map outputs","pageTitle":"Connect Model Outputs","url":"https://teammately.ai/docs/integrations/connect-model-outputs.md","humanUrl":"https://teammately.ai/docs/integrations/connect-model-outputs#map-outputs","markdownUrl":"https://teammately.ai/docs/integrations/connect-model-outputs.md","sectionId":"map-outputs","kind":"task","productArea":"benchmark_evaluations","score":1952.1405771085376,"reasons":["search_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Map outputs"},{"blockId":"integrations.connect-model-outputs#task-steps-connect-external-model-outputs","pageId":"integrations.connect-model-outputs","title":"Task steps: Connect external model outputs","pageTitle":"Connect Model Outputs","url":"https://teammately.ai/docs/integrations/connect-model-outputs.md","humanUrl":"https://teammately.ai/docs/integrations/connect-model-outputs#task-steps-connect-external-model-outputs","markdownUrl":"https://teammately.ai/docs/integrations/connect-model-outputs.md","sectionId":"task-steps-connect-external-model-outputs","kind":"task","productArea":"benchmark_evaluations","score":1474.0164184521745,"reasons":["search_match","term_match","prefix_or_fuzzy_match"],"markdown":"### Task steps: Connect external model outputs\n\n1. Open the intended Benchmark Version and go to **Benchmark Evaluations** → **Runs**.\n2. Choose **Import reference outputs** and name the external system or candidate clearly.\n3. Download the mapping template for the current Benchmark Version. Keep `case_id` unchanged; use input and context columns only to verify the match.\n4. Populate `output` for each Case. Add latency, usage, or cost columns only for values measured by the producing system.\n5. Upload the file and inspect unknown Case IDs, missing Benchmark Cases, duplicates, and output previews.\n6. Resolve every mapping error. Do not join on input text or force an output onto a similar-looking Case.\n7. Confirm the mapping and inspect the output-only reference Run.\n8. Wait for evaluation to complete before interpreting result summaries or failures."},{"blockId":"integrations.connect-model-outputs#connect-model-outputs","pageId":"integrations.connect-model-outputs","title":"Connect Model Outputs","pageTitle":"Connect Model Outputs","url":"https://teammately.ai/docs/integrations/connect-model-outputs.md","humanUrl":"https://teammately.ai/docs/integrations/connect-model-outputs#connect-model-outputs","markdownUrl":"https://teammately.ai/docs/integrations/connect-model-outputs.md","sectionId":"connect-model-outputs","kind":"task","productArea":"benchmark_evaluations","score":1137.3409272966185,"reasons":["search_match","term_match","prefix_or_fuzzy_match"],"markdown":"# Connect Model Outputs"},{"blockId":"benchmark-evaluations.output-mapping#prerequisites","pageId":"benchmark-evaluations.output-mapping","title":"Prerequisites","pageTitle":"Map External Evaluation Outputs","url":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","humanUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping#prerequisites","markdownUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","sectionId":"prerequisites","kind":"task","productArea":"benchmark_evaluations","score":1099.0901544053427,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Prerequisites\n\n- External outputs for the exact Benchmark Version.\n- Durable Case IDs and, for repeated groups, an attempt-assignment plan.\n- Permission to create or update the output-only Run.\n\nOutput mapping admits responses produced outside the managed Harness runtime as an output-only Run. Use upload or the displayed API path, then map every row to an immutable Case in the current Benchmark Version."},{"blockId":"benchmark-evaluations.output-mapping#steps","pageId":"benchmark-evaluations.output-mapping","title":"Steps","pageTitle":"Map External Evaluation Outputs","url":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","humanUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping#steps","markdownUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","sectionId":"steps","kind":"task","productArea":"benchmark_evaluations","score":1074.90571165597,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Steps\n\n1. Open Runs and start the external or reference-output mapping flow.\n2. Download or inspect the template for the current Benchmark Version.\n3. Populate exact Case IDs and outputs. Preserve the source system's telemetry only when it is measured.\n4. Upload or submit through the displayed API workflow and review the preview.\n5. Resolve unknown Cases, missing benchmark Cases, duplicates, or ambiguous attempt assignments.\n6. Commit the mapping and inspect inserted, updated, missing, and unknown counts.\n7. Follow evaluation progress and inspect the output-only Run from List.\n\n> Reference output boundary\n>\n> An imported output-only Run can be scored and inspected, but it is not a saved Harness Version. It cannot be activated, optimized in Improve, or used as a Harness column in Compare or Arena."},{"blockId":"benchmark-evaluations.output-mapping#related-troubleshooting-pages","pageId":"benchmark-evaluations.output-mapping","title":"Related troubleshooting pages","pageTitle":"Map External Evaluation Outputs","url":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","humanUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping#related-troubleshooting-pages","markdownUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","sectionId":"related-troubleshooting-pages","kind":"task","productArea":"benchmark_evaluations","score":1063.5223061898216,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Related troubleshooting pages\n\n{% related-card-grid title=\"Related troubleshooting pages\" %}\n- [Output mapping](/docs/troubleshooting/output-mapping)\n- [Missing outputs](/docs/troubleshooting/missing-outputs)\n- [Dataset upload](/docs/troubleshooting/dataset-upload)\n{% /related-card-grid %}"},{"blockId":"benchmark-evaluations.output-mapping#related-reference-pages","pageId":"benchmark-evaluations.output-mapping","title":"Related reference pages","pageTitle":"Map External Evaluation Outputs","url":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","humanUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping#related-reference-pages","markdownUrl":"https://teammately.ai/docs/benchmark-evaluations/output-mapping.md","sectionId":"related-reference-pages","kind":"task","productArea":"benchmark_evaluations","score":1053.9252538125024,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Related reference pages\n\n{% related-card-grid title=\"Related reference pages\" %}\n- [Benchmark Evaluations](/docs/benchmark-evaluations)\n- [Dataset Snapshots](/docs/benchmark-datasets/snapshots)\n- [Connect model outputs](/docs/integrations/connect-model-outputs)\n{% /related-card-grid %}"}]}