{"query":"Submit External Outputs with the CLI","corpusVersion":"local","generatedAt":"2026-11-02T06:36:34.022Z","results":[{"blockId":"cli.external-outputs#submit-external-outputs-with-the-cli","pageId":"cli.external-outputs","title":"Submit External Outputs with the CLI","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#submit-external-outputs-with-the-cli","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"submit-external-outputs-with-the-cli","kind":"quickstart","productArea":"developer_tools","score":4939.584852028474,"reasons":["search_match","exact_match","title_match","term_match"],"markdown":"# Submit External Outputs with the CLI"},{"blockId":"cli.external-outputs#validate-submit-and-inspect","pageId":"cli.external-outputs","title":"Validate, submit and inspect","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#validate-submit-and-inspect","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"validate-submit-and-inspect","kind":"quickstart","productArea":"developer_tools","score":2739.9221444793175,"reasons":["search_match","exact_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Validate, submit and inspect\n\n```sh\nteammately eval validate-results \\\n  --manifest ./evaluation-package/manifest.json --results ./results.json\nteammately eval submit-results \\\n  --manifest ./evaluation-package/manifest.json --results ./results.json \\\n  --name 'Application candidate' --receipt ./import-receipt.json\n```\n\nMissing Cases require explicit `--allow-partial` for both validation and submission. The CLI accepts result files up to 32 MiB and uses batches up to 10 MiB. Keep the manifest, results and receipt secure until recovery is no longer needed.\n\nUse the returned child Run ID, not the group ID:\n\n```sh\nteammately run wait --run \"$RUN_ID\" --timeout 10m\nteammately eval results --run \"$RUN_ID\" --limit 20\nteammately run compare --run \"$BASELINE_RUN_ID\" --target \"$RUN_ID\"\n```\n\nComparison needs an actual baseline selected before inspecting candidate outcomes. Without one, inspect the first Trial's results without inventing a comparison. Page through results and preserve incompleteness/comparability reasons."},{"blockId":"cli.external-outputs#related-reference-pages","pageId":"cli.external-outputs","title":"Related reference pages","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#related-reference-pages","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"related-reference-pages","kind":"quickstart","productArea":"developer_tools","score":1903.5495588746235,"reasons":["search_match","exact_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Related reference pages\n\n{% related-card-grid %}\n- [Command reference](/docs/cli/reference)\n- [External outputs API](/docs/public-api/evaluation-outputs)\n- [Output mapping troubleshooting](/docs/troubleshooting/output-mapping)\n{% /related-card-grid %}"},{"blockId":"cli.external-outputs#recovery-and-corrections","pageId":"cli.external-outputs","title":"Recovery and corrections","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#recovery-and-corrections","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"recovery-and-corrections","kind":"quickstart","productArea":"developer_tools","score":1867.6100818584557,"reasons":["search_match","exact_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Recovery and corrections\n\nRetry an interrupted write with the same original files and receipt. Changed content needs a new receipt and operation. Accepted responses are immutable within a Trial; a correction can create another Trial in the same external Run using `--group`, or an intentionally new Run.\n\nIf completion froze the responses but judging admission failed, use `teammately eval complete --group \"$GROUP_ID\" --run \"$RUN_ID\" --retry`, retaining the original partial policy. Admission success is not completed judging. These operations do not adopt code changes or activate a Harness."},{"blockId":"cli.external-outputs#prerequisites","pageId":"cli.external-outputs","title":"Prerequisites","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#prerequisites","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"prerequisites","kind":"quickstart","productArea":"developer_tools","score":1837.6667943973355,"reasons":["search_match","exact_match","page_title_match","term_match"],"markdown":"## Prerequisites\n\n[Authenticate](/docs/cli/authentication) with write access and select the exact organization, Project, Benchmark and immutable Version. Your application produces the responses in its own runtime. A managed Harness is optional."},{"blockId":"cli.external-outputs#example-results-json-shape","pageId":"cli.external-outputs","title":"Example: results.json shape","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#example-results-json-shape","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"example-results-json-shape","kind":"quickstart","productArea":"developer_tools","score":1830.7042699643018,"reasons":["search_match","exact_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"### Example: results.json shape\n\n```json\n[\n  {\n    \"case_id\": \"<issued Case ID from the manifest>\",\n    \"output\": {\"reply\": \"<actual application response>\"}\n  }\n]\n```\n\nReplace both placeholders with an actual manifest ID and its actual response. Each row has exactly one native JSON `output` or `failure` with `code` and `message`. Optional trajectory and measured latency/usage/cost remain absent when unknown. JSON null and text whitespace can be meaningful outputs."},{"blockId":"cli.external-outputs#prepare-cases-and-criteria","pageId":"cli.external-outputs","title":"Prepare Cases and criteria","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#prepare-cases-and-criteria","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"prepare-cases-and-criteria","kind":"quickstart","productArea":"developer_tools","score":1787.6060815122476,"reasons":["search_match","exact_match","page_title_match","term_match"],"markdown":"## Prepare Cases and criteria\n\n```sh\nteammately eval version-context --kind summary\nteammately eval version-context --kind policies --limit 20\nteammately eval version-context --kind rubrics --limit 20\nteammately eval prepare --out ./evaluation-package\n```\n\nRead the generated manifest and result contract. Execute its frozen Cases with your application. Preserve Case, membership and record-version identities; access to a manifest does not grant access to protected materials."},{"blockId":"cli.external-outputs#record-actual-responses","pageId":"cli.external-outputs","title":"Record actual responses","pageTitle":"Submit External Outputs with the CLI","url":"https://teammately.ai/docs/cli/external-outputs.md","humanUrl":"https://teammately.ai/docs/cli/external-outputs#record-actual-responses","markdownUrl":"https://teammately.ai/docs/cli/external-outputs.md","sectionId":"record-actual-responses","kind":"quickstart","productArea":"developer_tools","score":1758.3715527434158,"reasons":["search_match","exact_match","page_title_match","term_match"],"markdown":"## Record actual responses"}]}