{"query":"Dataset Snapshots","corpusVersion":"local","generatedAt":"2026-09-13T04:40:07.042Z","results":[{"blockId":"benchmark-datasets.snapshots#dataset-snapshots","pageId":"benchmark-datasets.snapshots","title":"Dataset Snapshots","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#dataset-snapshots","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"dataset-snapshots","kind":"task","productArea":"benchmark_datasets","score":1151.9911989241584,"reasons":["search_match","title_match","display_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"# Dataset Snapshots"},{"blockId":"benchmark-datasets.overview#benchmark-datasets","pageId":"benchmark-datasets.overview","title":"Benchmark Datasets","pageTitle":"Benchmark Datasets","url":"https://teammately.ai/docs/benchmark-datasets.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets#benchmark-datasets","markdownUrl":"https://teammately.ai/docs/benchmark-datasets.md","sectionId":"benchmark-datasets","kind":"concept","productArea":"benchmark_datasets","score":487.62747216271345,"reasons":["search_match","term_match","prefix_or_fuzzy_match"],"markdown":"# Benchmark Datasets\n\nBenchmark Datasets defines the evidence set for one benchmark through **Cases**, **Representation**, and **Snapshots**.\n\nThe current dataset is editable. It selects reusable project Cases and reflects current facet, policy, rubric, and contributor facts. A Snapshot freezes the exact dataset state needed by a Benchmark Version and its evaluations. These are deliberately different surfaces: editing the current set must not rewrite historical evidence."},{"blockId":"benchmark-datasets.snapshots#create-a-snapshot","pageId":"benchmark-datasets.snapshots","title":"Create a Snapshot","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#create-a-snapshot","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"create-a-snapshot","kind":"task","productArea":"benchmark_datasets","score":432.9208302885664,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Create a Snapshot\n\nThe readiness check reports Case count, approved eligible Policy and Rubric counts, and blockers. Resolve every blocker before creation. Record a meaningful Snapshot label, then verify the displayed version, content hash, creation time, and Case count.\n\nCreation does not make weak input trustworthy. Review Case clarity, coverage, materials, and evaluator applicability first. After creation, do not describe later mutable classifications or links as if they were part of the frozen state."},{"blockId":"benchmark-datasets.snapshots#source-confidence","pageId":"benchmark-datasets.snapshots","title":"Source confidence","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#source-confidence","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"source-confidence","kind":"task","productArea":"benchmark_datasets","score":321.48254439871323,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Source confidence\n\nCode-backed: the active Snapshots route defines readiness, blockers, immutable content, identity fields, and read-only Snapshot inspection."},{"blockId":"benchmark-datasets.snapshots#prerequisites","pageId":"benchmark-datasets.snapshots","title":"Prerequisites","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#prerequisites","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"prerequisites","kind":"task","productArea":"benchmark_datasets","score":318.22895060211937,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Prerequisites\n\n- A reviewed current Case set.\n- Approved eligible evaluator links and no Snapshot readiness blockers.\n- Permission to create benchmark evidence.\n\nA Dataset Snapshot freezes the benchmark's selected Cases, eligible evaluator links, and representation facts at a point in time. The live dataset remains editable; the Snapshot opens read-only **Cases** and **Representation** views."},{"blockId":"benchmark-datasets.snapshots#related-troubleshooting-pages","pageId":"benchmark-datasets.snapshots","title":"Related troubleshooting pages","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#related-troubleshooting-pages","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"related-troubleshooting-pages","kind":"task","productArea":"benchmark_datasets","score":315.84017419789996,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Related troubleshooting pages\n\n{% related-card-grid title=\"Related troubleshooting pages\" %}\n- [Dataset upload](/docs/troubleshooting/dataset-upload)\n- [Benchmark results changed unexpectedly](/docs/troubleshooting/benchmark-results-changed-unexpectedly)\n{% /related-card-grid %}"},{"blockId":"benchmark-datasets.snapshots#object-and-state-changes","pageId":"benchmark-datasets.snapshots","title":"Object and state changes","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#object-and-state-changes","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"object-and-state-changes","kind":"task","productArea":"benchmark_datasets","score":315.79175952281014,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Object and state changes\n\nCreation adds a new immutable Snapshot with its own label, version, hash, time, Case membership, evaluator links, and representation facts. It does not lock or copy edits back into the current dataset."},{"blockId":"benchmark-datasets.snapshots#evidence-rules","pageId":"benchmark-datasets.snapshots","title":"Evidence rules","pageTitle":"Dataset Snapshots","url":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","humanUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots#evidence-rules","markdownUrl":"https://teammately.ai/docs/benchmark-datasets/snapshots.md","sectionId":"evidence-rules","kind":"task","productArea":"benchmark_datasets","score":314.62282759205743,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Evidence rules\n\n- Identify the exact Snapshot or resulting Benchmark Version in every Run and comparison.\n- Create a new Snapshot when Case membership, material content, or admitted evaluator relationships change in a way that affects the claim.\n- Do not mutate a Snapshot to “fix” historical evidence; correct the live dataset and freeze a new one.\n- If historical Representation is unavailable, report that limitation instead of substituting current facts.\n\n{% example-demo title=\"Example: preserving a coverage expansion\" %}\nAfter Case Review adds eight exception-handling Cases, the team verifies approved rubric links and creates a new Snapshot. Runs against the earlier Benchmark Version remain comparable within their old boundary, while new Runs explicitly use the expanded version.\n{% /example-demo %}"}]}