{"query":"Coverage Gaps","corpusVersion":"local","generatedAt":"2026-09-13T04:31:57.136Z","results":[{"blockId":"coverage.coverage-gaps#coverage-gaps","pageId":"coverage.coverage-gaps","title":"Coverage Gaps","pageTitle":"Coverage Gaps","url":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","humanUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps#coverage-gaps","markdownUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","sectionId":"coverage-gaps","kind":"task","productArea":"coverage_engineering","score":975.0347296657847,"reasons":["search_match","title_match","display_title_match","term_match"],"markdown":"# Coverage Gaps"},{"blockId":"coverage.coverage-gaps#task-steps-coverage-gaps","pageId":"coverage.coverage-gaps","title":"Task steps: Coverage Gaps","pageTitle":"Coverage Gaps","url":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","humanUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps#task-steps-coverage-gaps","markdownUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","sectionId":"task-steps-coverage-gaps","kind":"task","productArea":"coverage_engineering","score":871.1720687102801,"reasons":["search_match","title_match","display_title_match","page_title_match","term_match"],"markdown":"### Task steps: Coverage Gaps\n\n1. Name the behavior area that may be missing: dimension, ontology value, product flow, policy exception, source condition, or boundary scenario.\n2. Inspect **Benchmark Datasets → Representation** and the current Benchmark Version. Check whether the area is absent, represented by too few selected Cases, or represented only by easy examples.\n3. Compare the suspected gap against evaluation failures, failure clusters, Expert Contribution notes, and recent product signals.\n4. Rule out look-alike problems: missing outputs, stale cases, weak applicability logic, overly broad policies, ambiguous rubrics, or output mapping errors.\n5. Route the gap: update Coverage Facets, create a Coverage Story, source or synthesize Cases, request an Expert Contribution, or select already reviewed Cases in Benchmark Datasets.\n6. Review candidates in Case Review, create a new Snapshot when membership changes, and preserve the gap rationale in the owning coverage surfaces.\n\n![Case Pool table with selected cases and an action bar for adding cases to a benchmark.](/docs-assets/assets/screenshots/case-pool-selected-action-bar.png)\n\nWhen a gap points to specific candidates, the operator can select cases and prepare them for benchmark membership."},{"blockId":"playbooks.coverage-gaps-before-review#finding-coverage-gaps-before-review","pageId":"playbooks.coverage-gaps-before-review","title":"Finding Coverage Gaps Before Review","pageTitle":"Finding Coverage Gaps Before Review","url":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review.md","humanUrl":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review#finding-coverage-gaps-before-review","markdownUrl":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review.md","sectionId":"finding-coverage-gaps-before-review","kind":"recipe","productArea":"playbooks","score":782.8191950117287,"reasons":["search_match","title_match","display_title_match","term_match"],"markdown":"# Finding Coverage Gaps Before Review\n\nUse this playbook when benchmark evidence looks plausible overall but the team needs to know whether important behavior slices are missing or underrepresented."},{"blockId":"playbooks.coverage-gaps-before-review#coverage-audit","pageId":"playbooks.coverage-gaps-before-review","title":"Coverage audit","pageTitle":"Finding Coverage Gaps Before Review","url":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review.md","humanUrl":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review#coverage-audit","markdownUrl":"https://teammately.ai/docs/playbooks/finding-coverage-gaps-before-review.md","sectionId":"coverage-audit","kind":"recipe","productArea":"playbooks","score":510.52957868126435,"reasons":["search_match","page_title_match","term_match"],"markdown":"## Coverage audit\n\n1. Confirm the exact Benchmark Version and Run completeness before interpreting its distribution.\n2. Open **Benchmark Datasets → Representation** and inspect the selected Dataset across the configured Coverage Facets.\n3. Compare thin or empty slices with Coverage Stories, failed Cases, specialist observations, and must-level Rubrics with few applicable Cases.\n4. Classify each issue: missing vocabulary, missing Case, unreviewed candidate, missing Dataset membership, or unclear correctness standard.\n5. Route vocabulary changes to Coverage Facets, unclear standards to Expert Contributions, and missing Cases to Assets Synthesis or Case Foundry.\n6. Review candidates in **Case Review**, select the intended Cases in **Benchmark Datasets**, and create a new Snapshot.\n7. Run the relevant saved Harness Versions against the new Benchmark Version and state any still-unrepresented risk in the customer's review context."},{"blockId":"coverage.plan-benchmark-coverage#plan-benchmark-coverage","pageId":"coverage.plan-benchmark-coverage","title":"Plan Benchmark Coverage","pageTitle":"Plan Benchmark Coverage","url":"https://teammately.ai/docs/coverage-engineering/plan-benchmark-coverage.md","humanUrl":"https://teammately.ai/docs/coverage-engineering/plan-benchmark-coverage#plan-benchmark-coverage","markdownUrl":"https://teammately.ai/docs/coverage-engineering/plan-benchmark-coverage.md","sectionId":"plan-benchmark-coverage","kind":"task","productArea":"coverage_engineering","score":418.7170521765729,"reasons":["search_match","term_match"],"markdown":"# Plan Benchmark Coverage\n\nPlan coverage by applying reusable project facets to one benchmark and comparing the intended behavior space with the selected dataset representation."},{"blockId":"coverage-management.overview#coverage-and-correctness","pageId":"coverage-management.overview","title":"Coverage and correctness","pageTitle":"Coverage Management","url":"https://teammately.ai/docs/coverage-management.md","humanUrl":"https://teammately.ai/docs/coverage-management#coverage-and-correctness","markdownUrl":"https://teammately.ai/docs/coverage-management.md","sectionId":"coverage-and-correctness","kind":"concept","productArea":"coverage_management","score":394.86656019585985,"reasons":["search_match","term_match"],"markdown":"## Coverage and correctness\n\nCoverage gaps sometimes reveal missing correctness rather than missing cases. If experts cannot say how a represented situation should be judged, request an Expert Contribution and update policies or rubrics. If the standard is clear but no case exercises it, use Weave and Case Foundry. If cases exist but are not selected or snapshotted, use Benchmark Datasets.\n\nThis routing prevents Comparison Directions, Contribution-scoped agent behavior, and coverage structure from being mixed together. Comparison Directions guide response variation; Coverage Facets and Coverage Stories describe the benchmark behavior space.\n\n{% example-demo title=\"Conflicting-source story\" %}\nRepresentation shows that the benchmark covers current-source questions but almost never combines them with a plausible superseded document. A Coverage Story names the conflict pattern, relevant source-freshness and impact facets, and the desired case count. Case Foundry prepares candidates, Case Review rejects unrealistic material, and the accepted cases enter a new dataset snapshot.\n{% /example-demo %}"},{"blockId":"coverage.coverage-gaps#required-role-or-permission","pageId":"coverage.coverage-gaps","title":"Required role or permission","pageTitle":"Coverage Gaps","url":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","humanUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps#required-role-or-permission","markdownUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","sectionId":"required-role-or-permission","kind":"task","productArea":"coverage_engineering","score":380.88420084855477,"reasons":["search_match","page_title_match","term_match"],"markdown":"## Required role or permission\n\nAI engineers, evaluation owners, and product owners usually identify coverage gaps together. Experts may be needed when the missing behavior depends on domain judgment. If the UI blocks investigation or case changes, inspect project membership and artifact access before changing the benchmark."},{"blockId":"coverage.coverage-gaps#when-to-use-it","pageId":"coverage.coverage-gaps","title":"When to use it","pageTitle":"Coverage Gaps","url":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","humanUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps#when-to-use-it","markdownUrl":"https://teammately.ai/docs/coverage-engineering/coverage-gaps.md","sectionId":"when-to-use-it","kind":"task","productArea":"coverage_engineering","score":371.7020233969967,"reasons":["search_match","page_title_match","term_match"],"markdown":"## When to use it\n\nUse this task when the team suspects that a benchmark result is incomplete because the case set does not represent an important behavior area. A coverage gap is not just a low score. It is a missing or thin slice of the behavior space: a dimension value, ontology category, source condition, user intent, boundary scenario, policy exception, failure cluster, or product flow that should be represented before results are trusted.\n\nCoverage gaps matter because Teammately helps the team reason about whether the benchmark actually represents the correctness space, instead of only running checks over available examples."}]}