{"query":"The Teammately correctness loop","corpusVersion":"local","generatedAt":"2026-09-13T04:33:13.136Z","results":[{"blockId":"product-loop#the-teammately-correctness-loop","pageId":"product-loop","title":"The Teammately correctness loop","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#the-teammately-correctness-loop","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"the-teammately-correctness-loop","kind":"concept","productArea":"introduction","score":2699.499482099673,"reasons":["search_match","title_match","display_title_match","term_match"],"markdown":"# The Teammately correctness loop\n\nThe correctness loop is how a team repeatedly turns domain knowledge into stronger AI behavior. It follows the five public capabilities while preserving a trace from every result back to the project context, expert contribution, case, policy, rubric, benchmark version, Harness version, and evaluation setting that made the result meaningful."},{"blockId":"product-loop#how-product-scope-changes-through-the-loop","pageId":"product-loop","title":"How product scope changes through the loop","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#how-product-scope-changes-through-the-loop","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"how-product-scope-changes-through-the-loop","kind":"concept","productArea":"introduction","score":1349.2490306800216,"reasons":["search_match","page_title_match","term_match"],"markdown":"## How product scope changes through the loop\n\nProject foundations are reusable. Project Context, Reference Materials, policies, rubrics, Coverage Facets, Cases, and Harnesses do not belong to only one benchmark. A benchmark workspace selects and versions the relevant subset, manages coverage, coordinates contributions, evaluates candidates, and records improvement.\n\nThis scope distinction prevents accidental drift. Editing a project-level policy may affect several benchmarks. Changing dataset membership should create a new benchmark evidence boundary. Saving a Harness draft is different from selecting an exact saved Harness version for a Run."},{"blockId":"intro.correctness-lifecycle#the-teammately-correctness-lifecycle","pageId":"intro.correctness-lifecycle","title":"The Teammately correctness lifecycle","pageTitle":"The Teammately correctness lifecycle","url":"https://teammately.ai/docs/introduction/correctness-lifecycle.md","humanUrl":"https://teammately.ai/docs/introduction/correctness-lifecycle#the-teammately-correctness-lifecycle","markdownUrl":"https://teammately.ai/docs/introduction/correctness-lifecycle.md","sectionId":"the-teammately-correctness-lifecycle","kind":"concept","productArea":"introduction","score":1090.1816275566018,"reasons":["search_match","term_match"],"markdown":"# The Teammately correctness lifecycle\n\nThe correctness lifecycle describes how a team turns domain knowledge into an improving specialist AI system. It begins with reusable project foundations, narrows into a benchmark workspace, and cycles through coverage, expert contribution, evaluation, and improvement without losing the evidence that explains each change."},{"blockId":"operating.first-correctness-loop#first-correctness-loop","pageId":"operating.first-correctness-loop","title":"First correctness loop","pageTitle":"First correctness loop","url":"https://teammately.ai/docs/operating-manual/first-correctness-loop.md","humanUrl":"https://teammately.ai/docs/operating-manual/first-correctness-loop#first-correctness-loop","markdownUrl":"https://teammately.ai/docs/operating-manual/first-correctness-loop.md","sectionId":"first-correctness-loop","kind":"task","productArea":"operating_manual","score":1003.8510120949506,"reasons":["search_match","term_match"],"markdown":"# First correctness loop\n\nComplete one narrow loop that another operator can reconstruct. Choose one specialist behavior slice and preserve the path from project knowledge through coverage, expert contribution, governed standards, benchmark evidence, and any candidate change."},{"blockId":"product-loop#before-and-after","pageId":"product-loop","title":"Before and after","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#before-and-after","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"before-and-after","kind":"concept","productArea":"introduction","score":771.6212857598721,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Before and after\n\n| Before | Loop work | After |\n| --- | --- | --- |\n| Domain knowledge is distributed across people and files | Agent Setup and Correctness Elicitation organize it | Project context and governed correctness artifacts are inspectable |\n| Examples are convenient rather than deliberate | Coverage Engineering and Weave shape the challenge set | Dataset representation and missing coverage are explicit |\n| Candidate behavior is discussed from anecdotes | Trialground runs a versioned evaluation | Case-level rubric evidence and comparisons are available |\n| Improvement is a sequence of untracked edits | Coevolve starts from pinned evidence | Candidate branches, receipts, chronology, and current frontier remain connected |\n\n{% example-demo title=\"Changing a retrieval harness\" %}\nAn evaluation shows failures only when current and superseded documents appear together. The team first confirms that the coverage slice and grounding rubric are valid. An Improvement Session pins those cases and the failing Harness version, then tests source-date filtering and citation-selection candidates. A stronger candidate becomes part of the current frontier only after a canonical evaluation produces the expected rubric evidence. If the work uncovers an unseen source-conflict pattern, that observation returns to Coverage Management.\n{% /example-demo %}"},{"blockId":"product-loop#how-expert-effort-compounds","pageId":"product-loop","title":"How expert effort compounds","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#how-expert-effort-compounds","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"how-expert-effort-compounds","kind":"concept","productArea":"introduction","score":770.8584636929892,"reasons":["search_match","page_title_match","term_match"],"markdown":"## How expert effort compounds\n\nThe loop should ask an expert only after agents have prepared the relevant structure and evidence. A Contribution can include selected Cases, source attachments, scoped statements, draft Policies, Rubric questions, or coverage uncertainty. Completed expert work can materialize as an attributable contributed Policy, Rubric, Case, or coverage observation through the owning workflow.\n\nThat same judgment can guide future case construction, determine which rubrics apply during evaluation, and identify missing correctness during improvement. Reuse across the loop is more valuable than maximizing the number of disconnected review actions."},{"blockId":"product-loop#definition","pageId":"product-loop","title":"Definition","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#definition","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"definition","kind":"concept","productArea":"introduction","score":761.7867930089786,"reasons":["search_match","page_title_match","term_match","prefix_or_fuzzy_match"],"markdown":"## Definition\n\n1. **Design coverage.** Establish Dimensions, Project Topics, and Case Construction Patterns, then decide which combinations the benchmark must represent.\n2. **Elicit correctness.** Use focused expert contributions to resolve policies, exceptions, applicability, disagreements, and binary rubric language.\n3. **Construct the challenge set.** Create or import canonical cases, attach required materials, generate difficult variants, and curate benchmark dataset membership.\n4. **Evaluate behavior.** Run an exact saved Harness Version against an exact Benchmark Version and inspect responses, Case-level Rubric evidence, comparisons, and rankings.\n5. **Improve from evidence.** Start an Improvement Session with a bounded Goal Contract, explore candidates, evaluate them through the canonical path, and retain a current frontier.\n6. **Return new learning.** Update coverage, correctness, cases, or the candidate according to what the evidence actually showed."},{"blockId":"product-loop#decision-checkpoint","pageId":"product-loop","title":"Decision checkpoint","pageTitle":"The Teammately correctness loop","url":"https://teammately.ai/docs/product-loop.md","humanUrl":"https://teammately.ai/docs/product-loop#decision-checkpoint","markdownUrl":"https://teammately.ai/docs/product-loop.md","sectionId":"decision-checkpoint","kind":"concept","productArea":"introduction","score":759.7607874908126,"reasons":["search_match","page_title_match","term_match"],"markdown":"## Decision checkpoint\n\n| Evidence says... | Responsible part of the loop | Change first |\n| --- | --- | --- |\n| Important behavior has no cases | Coverage Engineering or Weave | Coverage facet, construction pattern, or case set |\n| Experts cannot apply the standard consistently | Correctness Elicitation | Policy scope, applicability, or rubric wording |\n| A case cannot be interpreted or executed reliably | Weave and Project Input Schema | Input shape, case material, or world boundary |\n| One saved candidate fails applicable rubrics | Trialground | Harness candidate or its runtime configuration |\n| Several candidate branches improve different slices | Coevolve | Goal constraints, next experiment, or retained frontier |\n| Result movement cannot be explained | Benchmark version and evaluation boundary | Versions, settings, mapping, or run metadata before any product change |"}]}