Construct controlled variations
Vary the condition under investigation while preserving enough shared context to interpret the difference.
Prerequisites
A defined coverage objective, Project Input Schema, and suitable source Cases or synthesis context.
Steps
- Identify the Dimension, Topic, or Scenario distinction the variation should exercise.
- Specify which facts should change and which context must remain fixed. For input variations, follow Synthesize Cases with Lemon Weave: use Canvas → Shots and supply the distinction in Additional instructions. For response alternatives, attach Comparison Directions when preparing the Expert Contribution.
- Inspect each prepared candidate for realism, input validity, and the intended difference.
- Review prepared input candidates in the Canvas preview and confirm selected membership separately. Keep response alternatives attached to their Contribution; comparison alone does not make them canonical Cases or add them to the Benchmark.
Object and state changes
Generated candidates, expert review alternatives, canonical Cases, and dataset membership remain separate records and decisions.
Success criteria
A reviewer can attribute a different expected judgment to the intended condition rather than an accidental change in the input.
Common failure modes
Changing several unrelated conditions at once; accepting a fluent variation that breaks the task’s source assumptions.