Skip to content

reference

Candidates and Results

Interpret exact candidate Harness Versions, comparable evaluations, constraints, and retained results in a Lemon Goal Session.

Candidates and Results

Definition

A candidate is an identifiable Harness change examined during a Lemon Goal Session. Its source, ancestry, accepted Goal and actual evaluations explain what was attempted and what the result supports.

Fields, states, or lifecycle rules

  • An evaluated candidate identifies an exact saved Harness Version.
  • Results retain the Benchmark Version and measurement population.
  • Starting evaluation and candidate evaluation have different roles.
  • A missing, failed or incomparable evaluation does not establish improvement.
  • Retained candidates remain distinguishable from every explored draft or branch.

Read Results

Open the Session's Results panel to inspect candidate outcomes and comparison context. Its Evaluations view links the recorded executions. Check completeness and criteria before interpreting a lead.

A candidate can improve one target while violating another constraint. Keep that tradeoff visible. A high overall score cannot replace a missing judgment on a protected criterion.

The retained result is not automatically the newest candidate. An unsuccessful direction can still explain why the agent tried another change, while an incomparable result cannot justify a numerical improvement claim.

Read Evolution

Evolution connects progress and execution history. Strategies describe the approaches used in the Session. The chart remains available after work ends; Session completion does not erase the sequence that produced the result.

Use Harnesses to inspect the actual candidate artifacts rather than inferring code changes from narration. Saving or evaluating a candidate is distinct from deciding to use it in a future benchmark execution.

Population and history

Compare against the same Benchmark Version and recorded conditions. Ordinary candidate scores use the reference Run selected before outcomes were known. Extra independent Runs retain their own history instead of silently contributing only their best Trials.

A focused observation can guide exploration without replacing the complete comparison required by the Goal. Read the reported conclusion and its measurements before deciding how to use the resulting candidate.

Found something unclear?

Report outdated, unsupported, or confusing docs so we can fix the source page.

Report a docs issue