Understand rubric judgments
Read the applicable criterion and observed behavior before interpreting a pass, failure, or score.
Prerequisites
A Run with recorded responses and available rubric judgments.
Steps
- Open the relevant Case from Results or the Run and read the response or captured trajectory.
- Inspect the Policy, Rubric, applicability, and stated reason for the judgment.
- Check completeness, mandatory requirements, and the Project’s scoring treatment before comparing aggregate results.
- When a judgment needs correction, use the existing judgment-correction workflow and inspect the resulting history and recalculated result.
Object and state changes
A rubric assessment, a human judgment correction, a changed standard, and a new Run retain distinct identities and histories.
Success criteria
The team can explain the judgment from the actual behavior, applicable criterion, and scoring configuration.
Common failure modes
Treating incomplete execution as a scored failure; changing a standard to hide a bad response; reading an aggregate without its applicability.