Review agent trajectories
Assess the actions an agent took when its final answer cannot establish whether the work was acceptable.
Prerequisites
The review activity includes an actual recorded trajectory and the applicable task context.
Steps
- Read the task and identify the behavior the expert is being asked to judge.
- Inspect recorded tool use, observations, actions, and supplied reasoning summaries. Distinguish absent records from recorded non-action.
- Explain which observed step met or violated the requirement and what condition made it consequential.
- Review any resulting criterion against what the recording can actually establish.
Object and state changes
Your review stays attached to the recorded behavior and Contribution. It does not reconstruct unrecorded private reasoning or certify actions outside the captured scope.
Success criteria
The judgment identifies the relevant recorded action and a requirement the team can apply to comparable behavior.
Common failure modes
Inferring a correct process from a correct final answer; assuming a missing event proves an action never occurred.