# Evaluation Plan

Toolkit schema: `PAISEH-TK-1.0`
Source artifact: Chapter 8 **Evaluation Plan**

Complete `../common-artifact-header.md` first. Bind claims and risks to evidence for one exact candidate, population, and decision.

## 1. Decision Charter

- Candidate and immutable component identities:
- Intended population, environment, and consequence:
- Decision: ship / hold / narrow / reject / defer
- Product, quality, safety, execution, cost, and latency claims:
- Known risks and prohibited outcomes:
- Evidence owner and decision authority:
- Deadline, validity, and change triggers:

## 2. Coverage Matrix

| Claim/risk | Scenario/slice | Source | Expected behavior | Severity | Measure/rubric | Minimum evidence | Gap owner |
| --- | --- | --- | --- | --- | --- | --- | --- |
| | | | | | | | |

## 3. Evaluation Assets

| Asset ID/version | Provenance/permissions | Population/coverage | Freshness | Leakage controls | Adjudication | Known gaps |
| --- | --- | --- | --- | --- | --- | --- |
| | | | | | | |

## 4. Evaluators and Human Review

- Automated or model-based evaluator identity, validity, and calibration:
- Human rubric and decision criteria:
- Reviewer qualification and training:
- Independence and blinding:
- Disagreement, adjudication, fatigue, and capacity protocol:

## 5. Comparison and Online Evidence

- Baseline and candidate:
- Controlled differences:
- Practical and statistical uncertainty:
- Improvement or non-inferiority rule:
- Online sampling frame, denominator, slices, and delayed outcomes:
- Evidence-health dependency and missing-data state:
- Change attribution limits:

## 6. Results and Disposition

| Claim/risk | Population/slice | Result/uncertainty | Failure examples | Limitation or unsupported inference | Decision supported | Owner |
| --- | --- | --- | --- | --- | --- | --- |
| | | | | | | |

- Disposition and rationale:
- Launch or hold thresholds:
- Conditions, residual risks, and acceptors:
- Regression cadence and evidence to rerun:
- Expiry, invalidation, and reopening events: