---
name: eval-and-trace-designer
description: Design phase-gated evals, parseability checks, citation assertions, and judge-path regression coverage for Care Transitions Command.
compatibility: Codex-compatible skill for evaluation and QA work.
metadata:
  version: "2.0"
  owner: care-transitions-command
---

# Eval and Trace Designer

## Use this skill when
- adding or revising eval prompts
- defining failure and fallback assertions
- checking parseability or citation rules
- protecting hidden-risk and reconciliation behavior from drift

## First read
1. `AGENTS.md`
2. `PLAN.md`
3. `docs/evals.md`
4. `docs/phase0-hidden-risk-prompt-contract.md`
5. `docs/phase0-orchestrator-decision-matrix.md`

## Goal
Keep the two-MCP plus external-A2A system inspectable and testable.

## Required eval lenses
1. Phase 1: `Clinical Intelligence MCP` smoke
2. Phase 2: two-MCP integration
3. Phase 3: external A2A orchestration
4. parseability and citation gates
5. failure and fallback behavior

## Always check
- output is valid JSON without repair
- citations map to real inputs
- duplicate hidden-risk findings are suppressed
- contradictory evidence does not become confident prose
- fallback direct-MCP behavior is documented when the A2A path fails

## Do not
- write evals that assume hidden state
- reward verbosity over inspectability
- ignore null-result behavior for hidden-risk review