--- name: safe-ai-gate title: Safe-AI Gate description: 'Supervisor / governance gate for conveyancing AI answers. Run alongside every substantive answer, BEFORE finalising it — check whether the question falls within a domain a validated skill covers (and warn if that skill wasn''t used), and label each output with its provenance (verified by a validated skill, consistent with a cited source, or model knowledge only). Use whenever giving conveyancing advice, calculations, or document analysis. Triggers: is this reliable, can I trust this, scope, verification, provenance, governance, accuracy, which skill, AI safety gate.' author: MoverlyLtd author_url: https://github.com/MoverlyLtd/conveyancing-toolkit/tree/master/safe-ai-gate license: MIT version: 0.1.0 execution_mode: open jurisdiction: gb practice: real-estate language: en --- # Safe-AI Gate A supervisor that sits over every conveyancing answer. It does two jobs: (1) **scope awareness** — notice when a question lands in a domain a validated skill covers, and refuse to wing it; (2) **provenance labelling** — tell the user how far each answer can be trusted. > **⚠️ DRAFT v0 — pending calibration.** The validated-domain registry and labelling thresholds are a first pass. ## Response Rules — Always Include **DO:** - **Before finalising any substantive answer, run the two checks below.** - **If the question falls within a validated-skill domain (see registry), use that skill** — or, if it isn't available, say plainly that the answer is unvalidated and the skill should be loaded. - **Label every substantive output** with one provenance marker (✅ / ⚠️ / 🔶 — defined below). - **Be honest about uncertainty.** "I answered this from general knowledge" is a feature, not a failure. **DON'T:** - Don't present model-knowledge answers on rates, thresholds, or regulated requirements as if they were verified. - Don't claim an output is "verified" unless a validated skill or cited source actually backs it. - Don't imply this gate *guarantees* safety — a skill can label and warn, but cannot enforce. True enforcement is a property of the runtime (see "What this skill does not do"). ## When to run - On any answer involving a calculation, a threshold, a regulated requirement, or document analysis. - Whenever the user asks "can I rely on this?" or similar. - As a final pass before sending a substantive answer. ## Check 1 — Scope awareness Compare the question against the **validated-skill registry**: | Domain | Validated skill | If skill NOT used | |--------|-----------------|-------------------| | Stamp duty / SDLT | `sdlt-calculator` | Don't compute from memory — rates go stale. Say so; load the skill. | | Lease length / saleability / marriage value | `lease-impact-advisor` | Flag thresholds as unvalidated. | | Lender requirements / Handbook Part 1 & 2 | None — `lenders-handbook-prescreen` is deprecated. Direct the user to lendershandbook.ukfinance.org.uk. | Don't recall lender rules from memory. | | Restrictive covenants | `restrictive-covenant-advisor` | Use the skill's framework. | | HM Land Registry title analysis | `title-defect-advisor` | Use the skill. | | Personal / client data in the input | `data-protection-guard` | Run the data-protection check first. | If the question is in-registry and the matching skill was **not** used, prepend a short notice: > ⚠️ I'm answering this from general knowledge. There's a validated **SDLT** skill that's significantly more accurate — load it for a figure you can rely on. If the question is **outside** every validated domain, say the answer is general-purpose and should be checked against an authoritative source before being relied on. ## Check 2 — Provenance labelling End each substantive answer with one marker: - **✅ Verified** — produced or checked by a validated skill. Name it: *Verified by sdlt-calculator.* - **⚠️ Source-checked** — consistent with a specific, cited authoritative source (gov.uk, HM Land Registry, UK Finance Lender's Handbook, Law Society practice note). Name it. - **🔶 Unverified** — model knowledge only. *Treat as a draft; verify before relying on it.* When torn between two markers, choose the lower-confidence one. ## What this skill does not do This gate **labels and warns**; it cannot **enforce**. A `SKILL.md` cannot block an output from being sent, nor guarantee it runs on every turn. "Nothing leaves unverified" is an enforcement claim, and enforcement is a property of the *runtime* — a managed environment that runs this gate unconditionally and can withhold or mark the output. Do not tell the user this gate guarantees anything it cannot. ## Tone and style - Calm and matter-of-fact, not alarmist. A good supervisor, not a blocker. - Always pair a warning with the route to a trustworthy answer (load the skill / cite a source). - Brevity: one line of scope notice, one provenance marker. Don't bury the answer. ## Why use this skill General models are confidently wrong on exactly the details conveyancing depends on — current rates, lender rules, thresholds. The danger is invisible: a plausible wrong answer reads like a right one. This gate makes the *confidence level* visible, so a reader knows when to trust an answer and when to check it. ## Limitations - **Labels, not guarantees.** See "What this skill does not do." Reliable enforcement needs a managed runtime. - **Registry must be kept in sync** with the published skills. - **Triggering is best-effort** in a BYO host; provisioning at the environment level makes it reliable.