diff --git a/codex/skills/maintain-verification-skill/SKILL.md b/codex/skills/maintain-verification-skill/SKILL.md new file mode 100644 index 0000000..bfa5b09 --- /dev/null +++ b/codex/skills/maintain-verification-skill/SKILL.md @@ -0,0 +1,40 @@ +--- +name: maintain-verification-skill +description: "Audit a project's verification skill and feature map against source and live behavior. Use for periodic maintenance or when asked to audit a verify skill." +--- + +# Maintain a verification skill + +A feature map rots the moment the app changes. This skill is the upkeep loop for a skill generated by `$create-verification-skill` (or any project-local verification skill with a feature map). The unit of rigor is the feature, not every sentence: cover every feature file from source and exercise every feature live, without terminalising every bullet. + +## Outcomes + +Pick one, and say which: + +- **clean**: every feature got source and live coverage; nothing worth shipping. No branch, no PR. +- **changed**: one PR ships proven doc, harness, or map corrections. +- **blocked**: coverage could not finish or a proven fix could not ship safely. Say exactly what blocked it. + +## Edit scope + +Only edit the verification skill's own directory (its SKILL.md, features/, and any harness scripts it owns). Never edit product code during a run: a behavior the map describes that the app no longer does is either doc drift (fix the map) or a product regression (report it, don't paper over it in docs). + +## Pass + +0. **Locate the target.** Find the verification skill to maintain: the project-local skill whose body has launch/drive sections and a feature map (usually `.agents/skills/verify-*/`). Several candidates means ask which one. If there are none, stop and point at `$create-verification-skill` instead of inventing a target. + +1. **Index hygiene.** Read the feature map README and glob its sibling files. Fix missing, extra, duplicate, or dead entries. Lightweight; no generated inventory. + +2. **Source wave.** One read-only subagent per feature file, launched concurrently. Each explains "how does this user-facing feature work?" from source, flags likely doc drift with citations, and returns one concise live-verification recipe. Children never drive the app and never edit files. Return shape: feature summary / source entry points / likely drift or none / one recipe. + +3. **Reconcile.** Every feature file has a returned summary. Merge overlapping recipes into as few app states as practical. Spot-check cited drift; don't re-prove clean claims. Sweep recent churn for user-facing surfaces missing from the map. Require a concrete source path before calling one missing. + +4. **Live pass.** Required even when source looks clean. The coordinator owns all driving; follow the verification skill's own launch model: one long-lived instance driven serially for servers and UIs, or a fresh isolated session per drive for short-lived CLIs (the skill's Launch section decides, not this one). Exercise every feature at least once, and hold three invariants the whole pass, whatever the failure: (1) never drive an instance you haven't health-checked since it last did something surprising. Doctor before first drive, doctor on each fresh session where sessions are the unit, doctor again after any failed drive, and where doctor can't see the failure (a wedged UI state on a healthy process), reset to a known state or relaunch rather than hoping; (2) evidence captured so far survives every cleanup, checked at its named location, not assumed; (3) nothing a drive started outlives that drive's usefulness. Failed-iteration residue is cleaned whether the session is stuck, exited, or shared (for a shared instance, clean the residue, not the instance). A doctor failure caused by skill drift is drift: fix it under edit scope and retry once. Restart whatever the fix invalidated, nothing more, before calling the pass `blocked`. A feature that can't be reached is `verified-unreachable` only with the concrete prerequisite (auth, entitlement, OS, external state) and the route attempted; if the map omits that prerequisite, that's drift. Any harness fix from triage gets re-driven live before it ships. Final teardown happens after the last drive of the run, including those re-proofs, so nothing outlives the run (evidence stays, per the skill). + +5. **Triage.** Wrong or missing user-POV description is doc drift; fix it. Working behavior the harness cannot drive is a harness gap; fix it; a harness fix follows the same helpers rule as generation (scripts executable, invocation documented in the skill body). App behavior that is actually broken is a product gap; record it for the user, keep it out of this PR. + +6. **Ship or stop.** For changed: one PR of proven corrections, re-read every changed file first. For clean or blocked: no PR, report the outcome and the coverage honestly. + +Keep concise run notes (features covered, unreachable prerequisites, confirmed drift, outcome) in a scratch location; don't commit them. + +Source provenance lives in [references/sources.md](references/sources.md). Do not load it during normal use. diff --git a/codex/skills/maintain-verification-skill/agents/openai.yaml b/codex/skills/maintain-verification-skill/agents/openai.yaml new file mode 100644 index 0000000..bb86822 --- /dev/null +++ b/codex/skills/maintain-verification-skill/agents/openai.yaml @@ -0,0 +1,5 @@ +interface: + display_name: "Maintain Verification Skill" + short_description: "Keep verification docs and harnesses honest" +policy: + allow_implicit_invocation: false diff --git a/codex/skills/maintain-verification-skill/references/sources.md b/codex/skills/maintain-verification-skill/references/sources.md new file mode 100644 index 0000000..3f8564a --- /dev/null +++ b/codex/skills/maintain-verification-skill/references/sources.md @@ -0,0 +1,35 @@ +# Sources + +Read this provenance when auditing or revising Maintain Verification Skill, not during normal use. + +The skill is substantially derived from Lauren Tan's pstack `maintain-verification-skill`: + +- Source: https://github.com/cursor/plugins/blob/46125561306434d8a1d7745d540d8932ab0cd2a2/pstack/skills/maintain-verification-skill/SKILL.md +- Repository license: MIT +- Upstream copyright: Copyright (c) 2026 Lauren Tan + +Compass keeps the upstream clean/changed/blocked outcomes, verification-directory-only edit scope, parallel source wave, required live pass over every feature, doctor/evidence/cleanup invariants, and separation of doc drift, harness gaps, and product regressions. Platform translation changes the project-local skill root from `.cursor/skills` to `.agents/skills` and uses `agents/openai.yaml` for explicit invocation. + +## Upstream license + +MIT License + +Copyright (c) 2026 Lauren Tan + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in all +copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE +SOFTWARE. \ No newline at end of file diff --git a/manifests/portable-files.json b/manifests/portable-files.json index c14e298..503428b 100644 --- a/manifests/portable-files.json +++ b/manifests/portable-files.json @@ -19,6 +19,7 @@ "grilling", "ground-in-sources", "handoff", + "maintain-verification-skill", "micro-experiment", "monitor", "no-comments",