Skip to content

docs(design): prose-tests programme design log#544

Open
leeovery wants to merge 1 commit into
mainfrom
design/prose-tests
Open

docs(design): prose-tests programme design log#544
leeovery wants to merge 1 commit into
mainfrom
design/prose-tests

Conversation

@leeovery

Copy link
Copy Markdown
Owner

Summary

  • Design log for the prose-tests programme — the missing test layer: natural-language cases an agent executes by walking the real skills against materialised, engine-built project states.
  • Contract P1–P7: structured NL cases, worlds built by fixture recipes + golden snapshots (never hand-typed, never imagined), deterministic perimeter in CI (rebuild-compare + anchor staleness, zero tokens), walker/grader separation, on-command runs with diff-scoped selection, Sonnet→Opus escalation, happy path as first-class corpus.
  • Stack root — the framework, happy-path corpus (one PR per work type), and rounds-4–6 failure harvest stack on top; the log accrues an entry per landed PR and merges at the end.

Test plan

  • Docs-only; no behaviour to test. CI checks arrive with stage 2.

🤖 Generated with Claude Code

The missing test layer: natural-language cases an agent executes by
walking the real skills against materialised engine-built worlds.
Contract P1-P7 (real worlds, walker/grader separation, on-command
runs, tiered walkers), architecture, and the four-stage build plan
agreed with Lee.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant