fix(prose-tests): the asserter is told which substitutions were armed#554
Open
leeovery wants to merge 1 commit into
Open
fix(prose-tests): the asserter is told which substitutions were armed#554leeovery wants to merge 1 commit into
leeovery wants to merge 1 commit into
Conversation
leeovery
force-pushed
the
fix/environment-check-gathers-only
branch
from
July 26, 2026 12:52
f4c27d7 to
42108f0
Compare
leeovery
force-pushed
the
prose-tests/asserter-knows-stubs
branch
from
July 26, 2026 12:53
872d47c to
db46617
Compare
leeovery
force-pushed
the
fix/environment-check-gathers-only
branch
from
July 26, 2026 13:37
42108f0 to
4c916fa
Compare
leeovery
force-pushed
the
prose-tests/asserter-knows-stubs
branch
from
July 26, 2026 13:37
db46617 to
e81714b
Compare
leeovery
force-pushed
the
fix/environment-check-gathers-only
branch
from
July 26, 2026 13:43
4c916fa to
1976e37
Compare
First round with recording live exposed the gap: the action log shows a stub as the walker writing a report an agent would have produced, and an asserter that has never heard of the stub reads that as a missing dispatch. root-cause-validation failed 2/5 on exactly that, having behaved correctly throughout. Armed stubs now reach the asserter with their triggers and descriptions. Also from the same round, as an authoring rule (P4c): a claim about something *displayed* can never be evidenced by the action log, because emitting text is not a tool call — it rests on the walker's narrative, the one piece of evidence it authors itself. Most display claims have a consequence that can be asserted instead: the answer consumed, the arm taken, the state produced. And smoke-boot-in-world is deleted. It absorbed three authoring fixes — a contradictory stop point, claims about post-stop renderings, then a scope anchor fighting its own claims — for a framework smoke test whose job start-lists-active-work already does properly, and passes. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
leeovery
force-pushed
the
prose-tests/asserter-knows-stubs
branch
from
July 26, 2026 13:43
e81714b to
f4cfb5a
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
root-cause-validation-clean-verdictfailed 2/5 on precisely that, having behaved correctly throughout. Armed stubs now reach the asserter with their triggers and descriptions, as a distinct prompt section (P4b).smoke-boot-in-world. It absorbed three authoring fixes in one day — a contradictory stop point, then claims about renderings after that stop, then a scope anchor (#Boot) fighting its own claims — for a framework smoke test whose jobstart-lists-active-workalready does properly and passes 5/5.Test plan
npm testgreen: 1698 tests, 0 fail (one fewer suite entry: the deleted case's snapshot check).root-cause-validation-clean-verdictshould now be judged correctly rather than failing on its own substitution — worth a re-run once this lands.🤖 Generated with Claude Code