Skip to content

OKF: the stall can mask a real failure; a local visual red needs a master run - #515

Merged
pftg merged 1 commit into
masterfrom
chore-okf-session-wrap
Aug 20, 2026
Merged

OKF: the stall can mask a real failure; a local visual red needs a master run#515
pftg merged 1 commit into
masterfrom
chore-okf-session-wrap

Conversation

@pftg

@pftg pftg commented Aug 20, 2026

Copy link
Copy Markdown
Member

Session wrap-up. Two gate rules sharpened after a six-PR merge pass, both added to existing concepts rather than as new ones.

ci-gates — the stall can hide a real failure behind it

The concept already said re-run, don't raise the cap and if the job got past checkout it's a real failure. Necessary, not sufficient.

On #511 Unit Tests read fail 10m2s — the stall signature exactly — and "known flake, merge it" was the tempting call. The fresh run got past checkout and failed again in 1m48s on a genuine defect: PavedPathGuardTest caught friday-report.css wired into bin/qtest but missing from css-bundle-ownership-map.md. Same check, same PR, two unrelated causes.

Rule added: a slow failure and a fast failure are different failures. Multi-minute with no assertion output is infrastructure; fast with an assertion is the code. The first red's explanation must never carry over to the second.

test-gates — a local visual red can't condemn a branch until master runs the same way

Verifying #511, bin/qtest --changed went red pointing at services/fractional-cto — a page the PR never touched. The available story was that its postcss.config.js edit had shifted CSS site-wide. It hadn't: that edit only adds purgecss safelist entries, and safelisting more can only preserve more CSS, never remove any.

The check that settled it: the same system test on clean origin/master on this macOS host — 34 runs, 6 failures, 8 of 77 screenshots mismatched. The suite is red on master here, so the local leg couldn't answer the question. CI's native-Linux Screenshot Tests passed #511 in 16m15s and was right.

Also noted: the run rewrites two of those baselines mid-run then fails its own dirty-check, so git checkout -- test/fixtures/screenshots/ never converges.

Validation

okf_validate --strict conformant, 0 errors (the 70 warnings are the pre-existing house log-heading convention, unrelated to these edits). bin/hugo-build green. Docs-only.

🤖 Generated with Claude Code

…ster run

Two gate rules sharpened after a six-PR merge pass. Both are increments on
rules the bundle already had, added to the existing concepts rather than as
new ones.

ci-gates already said "re-run, don't raise the cap" and "if the job got past
checkout it is a real failure". Necessary, not sufficient. On #511 `Unit Tests`
read `fail 10m2s` - the stall signature exactly - and "known flake, merge it"
was the tempting call. The fresh run got past checkout and failed again in
1m48s on a genuine defect: PavedPathGuardTest caught friday-report.css wired
into bin/qtest but missing from css-bundle-ownership-map.md. Same check, same
PR, two unrelated causes. Rule: a slow failure and a fast failure are different
failures, and the first red's explanation must never carry over to the second.

test-gates gains the local-vs-master rule. Verifying #511, `bin/qtest --changed`
went red pointing at services/fractional-cto - a page it never touched - and the
available story was that its postcss.config.js edit had shifted CSS site-wide.
It had not: that edit only ADDS purgecss safelist entries, and safelisting more
can only preserve more CSS, never remove any. The check that settled it was the
same system test on clean origin/master on this macOS host: 34 runs, 6 failures,
8 of 77 screenshots mismatched. The suite is red on master here, so the local leg
could not answer the question; CI's native-Linux Screenshot Tests passed #511 in
16m15s and was right.

Validated: okf_validate --strict conformant, 0 errors (the 70 warnings are the
pre-existing house log-heading convention). bin/hugo-build green.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 5cf9fef5-226e-4d4a-bfc3-bbf65ad1120d


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@pftg
pftg merged commit 67bdd78 into master Aug 20, 2026
3 checks passed
@pftg
pftg deleted the chore-okf-session-wrap branch August 20, 2026 21:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant