Skip to content

feat(framework): add QA and communication evaluations - #512

Open
alexsoyes wants to merge 12 commits into
nextfrom
feat/qa-video-evidence
Open

feat(framework): add QA and communication evaluations#512
alexsoyes wants to merge 12 commits into
nextfrom
feat/qa-video-evidence

Conversation

@alexsoyes

@alexsoyes alexsoyes commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

🎯 What & why

Adds post-review UI QA with reviewer evidence, including optional WebM recordings and PR attachment. Adds a fresh-context evaluation for the project communication contract.

🛠️ How it works

🧪 How to verify

  • pnpm install --frozen-lockfile
  • node scripts/check-markdown-links.js
  • cd cli && pnpm install --frozen-lockfile && pnpm run knip:production && pnpm test

Browser QA evidence

  • aidd_docs/tasks/2026_06/2026_06_24-simplifier-creation-formation/qa/happy-path.webm — vp9, 1280×720, 13,8 s
happy-path.webm

⚠️ Heads-up

QA video runs need an application URL. Chromium downloads on the first Playwright CLI use.

✅ I certify

  • I DO CERTIFY I READ EACH LINE OF THE PULL REQUEST BECAUSE I AM A SOFTWARE ENGINEER, NOT A AI PUPPY.

@alexsoyes
alexsoyes force-pushed the feat/qa-video-evidence branch from f8a1bea to 6eb0b01 Compare July 24, 2026 11:49
Lock executable journeys, minimize discovery, record short WebM evidence, and keep every feature artifact under its task folder.
QA runs can reuse app entry, test auth, fixtures, and reset instructions without introducing another project configuration.
The skill name and plan channels now make browser-only evidence explicit, preventing API, CLI, or system scenarios from entering Playwright runs.
@alexsoyes

Copy link
Copy Markdown
Contributor Author

@blafourcade Holà ! Je sais pas si tu le fais mais j'ai fait une passe de relecture ligne par ligne de 100% des lignes générées pour en enlever... 40% facile.

Dis-moi si ça se voit ?

@alexsoyes
alexsoyes marked this pull request as ready for review July 26, 2026 06:28
@alexsoyes
alexsoyes enabled auto-merge (squash) July 26, 2026 11:24
Pace recorded interactions, preserve the final outcome, and offer direct Happy Path playback for reviewer control.
Run each recorded journey atomically and preserve command failures so invalid takes cannot look successful. Validate cut points and final evidence on frames because metadata alone misses broken recordings.
Comment thread plugins/aidd-dev/skills/11-browser-qa/actions/02-prepare-run.md Outdated
Comment thread plugins/aidd-dev/skills/11-browser-qa/actions/03-run-scenarios.md
Comment thread plugins/aidd-dev/skills/11-browser-qa/actions/03-run-scenarios.md
Comment thread plugins/aidd-dev/skills/11-browser-qa/references/run-scope-playwright-cli.md Outdated

## Invocation

Use the framework pin below. The current version is `0.1.17`.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pourquoi ping une version vs vérifier les capacités de l'outil si tu sais que tu es sur Playwright ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On peut le faire sauter mais avec cette version de playwright je suis sûr que ça fonctionne

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

C'est juste qu'on créé un point d'ancrage à faire évoluer dans le temps plus tard

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

C'est la recommandation NPM / sécu classique...

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Je sais mais je pointe la maintenance dans le temps, peut être mettre un >= ?

Comment thread plugins/aidd-dev/skills/11-browser-qa/SKILL.md
Comment thread plugins/aidd-dev/skills/11-browser-qa/SKILL.md
@blafourcade blafourcade assigned alexsoyes and unassigned blafourcade Jul 27, 2026
@alexsoyes alexsoyes assigned blafourcade and unassigned alexsoyes Jul 28, 2026
@blafourcade blafourcade assigned alexsoyes and unassigned blafourcade Jul 28, 2026
Keep dependency recovery explicit while preserving deterministic Playwright and video evidence.
@alexsoyes
alexsoyes requested a review from a team as a code owner July 31, 2026 07:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants