Implement automated eval test suite for Angular Skills - #17007

Closed

zdrawku with Copilot wants to merge 23 commits into

copilot/implement-automated-eval-test-suite

Commits on Mar 8, 2026

Commits on Mar 9, 2026

Merge branch 'master' into copilot/implement-automated-eval-test-suite
kdinev
authored
c183089
fix: replace skill-eval package dep with self-contained local runner

Copilot
and
kdinev
committed
6e7b838

Commits on Mar 10, 2026

fix: emit passRate/passAtK in result JSON so CI summary shows actual scores

Copilot
and
kdinev
committed
b2047d8
Update evals/tasks/component-combo-reactive-form/solution/solve.sh

kdinev
and
Copilot
authored
1691296
Update .github/workflows/skill-eval.yml

kdinev
and
Copilot
authored
2df335e
fix: tighten grader checks per review feedback

Copilot
and
kdinev
committed
b22b13f
Merge branch 'master' into copilot/implement-automated-eval-test-suite
kdinev
authored
c684351
Update Node.js version in skill-eval workflow
kdinev
authored
94d4bf8
Update skill-eval.yml
kdinev
authored
18f3e25
Remove eval dependencies installation step
kdinev
authored
568b04d
Merge branch 'master' into copilot/implement-automated-eval-test-suite
kdinev
authored
5da6711
feat: add copilot-cli and gemini-cli agent modes to eval runner

Copilot
and
kdinev
committed
b181ca0
fix: use read -ra for safe array parsing, add TRIALS guard

Copilot
and
kdinev
committed
665264b
Update skill-eval.yml
kdinev
authored
b3fa973
rework CI workflow to always run against both copilot and gemini agents

Copilot
and
kdinev
committed
1330989
add agent prompt files, switch CI to npm scripts, clean up README

Copilot
and
kdinev
committed
a9da524

Commits on Mar 11, 2026

Commits on Mar 24, 2026

Merge branch 'master' into copilot/implement-automated-eval-test-suite
kdinev
authored
59bcc87