Skip to content

fix(test-cli): render coverage on repeated checklist rows - #3586

Merged
danceratopz merged 1 commit into
ethereum:forks/amsterdamfrom
danceratopz:fix-checklist-repeated-rows
Sep 15, 2026
Merged

danceratopz merged 1 commit into
ethereum:forks/amsterdamfrom
danceratopz:fix-checklist-repeated-rows

Conversation

@danceratopz

@danceratopz danceratopz commented Sep 15, 2026

Copy link
Copy Markdown
Member

Description

When a checklist ID appears on multiple template rows, the report currently fills only its last row. The summary can therefore show full coverage while an earlier row remains blank.

Render coverage on every matching row, preserving each description and counting the ID once. Add regression tests for test evidence, external evidence, and N/A declarations.

Discovered while doing the 7981 checklist.

Validation: all 10 checklist tests and just static pass.

Related Issues or PRs

Extracted from #3537. Related to #3217 and #1943.

Checklist

  • Ran fast static checks to avoid CI fails, see Code Standards & Verifying Changes: just static
  • PR title has the form <type>(<area>): <title>, where <type> and <area> come from an appropriate C-<type>, respectively A-<area>, label. The title should match the target squash commit message.

@danceratopz danceratopz added C-bug Category: this is a bug, deviation, or other problem A-test-cli Area: execution_testing.cli labels Sep 15, 2026
@codecov

codecov Bot commented Sep 15, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.44%. Comparing base (1cf1c08) to head (8b3971c).
⚠️ Report is 1 commits behind head on forks/amsterdam.

Additional details and impacted files
@@               Coverage Diff                @@
##           forks/amsterdam    #3586   +/-   ##
================================================
  Coverage            94.44%   94.44%           
================================================
  Files                  624      624           
  Lines                36929    36929           
  Branches              3326     3326           
================================================
  Hits                 34876    34876           
  Misses                1450     1450           
  Partials               603      603           
Flag Coverage Δ
unittests 94.44% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

The template describes invalid and valid data-floor transactions with
the same checklist ID. The item map keeps one entry per ID, and the old
renderer only updated that entry's last line. A report could therefore
show 100% coverage while leaving the first outcome visibly blank.

Render each template row using its ID's shared evidence while preserving
that row's description. Keep summary counts based on unique IDs.
Add a regression for test, external and N/A evidence that fails before
the fix and checks both rows without double-counting the item.

Validation: all 10 checklist consistency and renderer tests and
just static pass on the isolated branch. This changes reporting,
not consensus fixtures.
@danceratopz
danceratopz force-pushed the fix-checklist-repeated-rows branch from aebcd50 to 8b3971c Compare September 15, 2026 09:34
@danceratopz
danceratopz marked this pull request as ready for review September 15, 2026 09:45
@danceratopz
danceratopz merged commit 9eb528c into ethereum:forks/amsterdam Sep 15, 2026
26 checks passed
@danceratopz danceratopz changed the title bug(test-cli): render coverage on repeated checklist rows fix(test-cli): render coverage on repeated checklist rows Sep 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-test-cli Area: execution_testing.cli C-bug Category: this is a bug, deviation, or other problem

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants