fix(test-consume): skip Besu evmtool's non-JSON summary line in state-test output - #3610
Merged
danceratopz merged 1 commit intoSep 17, 2026
Conversation
… output Besu 26.8.x appends "State test summary: N passed, M failed" after the NDJSON results. The parser treated it as a JSON line and raised JSONDecodeError, so every consume direct run against a current Besu reported harness failures for fixtures Besu itself had passed. Skip lines that do not start with a JSON object.
CPerezz
added
C-bug
2 tasks done
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## forks/amsterdam #3610 +/- ##
================================================
Coverage 94.44% 94.44%
================================================
Files 624 624
Lines 36928 36928
Branches 3326 3326
================================================
Hits 34875 34875
Misses 1450 1450
Partials 603 603
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
danceratopz
approved these changes
Sep 17, 2026
danceratopz
changed the title
danceratopz
added
the
A-test-consume
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Besu 26.8.x appends
State test summary: N passed, M failedafter the NDJSON results ofevmtool state-test.besu.pytreated it as a JSON line and raisedJSONDecodeError, so everyconsume direct --bin=evmtoolrun against a current Besu reported a harness failure for fixtures Besu itself had passed.Skip any output line that does not start with a JSON object.
Verified:
uv run consume direct --bin=evmtool -m state_testagainst Besu 26.8.1 (JDK 25) over the fixtures of #3600 went from 100%JSONDecodeErrorto 23/23 passed.Related Issues or PRs
Found while verifying #3600.
Checklist
<type>(<area>): <title>Cute Animal Picture