Skip to content

Chore/bump ethrex rev - #894

Draft
jotabulacios wants to merge 6 commits into
mainfrom
chore/bump-ethrex-rev
Draft

Chore/bump ethrex rev#894
jotabulacios wants to merge 6 commits into
mainfrom
chore/bump-ethrex-rev

Conversation

@jotabulacios

Copy link
Copy Markdown
Collaborator

No description provided.

The rkyv layout moved with the ethrex rev, so the block's fixture did too, and
the release now carries both: the pre-bump bytes under the original name and the
post-bump ones under a name carrying the rev.

Uploading under a new name rather than replacing the asset keeps `main` working
while this branch is open — its Makefile still pins the pre-bump sha256, and a
replaced asset would fail that checksum on every push, taking the published
benchmark baseline with it.
@jotabulacios

Copy link
Copy Markdown
Collaborator Author

/bench

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown

Benchmark — real block (ethrex_mainnet_25368371.bin) (median of 3)

continuations · epoch 2^22 · 11 epochs

Metric main PR Δ
Peak heap 52356 MB 52530 MB +174 MB (+0.3%) ⚪
Prove time 156.434s 138.468s -17.966s (-11.5%) 🟢

🎉 Improvement on the real block — prove time down 11.5%.

Prove-time spread 0.7% (138.468s / 139.411s / 138.462s)

Commit: 1e53cd3 · Baseline: cached · Runner: self-hosted bench

@jotabulacios

Copy link
Copy Markdown
Collaborator Author

/bench-gpu

@github-actions

github-actions Bot commented Aug 4, 2026

Copy link
Copy Markdown

GPU Benchmark (ABBA) — a9ec7ce1ee vs main (14 pairs)

RTX 5090 · AMD Ryzen 9 9950X 16-Core Processor (32 threads) · Vast.ai datacenter @ $0.6275925925925925/hr · prover/cuda · ethrex real block, continuations · drift-free A/B/B/A

=== ABBA paired result  (improvement: - = PR faster) ===
  pairs: 14   mean A (PR): 69.187s   mean B (base): 69.096s

  [parametric] paired-t   mean +0.13%   sd 0.84%   se 0.23%
               95% CI: [-0.35%, +0.62%]   (t df=13 = 2.16)
  [robust]     median +0.26%   Wilcoxon W+=62 W-=43  p(exact)=0.5830  (z=+0.56)

  --- server stability (this run; compare across servers) ---
  run-to-run jitter:    A CV 0.70%   B CV 0.61%        (lower = steadier)
  within-session drift: +0.67% over the run, 1st->2nd half +0.10%
    (jitter -> Tier-1 cached gate floor; drift -> whether the cached baseline can be trusted)

  VERDICT: INCONCLUSIVE - effect not separable from 0 at n=14.
           Point estimate ~+0.26% (median). Need more pairs to resolve.

  raw pairs: /tmp/abba_run/pairs.csv

- = PR faster. Trust the verdict when paired-t and Wilcoxon agree.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant