Skip to content

test: parallelize substrate e2e suite - #2661

Merged
EItanya merged 2 commits into
mainfrom
test/parallel-e2e
Sep 2, 2026
Merged

test: parallelize substrate e2e suite#2661
EItanya merged 2 commits into
mainfrom
test/parallel-e2e

Conversation

@EItanya

@EItanya EItanya commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Summary

  • mark all 20 top-level Go E2E tests parallel
  • scale the CI Substrate worker pool from 1 to 4 and run up to 4 tests concurrently
  • use a conservative parallelism of 2 for local E2E runs, where the default install has one worker
  • remove the CLI test environment mutation that prevented parallel execution

Validation

  • E2E package compile: passed
  • 42/42 compatible non-Claude test executions passed across three shuffled, uncached four-worker runs with -parallel 4
  • first run: 14 tests in 65.31s
  • two-run stress: 28 tests in 150.28s
  • shared-agent cases reached about 40s when all four workers were occupied, but did not time out
  • mixed full-suite run exercised concurrent actor lifecycle work; Claude cases were blocked by the reused cluster controller and an existing CRD fixture mismatch
  • git diff --check: passed

Follow-up

This reduces suite wall-clock time but does not remove the individual ~20 second latency. That is caused by the fixed 20 second ActorTemplate reconciliation poll in Substrate v0.0.22 and needs an upstream fix.

@github-actions github-actions Bot added testing Additional testing required and removed testing Additional testing required labels Sep 1, 2026
@github-actions github-actions Bot added testing Additional testing required and removed testing Additional testing required labels Sep 2, 2026
@EItanya
EItanya marked this pull request as ready for review September 2, 2026 10:58
@EItanya
EItanya requested review from a team and Charlesthebird as code owners September 2, 2026 10:58
@EItanya
EItanya marked this pull request as draft September 2, 2026 11:18
@EItanya
EItanya marked this pull request as ready for review September 2, 2026 11:20
@EItanya
EItanya marked this pull request as draft September 2, 2026 11:24
@EItanya
EItanya force-pushed the test/parallel-e2e branch 2 times, most recently from 8e715f4 to 6ab7bf4 Compare September 2, 2026 12:08
Signed-off-by: Eitan Yarmush <eitan.yarmush@solo.io>
@EItanya
EItanya marked this pull request as ready for review September 2, 2026 12:43
@EItanya
EItanya merged commit 78bb8ff into main Sep 2, 2026
24 checks passed
@EItanya
EItanya deleted the test/parallel-e2e branch September 2, 2026 12:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing Additional testing required

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant