Skip to content

ci: time-bound the job and the memcheck step, and retry apt fetches - #817

Merged
kacy merged 1 commit into
mainfrom
ci-timeout-hardening
Aug 19, 2026
Merged

ci: time-bound the job and the memcheck step, and retry apt fetches#817
kacy merged 1 commit into
mainfrom
ci-timeout-hardening

Conversation

@kacy

@kacy kacy commented Aug 19, 2026

Copy link
Copy Markdown
Owner

Twice today a main run wedged with zero output inside the memcheck step — the run for #811 sat four hours, the run for #815 twenty minutes before being cancelled. Both logs show the same signature: the step header prints, then nothing at all — not one line from apt-get update, not the memcheck banner. The wedge is the step's apt preamble stalling on a mirror, before any of our code runs; the six-hour default job timeout is why it burns hours instead of minutes.

Three bounds:

  • timeout-minutes: 90 on the job — no run outlives an hour and a half regardless of where it wedges.
  • timeout-minutes: 30 on the memcheck step, a generous triple of its normal time (apt ~1min + the curated suite ~8min with the cases test: close the sprint's coverage gaps, and put its ownership fixes under memcheck #815 added).
  • Acquire::Retries=3 plus 30-second http/https timeouts on both apt-get invocations, so a dead mirror times out and retries instead of hanging silently.

what was tested

@kacy
kacy merged commit 3ea6de5 into main Aug 19, 2026
2 checks passed
@kacy
kacy deleted the ci-timeout-hardening branch August 19, 2026 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant