Skip to content

chore(ci): share BDD setup with trusted cache saves - #4186

Draft
strantalis wants to merge 5 commits into
codex/bdd-release-cachefrom
codex/bdd-go-cache
Draft

strantalis wants to merge 5 commits into
codex/bdd-release-cachefrom
codex/bdd-go-cache

Conversation

@strantalis

@strantalis strantalis commented Oct 7, 2026 •

Copy link
Copy Markdown
Member

Stack merge order: release cache policy → shared BDD setup and Go cache → readiness polling → Docker cache.

Proposed Changes

BDD and authorization-scale repeat the same setup and previously required two cache-poisoning exclusions. Put their steps in one reusable workflow with a single scale boolean, disable implicit setup-go caching, and restore Go module/compiler caches explicitly. Only successful functional BDD runs from pushes to main save the shared cache. PR and scale runs restore only, so a dependency change can stay cold until it reaches main.

Keep the functional/scale tags, functional randomization, report names, 20-minute test timeout, and -count=1. Preserve the required ci dependency on the tests-bdd caller and leave scale report-only. Both jobs use read-only contents permissions and no workflow secrets. Compilation remains a separate timed step. The shared workflow has no release trigger, and both cache-poisoning exclusions are removed.

Release builds consume fresh dependencies in the prerequisite PR. Native cache-mode syntax is omitted because current actionlint does not support it; restore/save actions implement the cache policy with GitHub's existing branch/ref scoping.

Checklist

  • Updated CI helper workflow routing
  • Preserved suite selection, report names, and failure propagation
  • Documented cache ownership and cold-run comparisons

Testing Instructions

The two BDD callers retain ./ with inline self-repository exceptions because current actionlint v1.7.12 rejects GitHub's recommended $/ syntax for reusable workflow calls. GitHub resolves both forms to the caller's same commit. These exceptions cover only that syntax recommendation. The shared BDD workflow still has no cache-poisoning exceptions.

  • actionlint passes for the caller, reusable BDD workflow, focused CI test workflow, and CLI release workflow.
  • Offline zizmor v1.30.1 reports zero findings for the reusable BDD and CLI release workflows, with no ignores. Six baseline findings remain in other checks.yaml jobs: four cache-poisoning and two self-repository advisories.
  • Existing CI helper tests: 12 passed. Authorization summary renderer tests: 6 passed.
  • BDD test binary compiles with cukes and the current workspace dependencies.
  • Executed the shell command with a recording Go executable for functional and scale modes: tags, randomization, reports, -count=1, and nonzero-exit propagation match the intended behavior.
  • git diff --check passes.

Compare cache-hit runs after a successful push to main has populated the cache, recording compilation time, restore/save overhead, total duration, and executed scenario count. PR reruns do not populate their own cache. Historical baseline runs in the README predate the dependency update in #4177, so compare the layers with the same dependency set. Warm CI savings remain unmeasured.

Signed-off-by: strantalis <strantalis@virtru.com>
@coderabbitai

coderabbitai Bot commented Oct 7, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot added comp:ci Github Actions Work size/s labels Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor
Benchmark results, click to expand

Bulk Benchmark Results

Metric Value
Total Decrypts 100
Successful Decrypts 100
Failed Decrypts 0
Total Time 408.085535ms
Throughput 245.05 requests/second

TDF3 Benchmark Results

Metric Value
Total Requests 5000
Successful Requests 5000
Failed Requests 0
Concurrent Requests 50
Total Time 46.199159841s
Average Latency 461.020148ms
Throughput 108.23 requests/second

Signed-off-by: strantalis <strantalis@virtru.com>
Signed-off-by: strantalis <strantalis@virtru.com>
Comment thread .github/workflows/checks.yaml Fixed
Comment thread .github/workflows/checks.yaml Fixed
@strantalis
strantalis removed this pull request from stack #4189 October 7, 2026 11:24
@strantalis
strantalis changed the base branch from main to codex/bdd-release-cache October 7, 2026 11:24
@strantalis
strantalis added this pull request to stack #4191 October 7, 2026 11:24
@strantalis strantalis changed the title chore(ci): cache BDD Go compilation chore(ci): share BDD setup with trusted cache saves Oct 7, 2026
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor
Benchmark results, click to expand

Bulk Benchmark Results

Metric Value
Total Decrypts 100
Successful Decrypts 100
Failed Decrypts 0
Total Time 428.795321ms
Throughput 233.21 requests/second

TDF3 Benchmark Results

Metric Value
Total Requests 5000
Successful Requests 5000
Failed Requests 0
Concurrent Requests 50
Total Time 44.840488363s
Average Latency 447.277194ms
Throughput 111.51 requests/second

Signed-off-by: strantalis <strantalis@virtru.com>
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor
Benchmark results, click to expand

Bulk Benchmark Results

Metric Value
Total Decrypts 100
Successful Decrypts 100
Failed Decrypts 0
Total Time 411.161514ms
Throughput 243.21 requests/second

TDF3 Benchmark Results

Metric Value
Total Requests 5000
Successful Requests 5000
Failed Requests 0
Concurrent Requests 50
Total Time 47.460567141s
Average Latency 473.492604ms
Throughput 105.35 requests/second

Signed-off-by: strantalis <strantalis@virtru.com>
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor
Benchmark results, click to expand

Bulk Benchmark Results

Metric Value
Total Decrypts 100
Successful Decrypts 100
Failed Decrypts 0
Total Time 412.299807ms
Throughput 242.54 requests/second

TDF3 Benchmark Results

Metric Value
Total Requests 5000
Successful Requests 5000
Failed Requests 0
Concurrent Requests 50
Total Time 44.506582605s
Average Latency 444.080302ms
Throughput 112.34 requests/second

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

⚠️ Govulncheck found vulnerabilities ⚠️

The following modules have known vulnerabilities:

  • otdfctl
  • service
  • tests-bdd

See the workflow run for details.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp:ci Github Actions Work size/s

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants