Skip to content

Introduce new parameter --processes for catalog compile#1377

Merged
simu merged 1 commit into
masterfrom
feat/catalog-compile-processes
May 28, 2026
Merged

Introduce new parameter --processes for catalog compile#1377
simu merged 1 commit into
masterfrom
feat/catalog-compile-processes

Conversation

@simu
Copy link
Copy Markdown
Member

@simu simu commented May 28, 2026

This allows us to better tune the number of processes spawned by Kapitan when running in CI (from some local experiments, peak memory working set size is more or less directly correlated to number of Kapitan worker processes). Unfortunately, extending our cpu_count() logic to account for K8s CPU requests/limits is non-trivial, so we just allow users to override the detected number of CPUs.

Checklist

  • Keep pull requests small so they can be easily reviewed.
  • Update the documentation.
  • Update tests.
  • Categorize the PR by setting a good title and adding one of the labels:
    bug, enhancement, documentation, change, breaking, dependency, internal
    as they show up in the changelog

@simu simu requested a review from a team as a code owner May 28, 2026 09:29
@simu simu added the enhancement New feature or request label May 28, 2026
This allows us to better tune the number of processes spawned by Kapitan
when running in CI (from some local experiments, peak memory working set
size is more or less directly correlated to number of Kapitan worker
processes). Unfortunately, extending our `cpu_count()` logic to account
for K8s CPU requests/limits is non-trivial, so we just allow users to
override the detected number of CPUs.
@simu simu force-pushed the feat/catalog-compile-processes branch from 5183f12 to acc438a Compare May 28, 2026 09:40
@simu simu requested a review from a team May 28, 2026 09:40
@simu simu merged commit 81195ee into master May 28, 2026
28 checks passed
@simu simu deleted the feat/catalog-compile-processes branch May 28, 2026 11:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants