Skip to content

CI: put pysceptre's scripts/ on PYTHONPATH for the Nextflow DAG step - #3

Merged
emattei merged 3 commits into
mainfrom
fix/ci-sceptre-io
Sep 28, 2026
Merged

emattei merged 3 commits into
mainfrom
fix/ci-sceptre-io

Conversation

@emattei

@emattei emattei commented Sep 26, 2026

Copy link
Copy Markdown
Collaborator

The tests workflow's Nextflow DAG step fails with ModuleNotFoundError: No module named 'sceptre_io': watteg-make-test-data imports pysceptre's scripts/sceptre_io.py, which is not in pysceptre's wheel. This fetches scripts/ at the pinned tag (v0.2.0) and puts it on PYTHONPATH, as the container image does.

🤖 Generated with Claude Code

emattei and others added 3 commits September 25, 2026 23:16
watteg-make-test-data imports sceptre_io, which pysceptre does not ship in
its wheel, so the step failed with ModuleNotFoundError on every push since
the Python switch. Fetch scripts/ at the pinned tag, as the container does.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
WattEG reads the .h5mu pysceptre's export writes, but only pixi.toml listed
them, so a pip or uv install (and CI) lacked them: the Nextflow DAG step
then failed with No module named 'anndata'.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
-profile standard kept the real requests, and PREPARE_SIM_INPUT's 32 GB
exceeds the 15.6 GB runner, so Nextflow refused the task before running its
stub. The stub profile caps resources for this, as pixi's pipeline-test does.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@emattei
emattei merged commit 842dcc4 into main Sep 28, 2026
1 check passed
@emattei
emattei deleted the fix/ci-sceptre-io branch September 28, 2026 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant