You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add support for GCS-backed plot uploads and update documentation
- Configure GCS as the default `IMAGE_UPLOAD_BACKEND` in `Dockerfile`, with fallback to S3 if overridden.
- Enhance `pyproject.toml` to include `gcs` extra for `lf_toolkit`.
- Update `CLAUDE.md` to reflect GCS integration and backend switching details.
- Clarify environment variable requirements for both GCS and S3 upload options.
@@ -20,7 +20,7 @@ All source lives in `evaluation_function/`:
20
20
-**`demo`**: execute code with no stdin; return stdout/plots as `output` feedback (no pass/fail)
21
21
-**`io_test`**: for each test in `params["tests"]`, execute with `test["input"]` as stdin and compare stdout against `test["expected_output"]`; upload matplotlib plots on pass or fail
3. Upload any captured matplotlib figures to S3 (`_UPLOAD_FOLDER = "evaluatePython"`)
23
+
3. Upload any captured matplotlib figures via `lf_toolkit``upload_image`(`_UPLOAD_FOLDER = "evaluatePython"`); backend is GCS or S3 per `IMAGE_UPLOAD_BACKEND`
24
24
4. Return a `Result` with feedback tags: `pass`, `fail`, `hidden_fail`, `error`, `output`, `summary`
25
25
26
26
### Request shape
@@ -151,7 +151,9 @@ CI runs on Python 3.12 and uploads JUnit XML results (`.github/workflows/test-li
|`IMAGE_UPLOAD_BACKEND`|`gcs`| Plot upload backend in lf_toolkit (`gcs` set in Dockerfile; override to `s3` on the service to use AWS) |
155
+
|`GCS_BUCKET`| Runtime env | Target bucket for matplotlib plot uploads; set per-environment on the Cloud Run service. Auth is via the runtime service account (ADC) — no keys |
156
+
|`AWS_*` / `S3_BUCKET_URI`| Runtime env | Only for the legacy S3 plot-upload backend (`IMAGE_UPLOAD_BACKEND=s3`) |
155
157
|`SANDBOX_ENABLED`|`true`| Wrap the worker in shimmy's nsjail sandbox (needs `--privileged` at run time) |
0 commit comments