Skip to content

Improve AIR log retrieval reliability - #6414

Open
ben-hansen-db wants to merge 1 commit into
mainfrom
ben-hansen/air-log-retrieval-reliability
Open

Improve AIR log retrieval reliability#6414
ben-hansen-db wants to merge 1 commit into
mainfrom
ben-hansen/air-log-retrieval-reliability

Conversation

@ben-hansen-db

Copy link
Copy Markdown
Contributor

Changes

  • Cache MLflow artifact roots and support UC Volume-backed logs.
  • Unify retry-attempt selection across Bricklens and MLflow.
  • Hand active empty Bricklens streams over to MLflow when artifacts appear.

Why

Make AIR log streaming and downloads reliable across artifact backends, retries, and active runs.

Tests

  • go test ./experimental/air/cmd

This PR was written with Codex.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Aug 27, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: ee3a5be

Run: 33127297239

Env 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 1 1 274 1194 4:17
💚​ aws windows 1 1 276 1192 3:40
💚​ azure linux 1 1 273 1194 4:11
💚​ azure windows 1 1 275 1192 3:52
💚​ gcp linux 1 1 274 1194 4:35
💚​ gcp windows 1 1 276 1192 3:33
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
Top 3 slowest tests (at least 2 minutes):
duration env testname
3:47 azure windows TestAccept
3:37 aws windows TestAccept
3:27 gcp windows TestAccept

@ben-hansen-db
ben-hansen-db force-pushed the ben-hansen/air-snapshot-workspace-parity branch from 29c379d to 6ba3037 Compare August 27, 2026 23:37
@ben-hansen-db
ben-hansen-db force-pushed the ben-hansen/air-log-retrieval-reliability branch from cf199c8 to 12eb9b3 Compare August 27, 2026 23:37
@ben-hansen-db
ben-hansen-db changed the base branch from ben-hansen/air-snapshot-workspace-parity to main August 27, 2026 23:37
@ben-hansen-db
ben-hansen-db force-pushed the ben-hansen/air-log-retrieval-reliability branch from 12eb9b3 to ee3a5be Compare August 27, 2026 23:42
@ben-hansen-db
ben-hansen-db marked this pull request as ready for review August 27, 2026 23:50
@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Approval status: pending

/experimental/air/ - approved by @vinchenzo-db

6 files changed

General files (require maintainer)

Files: .nextchanges/cli/air-log-reliability.md
Based on git history:

  • @janniklasrose -- recent work in .nextchanges/cli/

Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose, @lennartkats-db, @rugpanov, @rclarey) can approve all areas.
See OWNERS for ownership rules.

@@ -0,0 +1 @@
Improved AIR log fallback, retry-attempt selection, and Unity Catalog volume artifact handling.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see a world where we don't have the MLflow artifact fallback but I'm not sure when bricklens will be stable so we should include it

Comment on lines +365 to +366
if volumeRoot, ok := volumeArtifactRoot(root); ok {
fc, err := filer.NewWorkspaceFilesClient(w, volumeRoot)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pls verify that NewWorkspaceFilesClient is what should be used for UC Volumes. I will stamp to unblock but make sure to verify.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants