Skip to content

add libraries field for Clusters - #6365

Draft
Sankalp-Mittal wants to merge 4 commits into
mainfrom
sankalp-mittal/all-purpose-cluster-libraries
Draft

add libraries field for Clusters#6365
Sankalp-Mittal wants to merge 4 commits into
mainfrom
sankalp-mittal/all-purpose-cluster-libraries

Conversation

@Sankalp-Mittal

Copy link
Copy Markdown
Collaborator

WIP: Fix for Issue:#1860

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Aug 24, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: e4e688e

Run: 32833067435

Env 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 1 4 274 1180 3:59
💚​ aws windows 1 4 276 1178 3:46
💚​ azure linux 1 4 273 1180 4:03
💚​ azure windows 1 4 275 1178 3:50
💚​ gcp linux 1 4 274 1180 4:23
💚​ gcp windows 1 4 276 1178 3:24
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
Top 3 slowest tests (at least 2 minutes):
duration env testname
3:30 azure windows TestAccept
3:19 aws windows TestAccept
3:16 gcp windows TestAccept

@Sankalp-Mittal
Sankalp-Mittal force-pushed the sankalp-mittal/all-purpose-cluster-libraries branch from e378a6a to e4e688e Compare August 25, 2026 09:36
Sankalp-Mittal and others added 3 commits August 25, 2026 13:57
Wire the direct engine to treat resources.clusters.*.libraries as a
child-resource node, the same way permissions and grants are handled:
node/type resolution, reference splitting, and plan node discovery.

Co-authored-by: Isaac <no-reply@databricks.com>
Implement ResourceLibraries: installs/uninstalls cluster libraries via
the Libraries API, reconciling removed libraries on update and polling
for install completion on a running cluster. Registered in all.go.

Note: TestAll/clusters.libraries fails until the testserver models the
libraries install/uninstall/cluster-status endpoints (next step).

Co-authored-by: Isaac <no-reply@databricks.com>
Add stateful fakes for the Libraries API (install, uninstall,
cluster-status) so clusters.libraries runs against the in-process
server. Add the TestAll fixture and classify libraries as a no-op
delete alongside permissions/grants; this greens TestAll/clusters.libraries.

Co-authored-by: Isaac <no-reply@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants