Skip to content

Refresh temporary namespace credentials in distributed workers #53

Description

@FANNG1

Goal

Allow long-running distributed namespace operations to refresh temporary catalog-vended storage credentials.

Scope

  • Introduce an explicit serializable table-access context instead of relying on private LanceDataset attributes.
  • Recreate the namespace client and reopen datasets on distributed workers where needed.
  • Cover scan, merge, index, and compaction workers.
  • Add a short-lived credential or forced-refresh regression test.

This is a follow-up reliability optimization and does not block the initial namespace feature, release, or Daft entry-point integration tracked by #51.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions