Skip to content

[_]: feat/batch-delete-shards-per-farmer#219

Merged
sg-gs merged 1 commit into
masterfrom
feat/delete-shards-in-batch
May 22, 2026
Merged

[_]: feat/batch-delete-shards-per-farmer#219
sg-gs merged 1 commit into
masterfrom
feat/delete-shards-in-batch

Conversation

@sg-gs

@sg-gs sg-gs commented May 21, 2026

Copy link
Copy Markdown
Member

What

deleteShardsStorageByUuids now groups shards by farmer node and enqueues a single delete-shards-batch job per node (in chunks of 50) instead of one delete-shard job per shard.

How

  • Shards are grouped by address:port using a Map before enqueuing
  • Each group is split into chunks of 50 and enqueued as delete-shards-batch jobs, which the worker handles via DELETE /v2/shards with a { keys[] } body
  • Existing delete-shard job type is untouched — only v2 UUID-based deletions are batched

⚠️ NEEDS https://github.com/internxt/network-worker/pull/32

@sg-gs sg-gs requested a review from apsantiso May 21, 2026 15:49
@sg-gs sg-gs self-assigned this May 21, 2026
@sg-gs sg-gs added the enhancement New feature or request label May 21, 2026
@sg-gs sg-gs merged commit 2430bb9 into master May 22, 2026
6 of 7 checks passed
@sg-gs sg-gs deleted the feat/delete-shards-in-batch branch May 22, 2026 07:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request ready-for-preview

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants