Skip to content

feat(doris-best-practices): add tablet count vs metadata & write-throughput limits rule - #13

Open
cool-joker wants to merge 1 commit into
apache:mainfrom
cool-joker:feat/bucket-tablet-count-limits
Open

cool-joker wants to merge 1 commit into
apache:mainfrom
cool-joker:feat/bucket-tablet-count-limits

Conversation

@cool-joker

Copy link
Copy Markdown

What

Adds a new best-practice rule schema-bucket-tablet-count-limits, sourced from the
Apache Doris 4.x doc "Basic Concepts — 6.2 Empirical Values and Limits".

Why

The existing bucket-strategy rules cover tablet size (1–10 GB) and bucket-key
choice, but none captured the hard operational limits on tablet count, which
directly drive FE memory and import throughput:

  • Metadata scale — every 10M tablets ≈ 100 GB FE memory; a single BE should hold

…hput limits rule

Add schema-bucket-tablet-count-limits rule sourced from Apache Doris 4.x
'Basic Concepts' doc §6.2 (Empirical Values and Limits):

- FE memory: ~100 GB per 10M tablets; single BE < 20k tablets
- Write throughput: <128 buckets/partition; concentrate writes on few partitions
- Cross-reference existing partition/bucket/tablet-size rules

Register the rule in the Bucket Strategy index and bump the rule count 37→38.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant