Skip to content

[core] Introduce a vector read planner for data evolution - #9877

Merged
JingsongLi merged 1 commit into
apache:masterfrom
zhoulii:fix/vector-partial-update-precedence
Sep 17, 2026
Merged

JingsongLi merged 1 commit into
apache:masterfrom
zhoulii:fix/vector-partial-update-precedence

Conversation

@zhoulii

@zhoulii zhoulii commented Sep 16, 2026

Copy link
Copy Markdown
Member

Purpose

close #9876

Tests

@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 289010a into apache:master Sep 17, 2026
18 checks passed
@JingsongLi

Copy link
Copy Markdown
Contributor

I ran the affected tests locally at this head (VectorStoreTableTest in paimon-core): 9 tests, 0 failures, 0 errors, BUILD SUCCESS.

The planner reads well: the boundary sweep and the latest-provider-per-row-id resolution handle the overlapping vector file cases the previous sequential grouping could not, the "presence in writeCols" rule correctly documents explicit-NULL-overwrite behavior, and the column-pruning fallback (retain an active provider where the projected vector is not yet populated) closes the missing-range case. The three new tests cover shared-file partial updates, compacted ranges, and missing vector ranges.

@zhoulii
zhoulii deleted the fix/vector-partial-update-precedence branch September 17, 2026 06:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Vector partial updates can return stale values in Data Evolution tables

2 participants