Skip to content

feat: support additional SQL filter pushdown for scanners - #67

Merged
jja725 merged 2 commits into
lance-format:mainfrom
zhangstar333:test_pick
Aug 31, 2026
Merged

feat: support additional SQL filter pushdown for scanners#67
jja725 merged 2 commits into
lance-format:mainfrom
zhangstar333:test_pick

Conversation

@zhangstar333

Copy link
Copy Markdown
Contributor
  • when scan node have runtime filter, now have no chance to apply it.
  • So add C and C++ APIs for appending SQL filters before scanning starts.
  • Combine additional SQL filters with the existing SQL or Substrait filter using AND.

@zhangstar333
zhangstar333 force-pushed the test_pick branch 2 times, most recently from 145681c to c8e30c5 Compare August 28, 2026 09:09
lance-gatekeeper[bot]

This comment was marked as outdated.

@lance-gatekeeper lance-gatekeeper Bot added K-changes Latest Gatekeeper recommendation requests changes. and removed K-changes Latest Gatekeeper recommendation requests changes. labels Aug 28, 2026

@lance-gatekeeper lance-gatekeeper Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gate recommendation: approve.

The previous filter-schema issue is fixed. Primary SQL/Substrait and appended SQL predicates now compose through Lance’s fully configured scanner, preserving metadata and query-generated columns while ANDing every additional predicate. Coverage now exercises metadata, _distance, _score, and multiple appended predicates.

@lance-gatekeeper lance-gatekeeper Bot added the K-approved Latest Gatekeeper recommendation permits acceptance. label Aug 28, 2026

@jja725 jja725 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, can you resolve the conflict?

@lance-gatekeeper lance-gatekeeper Bot removed the K-approved Latest Gatekeeper recommendation permits acceptance. label Aug 31, 2026
@zhangstar333

Copy link
Copy Markdown
Contributor Author

LGTM, can you resolve the conflict?

@jja725 thanks, have done.

@jja725
jja725 merged commit 4420c2f into lance-format:main Aug 31, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants