feat: DISTINCT handling for Aggregate UDFs - #25288

Merged

adriangb merged 23 commits into

apache:mainfrom

mkleen:eliminate-aggregate-distinct

Sep 16, 2026

Commits on Sep 16, 2026

feat: teach AggregateUDFImpl how it treats DISTINCT, and strip the flag when it is a no-op

mkleen
and
claude
committed
bcfe457
fix: keep DISTINCT on mixed aggregate nodes, and correct three mis-tagged functions

mkleen
and
claude
committed
958b5b2
refactor: simplify EliminateAggregateDistinct

mkleen
and
claude
committed
6eb6365
docs: correct how stddev, variance and approx_median handle DISTINCT

mkleen
and
claude
committed
596b326
fix: tag grouping as Ignored, align the UDAF guide, and mark DistinctHandling non_exhaustive

mkleen
and
claude
committed
145ff67
Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

mkleen
and
adriangb
committed
81de522
Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

mkleen
and
adriangb
committed
343df17
Update datafusion/functions-aggregate/src/stddev.rs

mkleen
and
adriangb
committed
bd62130
Update datafusion/functions-aggregate/src/approx_median.rs

mkleen
and
adriangb
committed
605f5cf
Update docs/source/library-user-guide/functions/adding-udfs.md

mkleen
and
adriangb
committed
8852f7a
Update datafusion/sqllogictest/test_files/aggregates_simplify.slt

mkleen
and
adriangb
committed
37c51c9
Update datafusion/expr/src/udaf.rs

mkleen
and
adriangb
committed
7e527f0
Update datafusion/functions-aggregate/src/stddev.rs

mkleen
and
adriangb
committed
2269404
Update docs/source/library-user-guide/functions/adding-udfs.md

mkleen
and
adriangb
committed
de84530
Update datafusion/functions-aggregate/src/bit_and_or_xor.rs

mkleen
and
adriangb
committed
cb5ac84
Update datafusion/functions-aggregate/src/grouping.rs

mkleen
and
adriangb
committed
8975e11
Update datafusion/functions-aggregate/src/first_last.rs

mkleen
and
adriangb
committed
826345e
Update datafusion/sqllogictest/test_files/aggregates_simplify.slt

mkleen
and
adriangb
committed
569fa41
Update datafusion/expr/src/udaf.rs

mkleen
and
adriangb
committed
5807127
Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

mkleen
and
adriangb
committed
b130350
test: cover distinct_handling through the public UDAF API

mkleen
and
claude
committed
0676aba
refactor: rename DistinctHandling::Ignored/Honored to Insensitive/Sensitive

mkleen
and
claude
committed
9e96779
Fix formatting
mkleen
committed
9089a07

Navigation Menu

feat: DISTINCT handling for Aggregate UDFs - #25288

feat: DISTINCT handling for Aggregate UDFs#25288
adriangb merged 23 commits into
apache:mainfrom
mkleen:eliminate-aggregate-distinct

Commits on Sep 16, 2026

feat: teach AggregateUDFImpl how it treats DISTINCT, and strip the flag when it is a no-op

fix: keep DISTINCT on mixed aggregate nodes, and correct three mis-tagged functions

refactor: simplify EliminateAggregateDistinct

docs: correct how stddev, variance and approx_median handle DISTINCT

fix: tag grouping as Ignored, align the UDAF guide, and mark DistinctHandling non_exhaustive

Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

Update datafusion/functions-aggregate/src/stddev.rs

Update datafusion/functions-aggregate/src/approx_median.rs

Update docs/source/library-user-guide/functions/adding-udfs.md

Update datafusion/sqllogictest/test_files/aggregates_simplify.slt

Update datafusion/expr/src/udaf.rs

Update datafusion/functions-aggregate/src/stddev.rs

Update docs/source/library-user-guide/functions/adding-udfs.md

Update datafusion/functions-aggregate/src/bit_and_or_xor.rs

Update datafusion/functions-aggregate/src/grouping.rs

Update datafusion/functions-aggregate/src/first_last.rs

Update datafusion/sqllogictest/test_files/aggregates_simplify.slt

Update datafusion/expr/src/udaf.rs

Update datafusion/optimizer/src/eliminate_aggregate_distinct.rs

test: cover distinct_handling through the public UDAF API

refactor: rename DistinctHandling::Ignored/Honored to Insensitive/Sensitive

Fix formatting