Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 15 additions & 14 deletions docs/source/changelog/1.1.0.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ under the License.

# DataFusion Comet 1.1.0 Changelog

This release consists of 398 commits from 40 contributors. See credits at the end of this changelog for more information.
This release consists of 398 commits from 41 contributors. See credits at the end of this changelog for more information.

**Fixed bugs:**

Expand Down Expand Up @@ -111,7 +111,7 @@ This release consists of 398 commits from 40 contributors. See credits at the en
- fix: align time parsing and native second extraction with Spark [#5738](https://github.com/apache/datafusion-comet/pull/5738) (peterxcli)
- fix: normalize floating-point values in native collect_set [#5166](https://github.com/apache/datafusion-comet/pull/5166) (peterxcli)
- fix: keep Iceberg complex null checks on native scans [#5732](https://github.com/apache/datafusion-comet/pull/5732) (ErikBPF)
- fix: decode invalid UTF-8 at the JVM to native FFI import boundary [#5310](https://github.com/apache/datafusion-comet/pull/5310) (manuzhang)
- fix: decode invalid UTF-8 at the JVM to native FFI import boundary [#5310](https://github.com/apache/datafusion-comet/pull/5310) (manuzhang, andygrove)
- fix: fall back when a struct repeats a Parquet field id [#6004](https://github.com/apache/datafusion-comet/pull/6004) (comphead)
- fix: normalize signed zero in nested float array comparisons [#5235](https://github.com/apache/datafusion-comet/pull/5235) (divyankshah)
- fix: fall back to Spark for native Iceberg writes to gs:// through HadoopFileIO [#5935](https://github.com/apache/datafusion-comet/pull/5935) (zhangfengcdt)
Expand Down Expand Up @@ -148,12 +148,12 @@ This release consists of 398 commits from 40 contributors. See credits at the en
- fix: check each fair_unified reservation against its own share [#6205](https://github.com/apache/datafusion-comet/pull/6205) (andygrove)
- fix(iceberg): don't push transform residuals as their source column, fail on residual errors [#6154](https://github.com/apache/datafusion-comet/pull/6154) (andygrove)
- fix: match Spark's duplicate field and field id semantics in parquet field lookup [#5654](https://github.com/apache/datafusion-comet/pull/5654) (dwsmith1983)
- fix: park the native scan loop instead of busy-polling while waiting on native I/O [#6219](https://github.com/apache/datafusion-comet/pull/6219) (andygrove)
- fix: refresh S3 policy locations when a location's credential fails [#6223](https://github.com/apache/datafusion-comet/pull/6223) (andygrove)
- fix: park the native scan loop instead of busy-polling while waiting on native I/O [#6219](https://github.com/apache/datafusion-comet/pull/6219) (andygrove, mixermt)
- fix: refresh S3 policy locations when a location's credential fails [#6223](https://github.com/apache/datafusion-comet/pull/6223) (andygrove, snmvaughan)
- fix: inject Comet session extension rules only once per session [#6230](https://github.com/apache/datafusion-comet/pull/6230) (andygrove)
- fix: [branch-1.1] reject a file without field ids at any depth whether or not id matching is on (#6116) [#6266](https://github.com/apache/datafusion-comet/pull/6266) (andygrove)
- fix: [branch-1.1] decline native Iceberg writes with a custom location provider (#6216) [#6305](https://github.com/apache/datafusion-comet/pull/6305) (andygrove)
- fix: [branch-1.1] Native S3 scan on EKS/IRSA turns a transient STS throttle into a hard 403 storm (#6025) [#6323](https://github.com/apache/datafusion-comet/pull/6323) (andygrove)
- fix: [branch-1.1] reject a file without field ids at any depth whether or not id matching is on (#6116) [#6266](https://github.com/apache/datafusion-comet/pull/6266) (andygrove, dwsmith1983)
- fix: [branch-1.1] decline native Iceberg writes with a custom location provider (#6216) [#6305](https://github.com/apache/datafusion-comet/pull/6305) (andygrove, liupoyi-1031)
- fix: [branch-1.1] Native S3 scan on EKS/IRSA turns a transient STS throttle into a hard 403 storm (#6025) [#6323](https://github.com/apache/datafusion-comet/pull/6323) (andygrove, parthchandra)
- fix: [branch-1.1] log partial memory grants at DEBUG and drop the memory usage dump (#6269) [#6346](https://github.com/apache/datafusion-comet/pull/6346) (andygrove)

**Performance related:**
Expand Down Expand Up @@ -337,7 +337,7 @@ This release consists of 398 commits from 40 contributors. See credits at the en
- feat: per-location credentials for the S3 credential SPI [#6031](https://github.com/apache/datafusion-comet/pull/6031) (snmvaughan)
- refactor: centralize data type support predicates [#5025](https://github.com/apache/datafusion-comet/pull/5025) (peterxcli)
- chore: [branch-1.1] change version from 1.1.0-SNAPSHOT to 1.1.0 [#6236](https://github.com/apache/datafusion-comet/pull/6236) (andygrove)
- feat: [branch-1.1] built-in S3 credential provider adapters for the native Parquet scan (#6023) [#6318](https://github.com/apache/datafusion-comet/pull/6318) (andygrove)
- feat: [branch-1.1] built-in S3 credential provider adapters for the native Parquet scan (#6023) [#6318](https://github.com/apache/datafusion-comet/pull/6318) (andygrove, parthchandra)

**Documentation updates:**

Expand Down Expand Up @@ -436,40 +436,42 @@ This release consists of 398 commits from 40 contributors. See credits at the en

## Credits

Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor. A PR with commits from more than one person counts for each of them.

```
128 Andy Grove
129 Andy Grove
61 Peter Lee
26 Chao Sun
26 KUAN-HAO HUANG
19 Ping Zhang
15 Oleks V
14 dustin
13 Bhargava Vadlamani
13 Liang-Chi Hsieh
13 dustin
11 dependabot[bot]
10 ChenChen Lai
7 sam-1112
6 Matt Butrovich
5 Han-Yin Chang
5 Parth Chandra
4 Erik Bogado
4 Wei Yan
3 Jordan Epstein
3 Manu Zhang
3 Parth Chandra
3 Steve Vaughan
2 Alexey
2 Cestercian
2 Daipayan Mukherjee
2 Feng Zhang
2 Kazantsev Maksim
2 Steve Vaughan
2 YuLun Mao
2 liupoyi-1031
1 Dharan-K
1 Hashim Khan
1 Henos D
1 Jeff Wang
1 LinSimon-901101
1 Michael Taranov
1 Scott Schenkein
1 Stefan Wang
1 Unik Dahal
Expand All @@ -478,7 +480,6 @@ Thank you to everyone who contributed to this release. Here is a breakdown of co
1 debaditya
1 divyank sameer shah
1 hsiang-c
1 liupoyi-1031
```

Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.