Search before asking
Paimon version
master
Compute Engine
Flink
Minimal reproduce step
- Create a table with column comments that contain newline characters, for example from Avro field doc strings.
- Sync Iceberg metadata through IcebergHiveMetadataCommitter.
- Let a comment stay under 255 characters after newline removal.
- Observe Glue validation failure on CreateTable or UpdateTable.
What does not meet your expectations?
IcebergHiveMetadataCommitter.normalizeColumnComment returns early for comments at or below the 255 character limit before removing newline characters. AWS Glue rejects comments with newline characters, so short multiline comments still fail validation even though they should be normalized to spaces first.
Anything else?
A small fix is enough here: strip newlines before the length check, keep the existing truncation behavior for long comments, and add a unit test covering both short and long multiline comments.
Are you willing to submit a PR?
Search before asking
Paimon version
master
Compute Engine
Flink
Minimal reproduce step
What does not meet your expectations?
IcebergHiveMetadataCommitter.normalizeColumnComment returns early for comments at or below the 255 character limit before removing newline characters. AWS Glue rejects comments with newline characters, so short multiline comments still fail validation even though they should be normalized to spaces first.
Anything else?
A small fix is enough here: strip newlines before the length check, keep the existing truncation behavior for long comments, and add a unit test covering both short and long multiline comments.
Are you willing to submit a PR?