Repository navigation

feat: support the S3A magic committer in native Parquet writes - #6940

Merged

andygrove merged 14 commits into

apache:mainfrom

andygrove:s3a-magic-committer-native-writes

Oct 27, 2026

Merged

feat: support the S3A magic committer in native Parquet writes#6940
andygrove merged 14 commits into
apache:mainfrom
andygrove:s3a-magic-committer-native-writes

Commits on Oct 13, 2026
Commits on Oct 17, 2026
- Merge remote-tracking branch 'upstream/main' into s3a-magic-committer-native-writes
  andygrove
  committed
  004eec5
Commits on Oct 18, 2026
- Merge remote-tracking branch 'apache/main' into s3a-magic-committer-native-writes
  andygrove
  committed
  09b9d6d
Commits on Oct 19, 2026
- address review: drop the unreachable bucket committer fallback and say once why S3A creates the file
  andygrove
  committed
  65e2bfd
Commits on Oct 21, 2026
- address review: enrich write errors as Spark does, test the Hadoop route's failure paths
  andygrove
  committed
  50efcb6
- test: compare what a failed job commit leaves pending with Spark's writer
  andygrove
  committed
  81f1166
Commits on Oct 27, 2026