[SPARK-34276] Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 3.2.0
• Component/s: Build, SQL
• Target Version/s: 3.2.0
• Assignee: Chao Sun
• Reporter: Yuming Wang
• Created: 28/Jan/21 04:34
• Updated: 05/Dec/21 07:20
• Resolved: 28/Sep/21 19:24

Description

Before the release, we need to double check the unreleased/unresolved JIRAs/PRs of Parquet 1.11/1.12 and then decide whether we should upgrade/revert Parquet. At the same time, we should encourage the whole community to do the compatibility and performance tests for their production workloads, including both read and write code paths.

More details: https://github.com/apache/spark/pull/26804#issuecomment-768790620

Issue Links

• is blocked by: SPARK-36726 Upgrade Parquet to 1.12.1
• is related to: SPARK-34542 Upgrade Parquet to 1.12.0
• relates to: SPARK-36696 spark.read.parquet loads empty dataset
• relates to: PARQUET-2078 Failed to read parquet file after writing with the same parquet version