[HUDI-2812] Upgrade Parquet to 1.12

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Fix Version/s: 0.11.0
• Assignee: Alexey Kudinkin
• Reporter: Alexey Kudinkin
• Created: 20/Nov/21 23:55
• Updated: 09/Dec/21 20:10
• Resolved: 09/Dec/21 20:10

Description

Current version of Apache Parquet is from 2 years old and contains at least one known race-condition that might be compromising correctness of the DateType:

 

Current version of 1.10 (and seems like 1.11 as well) contains DateStringifier class that uses static shared {{SimpleDataFormat}} object which is known to be NOT thread-safe.

Therefore any access to that object (for example upon serialization) exposes use to RCs.

Issue Links

• duplicates: HUDI-2811 Support Spark 3.2 and Parquet 1.12.x