[PARQUET-2437] Avoid flushing at Parquet writes after an exception

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: parquet-mr
• Assignee: Gabor Szadovszky
• Reporter: Gabor Szadovszky
• Created: 22/Feb/24 10:26
• Updated: 23/Jun/24 03:33
• Resolved: 05/Mar/24 09:49

Description

The different levels of Parquet writer classes (e.g. ColumnWriterBase) does a flush when close() is invoked. This is completely fine in normal scenario but in case of an exception happened this may lead to serious issues including JVM crash.

Issue Links

• links to: GitHub Pull Request #1285