[PARQUET-107] Add option to disable summary metadata aggregation after MR jobs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: parquet-mr
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 27/Sep/14 20:30
• Updated: 23/Jun/24 03:26
• Resolved: 01/Oct/14 21:16

Description

The summary metadata flies produced at the end of MR jobs aren't required for the job to complete successfully or for reading the data, so this should be an optional step in the MR commit phase. I'd like to add a property parquet.enable.summary-metadata that turns this off if set to false. The default will be true / enabled to match the current behavior.