[PARQUET-535] Make writeAllFields more efficient in proto-parquet component

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: parquet-mr
• Assignee: Chen Song
• Reporter: Chen Song
• Due: 29/Feb/16
• Created: 16/Feb/16 16:17
• Updated: 14/Aug/18 15:35

Description

This will improve the write performance by 1/3 - 1/4 based on my testing. It makes a huge difference when dealing with really large files (several GBs).

In the original implementation, a significant time was spent on creating unnecessary Java objects.