[SPARK-30414] Optimizations for arrays and maps in ParquetRowConverter

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 03/Jan/20 08:29
• Updated: 12/Dec/22 18:10
• Resolved: 07/Jan/20 05:30

Description

Similar to SPARK-30338, there are multiple opportunities to optimize ParquetRowConverter performance for maps and arrays, plus room for more general constant-factor shaving in a few other places.

Issue Links

• links to: GitHub Pull Request #27089