[SPARK-39231] Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordReader`

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 19/May/22 04:19
• Updated: 30/Jun/22 04:43
• Resolved: 29/Jun/22 16:22

Description

Try to use `ConstantColumnVector` instead of OnHeapColumnVector(or OffHeapColumnVector) to store partition columns in `VectorizedParquetRecordReader` for performance improvements and memory savings.

I will do some preliminary research and supplement jira description.

 

`

Issue Links

• links to: [Github] Pull Request #36616 (LuciferYang)
• links to: [Github] Pull Request #37030 (LuciferYang)
• links to: [Github] Pull Request #37030 (LuciferYang)