[HIVE-7082] Vectorized parquet reader should create assigners only for the columns it assigns, not for scratch columns

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.13.0, 0.14.0
• Fix Version/s: 0.14.0
• Component/s: Query Processor
• Labels: parquet vectorization
• Assignee: Remus Rusanu
• Reporter: Remus Rusanu
• Created: 19/May/14 05:06
• Updated: 13/Nov/14 19:43
• Resolved: 19/May/14 18:10

Description

The code in VectorizedParquetRecordReader.next and in VectorColumnAssignFactory.buildAssigners iterates for all columns in the vectorization context trying to build an assigner for it. Scratch columns do not require assigners. Fix is to simply use the writables.length instead of outputBatch.numCols.

Issue Links

• blocks: HIVE-5771 Constant propagation optimizer for Hive