[PARQUET-333] [Vectorized Reader] Add attributes in ColumnVector and RowBatch

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: parquet-mr
• Assignee: Nezih Yigitbasi
• Reporter: Dong Chen
• Created: 14/Jul/15 07:07
• Updated: 18/Aug/15 05:32

Description

As discussed in HIVE-8128, we want to add some attributes in vector.

• In ColumnVector, add two attributes: one is boolean noNulls, which indicates whether the whole column vector has no null value. The other is boolean isRepeating, which indicates whether the same value repeats for whole column vector. They could be calculated at the same time when we read a vector. SQL engines (like Hive) can check these attribute to skip some values.
• In RowBatch, add one attribute int size, which indicates the number of rows in this batch. This is just for easy usage. Its value should be the same as RowBatch.columns[0].numValues.