[HIVE-21200] Vectorization: date column throwing java.lang.UnsupportedOperationException for parquet

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.4
• Fix Version/s: 2.3.9
• Component/s: Vectorization
• Labels: pull-request-available
• Assignee: Adrian Wang
• Reporter: Vipin Vishvkarma
• Created: 01/Feb/19 13:56
• Updated: 16/May/21 15:49
• Resolved: 16/May/21 15:49

Description

set hive.vectorized.execution.enabled=true; 
set hive.fetch.task.conversion=none; 
create table t1(d date) stored as parquet; 
insert into table t1 values("2019-01-01"); 
select * from t1;

This query will throw java.lang.UnsupportedOperationException:

Caused by: java.lang.UnsupportedOperationException at org.apache.parquet.column.values.ValuesReader.readLong(ValuesReader.java:131) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readLongs(VectorizedPrimitiveColumnReader.java:297) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readBatchHelper(VectorizedPrimitiveColumnReader.java:176) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readBatch(VectorizedPrimitiveColumnReader.java:154) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.nextBatch(VectorizedParquetRecordReader.java:292) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:238) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:64) at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:365)

Above query works fine with Hive 2.1.1 and Hive 3.1.x.

Issue Links

• links to: GitHub Pull Request #2276