Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21200

Vectorization: date column throwing java.lang.UnsupportedOperationException for parquet

    XMLWordPrintableJSON

Details

    Description

      set hive.vectorized.execution.enabled=true; 
      set hive.fetch.task.conversion=none; 
      create table t1(d date) stored as parquet; 
      insert into table t1 values("2019-01-01"); 
      select * from t1;
      

      This query will throw java.lang.UnsupportedOperationException:

      Caused by: java.lang.UnsupportedOperationException at org.apache.parquet.column.values.ValuesReader.readLong(ValuesReader.java:131) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readLongs(VectorizedPrimitiveColumnReader.java:297) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readBatchHelper(VectorizedPrimitiveColumnReader.java:176) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedPrimitiveColumnReader.readBatch(VectorizedPrimitiveColumnReader.java:154) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.nextBatch(VectorizedParquetRecordReader.java:292) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:238) at org.apache.hadoop.hive.ql.io.parquet.vector.VectorizedParquetRecordReader.next(VectorizedParquetRecordReader.java:64) at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:365)
      

      Above query works fine with Hive 2.1.1 and Hive 3.1.x.

      Attachments

        Issue Links

          Activity

            People

              adrian-wang Adrian Wang
              vpnvishv Vipin Vishvkarma
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m