Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6639

Vectorization: Partition column names are not picked up.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • None
    • None

    Description

      The vectorized plan generation finds the list of partitioning columns from pruned-partition-list using table scan operator. In some cases the list is coming as null. TPCDS query 27 can reproduce this issue if the store_sales table is partitioned on ss_store_sk. The exception stacktrace is :

      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getInputColumnIndex(VectorizationContext.java:166)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getColumnVectorExpression(VectorizationContext.java:240)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpression(VectorizationContext.java:287)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpressions(VectorizationContext.java:267)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.getVectorExpressions(VectorizationContext.java:255)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator.<init>(VectorMapJoinOperator.java:116)
      	... 42 more
      
      

      Attachments

        1. HIVE-6639.6.patch
          11 kB
          Jitendra Nath Pandey
        2. HIVE-6639.5.patch
          5 kB
          Jitendra Nath Pandey
        3. HIVE-6639.5.patch
          5 kB
          Jitendra Nath Pandey
        4. HIVE-6639.4.patch
          6 kB
          Jitendra Nath Pandey
        5. HIVE-6639.3.patch
          6 kB
          Jitendra Nath Pandey
        6. HIVE-6639.2.patch
          4 kB
          Jitendra Nath Pandey

        Activity

          People

            jnp Jitendra Nath Pandey
            jnp Jitendra Nath Pandey
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: