Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4186

NPE in ReduceSinkDeDuplication

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11.0
    • Query Processor
    • None

    Description

      When you have a sequence of RedueSinks on constants you get this error:

      java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.optimizer.ReduceSinkDeDuplication$ReduceSinkDeduplicateProcFactory$ReducerReducerProc.getPartitionAndKeyColumnMapping(ReduceSinkDeDuplication.java:416)
      

      The e.g. to generate this si:

      select p_name from (select p_name from part distribute by 1 sort by 1) p distribute by 1 sort by 1
      

      Sorry for the contrived e.g., but this actually happens when we stack windowing clauses (see PTF-Windowing branch)

      Attachments

        1. HIVE-4186.1.patch.txt
          1 kB
          Harish Butani
        2. HIVE-4186.2.patch.txt
          4 kB
          Harish Butani
        3. HIVE-4186.3.patch.txt
          3 kB
          Harish Butani

        Activity

          People

            rhbutani Harish Butani
            rhbutani Harish Butani
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: