Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20038

Update queries on non-bucketed + partitioned tables throws NPE

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.1.3, 3.2.0, 4.0.0
    • 3.2.0, 4.0.0-alpha-1
    • Transactions
    • None

    Description

      With HIVE-19890 delete deltas of non-bucketed tables are computed from ROW__ID. This can create holes in output paths (and final paths) in FSOp.commit() resulting in NPE. 

      Following is the exception

      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:246)
      	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:235)
      	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
      	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1325)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
      	at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383)

      Attachments

        1. HIVE-20038.1.patch
          3 kB
          Prasanth Jayachandran
        2. HIVE-20038.2.patch
          3 kB
          Prasanth Jayachandran

        Activity

          People

            prasanth_j Prasanth Jayachandran
            Kavan Kavan Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: