[HIVE-20038] Update queries on non-bucketed + partitioned tables throws NPE

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.3, 3.2.0, 4.0.0
• Fix Version/s: 3.2.0, 4.0.0-alpha-1
• Component/s: Transactions
• Target Version/s: 3.2.0, 4.0.0
• Assignee: Prasanth Jayachandran
• Reporter: Kavan Suresh
• Created: 29/Jun/18 23:46
• Updated: 25/Sep/24 11:22
• Resolved: 02/Jul/18 06:48

Description

With HIVE-19890 delete deltas of non-bucketed tables are computed from ROW__ID. This can create holes in output paths (and final paths) in FSOp.commit() resulting in NPE. 

Following is the exception

Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:246)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:235)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1325)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
	at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383)