[HIVE-25452] Hive job fails while closing reducer output - Unable to rename

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Query Processor
• Assignee: Nikhil Gupta
• Reporter: Nikhil Gupta
• Created: 16/Aug/21 10:49
• Updated: 28/Feb/22 15:14

Description

I have observed similar issue for Hive on LLAP:

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from: 
abfs://<redacted>/tmp/hive/root/277a283f-9d32-4525-b35f-03551c6a364e/hive_2021-08-15_20-22-24_848_2416200416962826887-27/-mr-10001/.hive-staging_hive_2021-08-15_20-22-24_848_2416200416962826887-27/_task_tmp.-ext-10002/_tmp.000000_3 to: 
abfs://<redacted>/tmp/hive/root/277a283f-9d32-4525-b35f-03551c6a364e/hive_2021-08-15_20-22-24_848_2416200416962826887-27/-mr-10001/.hive-staging_hive_2021-08-15_20-22-24_848_2416200416962826887-27/_tmp.-ext-10002/000000_3
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:272)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:236)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1331)
 at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:732)
 at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:756)
 at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:756)
 at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383) ... 16 more

Issue Links

• is a clone of: HIVE-4605 Hive job fails while closing reducer output - Unable to rename
• links to: Review board