[HIVE-22686] MapredLocalTask hang for over 9 nine hours

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 1.1.1
• Component/s: Parser

Environment

HDP 2.5.2

Hive:1.1

normal_plan.xml

local_task_hangs_plan.xml hadoop-080-084.dump

 

• Assignee: Unassigned
• Reporter: philipse
• Created: 31/Dec/19 08:47
• Updated: 05/Jan/20 02:09

Description

Hi ,

Yesterday, i  run a hive on mr task,it hangs for over nine hours,after rerun it with the same data on the same hiveserver,the task finished in 10 mins in time,i am already crazy on it.

here is the last logs for the first try(which hangs for hours):

 

 

here is the second try(which finishs in 10 mins,the local part cost 7 seconds also) :

 

the most weird thing is the plan.xml is different,the plans and jstack infomation are as attached.the cpu and memory is normal,while the process is so slow.

My headache is:

1.Do the plan.xml can be different for the same hql and the same hiveserver

2.The first try runs quite slow,every records operation(put into hashmap) cost almost 1000ms.while the second try runs quite fast(same data and same hiveserver). 

Do Anyone has already met similar issues, any points will be appreciated.

Thanks.