Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22686

MapredLocalTask hang for over 9 nine hours

Log workAgile BoardRank to TopRank to BottomAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      Hi ,

      Yesterday, i  run a hive on mr task,it hangs for over nine hours,after rerun it with the same data on the same hiveserver,the task finished in 10 mins in time,i am already crazy on it.

      here is the last logs for the first try(which hangs for hours):

       

       

      here is the second try(which finishs in 10 mins,the local part cost 7 seconds also) :

       

      the most weird thing is the plan.xml is different,the plans and jstack infomation are as attached.the cpu and memory is normal,while the process is so slow.

      My headache is:

      1.Do the plan.xml can be different for the same hql and the same hiveserver

      2.The first try runs quite slow,every records operation(put into hashmap) cost almost 1000ms.while the second try runs quite fast(same data and same hiveserver). 

      Do Anyone has already met similar issues, any points will be appreciated.

      Thanks.

        Attachments

        1. normal_plan.xml
          3 kB
          philipse
        2. local_task_hangs_plan.xml
          6 kB
          philipse
        3. image-2019-12-31-16-42-20-416.png
          226 kB
          philipse
        4. image-2019-12-31-16-42-11-589.png
          54 kB
          philipse
        5. image-2019-12-31-16-31-40-304.png
          61 kB
          philipse
        6. image-2019-12-31-16-30-55-652.png
          91 kB
          philipse
        7. image-2019-12-31-16-30-14-731.png
          249 kB
          philipse
        8. hadoop-080-084.dump
          10 kB
          philipse

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

              Dates

              • Created:
                Updated:

                Issue deployment