Hive
  1. Hive
  2. HIVE-2945

Hive Client is hanging since MRApp Master doesnt exist after the task is finished

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Clients
    • Labels:
      None

      Description

      Submit a hive query which uses mapred to give the result(Say join query)
      If we submit a job to resourceManager process. it will create a MRAppMaster process to excute this task .
      MRAppMaster will create YarnChild process to excute Map task or reduce task.
      after task is finished,resourceManager will kill MRAppMaster and YarnChild process.
      When the hive client is about to get the progress from MRAppMaster ,the task is already finished ,so MRAppMaster process don't exist. so the client will try to connect it for ever.
      that's why hive client hangs.

        Activity

        Kristam Subba Swathi created issue -
        Hide
        Edward Capriolo added a comment -

        I am not sure anyone has tried hive in the Mapred.NEXT setup yet. I do not know enough about the infrastructure to comment definitively , but it sounds like it would be nice if the processes hung around for a few moments after completion so Hive client could check in to them. Strange though because you would not expect a hive job to hang around long then a typical map/reduce job.

        It would be great if you can give a stack trace and find what point in the hive code is hanging.

        Show
        Edward Capriolo added a comment - I am not sure anyone has tried hive in the Mapred.NEXT setup yet. I do not know enough about the infrastructure to comment definitively , but it sounds like it would be nice if the processes hung around for a few moments after completion so Hive client could check in to them. Strange though because you would not expect a hive job to hang around long then a typical map/reduce job. It would be great if you can give a stack trace and find what point in the hive code is hanging.

          People

          • Assignee:
            Unassigned
            Reporter:
            Kristam Subba Swathi
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development