Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5567 [Umbrella] Stabilize MR framework w.r.t ResourceManager restart
  3. MAPREDUCE-5086

MR app master deletes staging dir when sent a reboot command from the RM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • None
    • None
    • Reviewed

    Description

      If the RM is restarted when the MR job is running, then it sends a reboot command to the job. The job ends up deleting the staging dir and that causes the next attempt to fail.

      Attachments

        1. YARN-472.1.patch
          23 kB
          Jian He
        2. YARN-472.2.patch
          30 kB
          Jian He
        3. YARN-472.3.patch
          29 kB
          Jian He
        4. YARN-472.4.patch
          28 kB
          Jian He
        5. YARN-472.5.patch
          28 kB
          Jian He
        6. YARN-472.6.patch
          27 kB
          Jian He
        7. YARN-472.7.patch
          27 kB
          Jian He

        Issue Links

          is cloned by

          Sub-task - The sub-task of the issue MAPREDUCE-5607 Backport MAPREDUCE-5086 - MR app master deletes staging dir when sent a reboot command from the RM

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jianhe Jian He
              jianhe Jian He
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: