Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-807

Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.1
    • Component/s: jobtracker
    • Labels:
      None
    • Release Note:
      Hide
      The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.
      Show
      The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.

      Description

      With restart disabled, the jobtracker does a rm -rf of the mapred.system.dir. If the mapred.system.dir contains user files with permissions other than 777 then the jobtracker gets stuck in a loop trying to delete the mapred.system.dir (and each time failing with AccessControlException). The JobTracker admin has to manually cleanup the mapred.system.dir if this happens.

      1. MAPREDUCE-807-v1.7-branch-0.20.patch
        7 kB
        Amar Kamat
      2. MAPREDUCE-807-v1.6-branch-0.20.patch
        7 kB
        Amar Kamat
      3. MAPRED-807-v1.7.patch
        13 kB
        Amar Kamat
      4. MAPRED-807-v1.6.patch
        13 kB
        Amar Kamat
      5. MAPRED-807-v1.4.patch
        2 kB
        Amar Kamat
      6. MAPRED-807-v1.3.patch
        2 kB
        Amar Kamat
      7. MAPRED-807-v1.2.patch
        0.7 kB
        Amar Kamat
      8. MAPRED-807-v1.1.patch
        0.7 kB
        Amar Kamat

        Activity

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Amar Kamat
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development