Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-807

Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 0.20.1
    • jobtracker
    • None
    • Hide
      The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.
      Show
      The JobTracker tries to delete the mapred.system.dir when it is starting up (with the job recovery disabled). The fix provided by this jira is that JobTracker will fail (bail out) with AccessControlException if it fails to delete files/directories in mapred.system.dir due to access control issues.

    Description

      With restart disabled, the jobtracker does a rm -rf of the mapred.system.dir. If the mapred.system.dir contains user files with permissions other than 777 then the jobtracker gets stuck in a loop trying to delete the mapred.system.dir (and each time failing with AccessControlException). The JobTracker admin has to manually cleanup the mapred.system.dir if this happens.

      Attachments

        1. MAPREDUCE-807-v1.7-branch-0.20.patch
          7 kB
          Amar Kamat
        2. MAPREDUCE-807-v1.6-branch-0.20.patch
          7 kB
          Amar Kamat
        3. MAPRED-807-v1.7.patch
          13 kB
          Amar Kamat
        4. MAPRED-807-v1.6.patch
          13 kB
          Amar Kamat
        5. MAPRED-807-v1.4.patch
          2 kB
          Amar Kamat
        6. MAPRED-807-v1.3.patch
          2 kB
          Amar Kamat
        7. MAPRED-807-v1.2.patch
          0.7 kB
          Amar Kamat
        8. MAPRED-807-v1.1.patch
          0.7 kB
          Amar Kamat

        Activity

          People

            amar_kamat Amar Kamat
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: