Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5565

job clean up fails on secure cluster as the file system is not created in the context of the ugi running the job

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 1.2.1
    • Fix Version/s: 1.3.0
    • Component/s: jobtracker
    • Labels:
      None

      Description

      On secure clusters we see the following exceptions in the jt log

      2013-10-04 04:52:31,753 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:tt/host@REALM cause:javax.security.sasl.SaslException: GSS
      initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      

      And after the job finishes the staging dir is not cleaned up. While debugging with Arun C Murthy we determined that file system object needs to be created in the the context of the user who ran the job.

      Job however successfully completes

        Attachments

        1. MAPREDUCE-5565.patch
          1 kB
          Arun C Murthy
        2. MAPREDUCE-5565.patch
          1 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              arpitgupta Arpit Gupta
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: