Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5565

job clean up fails on secure cluster as the file system is not created in the context of the ugi running the job

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 1.2.1
    • Fix Version/s: 1.3.0
    • Component/s: jobtracker
    • Labels:
      None

      Description

      On secure clusters we see the following exceptions in the jt log

      2013-10-04 04:52:31,753 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:tt/host@REALM cause:javax.security.sasl.SaslException: GSS
      initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      

      And after the job finishes the staging dir is not cleaned up. While debugging with Arun Murthy we determined that file system object needs to be created in the the context of the user who ran the job.

      Job however successfully completes

        Attachments

        1. MAPREDUCE-5565.patch
          1 kB
          Arun Murthy
        2. MAPREDUCE-5565.patch
          1 kB
          Arun Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun Murthy
              Reporter:
              arpitgupta Arpit Gupta
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: