Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: security, test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed JobTracker to use it's own credentials instead of the job's credentials for accessing mapred.system.dir. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration.

      Description

      While running TestMiniMRWithDFSWithDistinctUsers, I used this patch to test the ugi checks

      Index: src/hdfs/org/apache/hadoop/hdfs/server/namenode/PermissionChecker.java
      ===================================================================
      --- src/hdfs/org/apache/hadoop/hdfs/server/namenode/PermissionChecker.java	(revision 768189)
      +++ src/hdfs/org/apache/hadoop/hdfs/server/namenode/PermissionChecker.java	(working copy)
      @@ -40,6 +40,7 @@
           if (LOG.isDebugEnabled()) {
             LOG.debug("ugi=" + ugi);
           }
      +    LOG.info("ugi=" + ugi);
       
           if (ugi != null) {
             user = ugi.getUserName();
      

      While initializing a job, the ugi information should point to jobtracker as jobtracker does a dfs read. But today we will see that the log shows pi as the caller instead of the jobtracker.

      1. HADOOP-5737-v1.3.patch
        4 kB
        Amar Kamat
      2. HADOOP-5737-v1.5.patch
        10 kB
        Amar Kamat
      3. HADOOP-5737-v1.7.patch
        19 kB
        Amar Kamat
      4. HADOOP-5737-y20.patch
        10 kB
        Hemanth Yamijala

        Issue Links

          Activity

          Amar Kamat created issue -
          Amar Kamat made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-3578 [ HADOOP-3578 ]
          Amar Kamat made changes -
          Summary UGI checks in testcases is broken UGI checks in testcases are broken
          Amar Kamat made changes -
          Attachment HADOOP-5737-v1.3.patch [ 12407325 ]
          Tsz Wo Nicholas Sze made changes -
          Assignee Amar Kamat [ amar_kamat ]
          Component/s mapred [ 12310690 ]
          Component/s test [ 12311440 ]
          Amar Kamat made changes -
          Attachment HADOOP-5737-v1.5.patch [ 12407596 ]
          Amar Kamat made changes -
          Attachment HADOOP-5737-v1.7.patch [ 12407694 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.21.0 [ 12313563 ]
          Resolution Fixed [ 1 ]
          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]
          Hemanth Yamijala made changes -
          Attachment HADOOP-5737-y20.patch [ 12430029 ]
          Vinod Kumar Vavilapalli made changes -
          Component/s security [ 12312526 ]
          Component/s test [ 12311440 ]
          Ravi Gummadi made changes -
          Release Note Uses JobTracker's credentials for accessing mapred.system.dir instead of using job's credentials.
          Vinod Kumar Vavilapalli made changes -
          Release Note Uses JobTracker's credentials for accessing mapred.system.dir instead of using job's credentials. Fixed a problem in the way the JobTracker used to talk to other daemons like the NameNode to get the job's files. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration.
          Vinod Kumar Vavilapalli made changes -
          Release Note Fixed a problem in the way the JobTracker used to talk to other daemons like the NameNode to get the job's files. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration. Fixed JobTracker to use it's own credentials instead of the job's credentials for accessing mapred.system.dir. Also added APIs in the JobTracker to get the FileSystem objects as per the JobTracker's configuration.
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development