Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.1
    • Component/s: security
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There are 11 failures on TestTaskTrackerLocalization .

      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testUserLocalization
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testJobLocalization
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testJobLocalizationFailsIfLogDirUnwritable
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTaskLocalization
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTaskFilesRemoval
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testFailedTaskFilesRemoval
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTaskFilesRemovalWithJvmUse
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testJobFilesRemoval
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTrackerRestart
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTrackerReinit
      org.apache.hadoop.mapred.TestTaskTrackerLocalization.testCleanupTaskLocalization

        Issue Links

          Activity

          Hide
          Benoy Antony added a comment -

          The following are the failures :

          Stacktrace

          java.lang.NullPointerException
          at org.apache.hadoop.mapreduce.server.tasktracker.Localizer.initializeUserDirs(Localizer.java:112)
          at org.apache.hadoop.mapred.TestTaskTrackerLocalization.__CLR3_0_2la3cg315k3(TestTaskTrackerLocalization.java:392)
          at org.apache.hadoop.mapred.TestTaskTrackerLocalization.testUserLocalization(TestTaskTrackerLocalization.java:387

          -----------------------------------

          java.lang.NullPointerException
          at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1188)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:396)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1207)
          at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1183)
          at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1102)
          at org.apache.hadoop.mapred.TestTaskTrackerLocalization.__CLR3_0_2mape4r15kz(TestTaskTrackerLocalization.java:466)
          at org.apache.hadoop.mapred.TestTaskTrackerLocalization.testJobLocalization(TestTaskTrackerLocalization.java:462)

          Show
          Benoy Antony added a comment - The following are the failures : Stacktrace java.lang.NullPointerException at org.apache.hadoop.mapreduce.server.tasktracker.Localizer.initializeUserDirs(Localizer.java:112) at org.apache.hadoop.mapred.TestTaskTrackerLocalization.__CLR3_0_2la3cg315k3(TestTaskTrackerLocalization.java:392) at org.apache.hadoop.mapred.TestTaskTrackerLocalization.testUserLocalization(TestTaskTrackerLocalization.java:387 ----------------------------------- java.lang.NullPointerException at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1188) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1207) at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1183) at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1102) at org.apache.hadoop.mapred.TestTaskTrackerLocalization.__CLR3_0_2mape4r15kz(TestTaskTrackerLocalization.java:466) at org.apache.hadoop.mapred.TestTaskTrackerLocalization.testJobLocalization(TestTaskTrackerLocalization.java:462)
          Hide
          Benoy Antony added a comment -

          Fixed issues by adding proper initialization code to the test. The test also depends on the ability to set DistributedCacheManager on TaskTracker.
          Added a function to set this.

          Show
          Benoy Antony added a comment - Fixed issues by adding proper initialization code to the test. The test also depends on the ability to set DistributedCacheManager on TaskTracker. Added a function to set this.
          Hide
          Konstantin Shvachko added a comment -

          +1
          I just committed this to branch 0.22.1. Thank you Benoy.

          Show
          Konstantin Shvachko added a comment - +1 I just committed this to branch 0.22.1. Thank you Benoy.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-22-branch #104 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/104/)
          MAPREDUCE-4247. Fix TestTaskTrackerLocalization. Contributed by Benoy Antony. (Revision 1346279)

          Result = SUCCESS
          shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346279
          Files :

          • /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
          • /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/TaskTracker.java
          • /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
          • /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestTaskTrackerLocalization.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-22-branch #104 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/104/ ) MAPREDUCE-4247 . Fix TestTaskTrackerLocalization. Contributed by Benoy Antony. (Revision 1346279) Result = SUCCESS shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346279 Files : /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/TaskTracker.java /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestTaskTrackerLocalization.java

            People

            • Assignee:
              Benoy Antony
              Reporter:
              Benoy Antony
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development