Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Target Version/s:

      Description

      TestJobConf is failing:

      testFindContainingJar
      testFindContainingJarWithPlus

      java.lang.ClassNotFoundException: ClassWithNoPackage
      at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
      at java.lang.Class.forName0(Native Method)
      at java.lang.Class.forName(Class.java:247)
      at org.apache.hadoop.mapred.TestJobConf.testJarAtPath(TestJobConf.java:78)
      at org.apache.hadoop.mapred.TestJobConf.testFindContainingJar(TestJobConf.java:44)

      Looks like perhaps a classpath issue.

      TestQueueManagerRefresh also has failures and I'm wondering might be related as it doesn't seem to pick up a config file written out to build/test/extraconf

      1. MAPREDUCE-3648.patch
        0.9 kB
        Thomas Graves
      2. MAPREDUCE-3648.patch
        1 kB
        Thomas Graves

        Activity

        Thomas Graves created issue -
        Hide
        Thomas Graves added a comment -

        looks like this was broken when mavenization of streaming happened (HADOOP-7590). It moved the ClassWithNoPackage.java from hadoop-mapreduce-project/src/test/mapred/testjar/ClassWithNoPackage.java to hadoop-tools/hadoop-streaming/src/test/java/ClassWithNoPackage.java and TestJobConf is expecting it in the testjar

        Show
        Thomas Graves added a comment - looks like this was broken when mavenization of streaming happened ( HADOOP-7590 ). It moved the ClassWithNoPackage.java from hadoop-mapreduce-project/src/test/mapred/testjar/ClassWithNoPackage.java to hadoop-tools/hadoop-streaming/src/test/java/ClassWithNoPackage.java and TestJobConf is expecting it in the testjar
        Hide
        Thomas Graves added a comment -

        simple add the ClassWithNoPackage back.

        Show
        Thomas Graves added a comment - simple add the ClassWithNoPackage back.
        Thomas Graves made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-3648.patch [ 12510000 ]
        Thomas Graves made changes -
        Assignee Thomas Graves [ tgraves ]
        Thomas Graves made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Mahadev konar added a comment -

        @Thomas,
        Is ClassWithNoPackage.java needed in hadoop-streaming? If not lets remove that and put it in test-jar. Better to have a single copy.

        Show
        Mahadev konar added a comment - @Thomas, Is ClassWithNoPackage.java needed in hadoop-streaming? If not lets remove that and put it in test-jar. Better to have a single copy.
        Hide
        Thomas Graves added a comment -

        yes its used in hadoop-tools/hadoop-streaming/src/test/javaorg/apache/hadoop/streaming/TestClassWithNoPackage.java

        Any suggestions?

        Show
        Thomas Graves added a comment - yes its used in hadoop-tools/hadoop-streaming/src/test/javaorg/apache/hadoop/streaming/TestClassWithNoPackage.java Any suggestions?
        Hide
        Thomas Graves added a comment -

        Actually I could check to see if there is another class still in the testjob.jar that I could use. Let me check on that.

        Show
        Thomas Graves added a comment - Actually I could check to see if there is another class still in the testjob.jar that I could use. Let me check on that.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12510000/MAPREDUCE-3648.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1579//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1579//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12510000/MAPREDUCE-3648.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1579//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1579//console This message is automatically generated.
        Hide
        Thomas Graves added a comment -

        changed to use a different class already in the testjob.jar file so we won't have the duplicate ClassWithNoPackage class.

        Show
        Thomas Graves added a comment - changed to use a different class already in the testjob.jar file so we won't have the duplicate ClassWithNoPackage class.
        Thomas Graves made changes -
        Attachment MAPREDUCE-3648.patch [ 12510052 ]
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12510052/MAPREDUCE-3648.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1581//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1581//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12510052/MAPREDUCE-3648.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1581//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1581//console This message is automatically generated.
        Mahadev konar made changes -
        Fix Version/s 0.23.1 [ 12318883 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Target Version/s 0.23.0 [ 12315570 ] 0.23.1 [ 12318883 ]
        Hide
        Mahadev konar added a comment -

        +1 looks good.

        Show
        Mahadev konar added a comment - +1 looks good.
        Hide
        Mahadev konar added a comment -

        I just committed this. Thanks Thomas!

        Show
        Mahadev konar added a comment - I just committed this. Thanks Thomas!
        Mahadev konar made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1600 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1600/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1600 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1600/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1527 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1527/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1527 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1527/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #365 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/365/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #365 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/365/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #355 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/355/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #355 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/355/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #376 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/376/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #376 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/376/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1546 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1546/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1546 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1546/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #923 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/923/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #923 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/923/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #136 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/136/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #136 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/136/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #158 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/158/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #158 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/158/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) - Merging r1230202 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230203 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #956 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/956/)
        MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #956 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/956/ ) MAPREDUCE-3648 . TestJobConf failing. (Thomas Graves via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230202 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobConf.java
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Thomas Graves
            Reporter:
            Thomas Graves
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development