Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3557

MR1 test fail to compile because of missing hadoop-archives dependency

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 0.24.0
    • Fix Version/s: 0.23.1
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      MAPREDUCE-3544 added hadoop-archives as dependency to gridmix and raid, but missed to add it to the main ivy.xml for the MR1 testcases thus the ant target 'compile-mapred-test' fails.

      I was under the impression that this stuff was not used anymore but trunk is failing on that target.

      1. MAPREDUCE-3557.patch
        0.6 kB
        Alejandro Abdelnur

        Activity

        Hide
        Alejandro Abdelnur added a comment -

        patch fixes the not found HadoopArchives compilation issue.

        However, there is another failure coming up that is not related at all to the HAR stuff shuffling

        compile-mapred-test:
            [javac] /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/build.xml:603: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
            [javac] Compiling 304 source files to /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/build/test/mapred/classes
            [javac] /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobQueueClient.java:80: printJobQueueInfo(org.apache.hadoop.mapred.JobQueueInfo,java.io.Writer,java.lang.String) in org.apache.hadoop.mapred.JobQueueClient cannot be applied to (org.apache.hadoop.mapred.JobQueueInfo,java.io.StringWriter)
            [javac]     client.printJobQueueInfo(root, writer);
            [javac]           ^
            [javac] Note: Some input files use or override a deprecated API.
            [javac] Note: Recompile with -Xlint:deprecation for details.
            [javac] 1 error
        
        BUILD FAILED
        

        If we really need to run this target, then this patch should be committed and another JIRA should be open for the above failure.

        If we don't need to run this target, this JIRA should be closed as invalid and the Jenkins job for trunk should be fixed to avoid such target

        Show
        Alejandro Abdelnur added a comment - patch fixes the not found HadoopArchives compilation issue. However, there is another failure coming up that is not related at all to the HAR stuff shuffling compile-mapred-test: [javac] /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/build.xml:603: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds [javac] Compiling 304 source files to /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/build/test/mapred/classes [javac] /Users/tucu/src/apache/hadoop/git/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobQueueClient.java:80: printJobQueueInfo(org.apache.hadoop.mapred.JobQueueInfo,java.io.Writer,java.lang. String ) in org.apache.hadoop.mapred.JobQueueClient cannot be applied to (org.apache.hadoop.mapred.JobQueueInfo,java.io.StringWriter) [javac] client.printJobQueueInfo(root, writer); [javac] ^ [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] 1 error BUILD FAILED If we really need to run this target, then this patch should be committed and another JIRA should be open for the above failure. If we don't need to run this target, this JIRA should be closed as invalid and the Jenkins job for trunk should be fixed to avoid such target
        Hide
        Jonathan Eagles added a comment -

        The above failure is handled by MAPREDUCE-3541

        Show
        Jonathan Eagles added a comment - The above failure is handled by MAPREDUCE-3541
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12507361/MAPREDUCE-3557.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1445//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1445//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12507361/MAPREDUCE-3557.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1445//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1445//console This message is automatically generated.
        Hide
        Mahadev konar added a comment -

        +1 patch looks good.

        Show
        Mahadev konar added a comment - +1 patch looks good.
        Hide
        Alejandro Abdelnur added a comment -

        committed to trunk and branch-0.23

        Show
        Alejandro Abdelnur added a comment - committed to trunk and branch-0.23
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1430 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1430/)
        MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1430 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1430/ ) MAPREDUCE-3557 . MR1 test fail to compile because of missing hadoop-archives dependency. (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #277 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/277/)
        Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #277 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/277/ ) Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #287 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/287/)
        Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #287 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/287/ ) Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1504 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1504/)
        MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1504 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1504/ ) MAPREDUCE-3557 . MR1 test fail to compile because of missing hadoop-archives dependency. (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #299 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/299/)
        Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #299 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/299/ ) Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1453 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1453/)
        MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1453 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1453/ ) MAPREDUCE-3557 . MR1 test fail to compile because of missing hadoop-archives dependency. (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #126 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/126/)
        Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #126 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/126/ ) Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #108 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/108/)
        Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #108 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/108/ ) Merge -r 1214353:1214354 from trunk to branch. FIXES: MAPREDUCE-3557 tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214358 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/ivy.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #928 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/928/)
        MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)

        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #928 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/928/ ) MAPREDUCE-3557 . MR1 test fail to compile because of missing hadoop-archives dependency. (tucu) tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1214354 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/ivy.xml

          People

          • Assignee:
            Alejandro Abdelnur
            Reporter:
            Alejandro Abdelnur
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development