Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1352

0.21.0 - snapshot incorrect dependency published in .pom files

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: build
    • Labels:
      None

      Description

      The snapshot available here at -
      https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ , has an incorrect dependency specified for hadoop-core ( in the .pom file ).

      The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in ivy/libaries.properties but pom.xml published in the repository refers to 0.22 . Please fix the same by republishing a .pom again.

      1. mapreduce-1352.patch
        0.5 kB
        Giridharan Kesavan

        Issue Links

          Activity

          Hide
          Karthik K added a comment -

          Marking this as critical since HBASE-1433 (ivy configuration of hbase ) is not successful because of this confusion.

          Also - if possible a fresh upload of the jars , along with the sources , into the maven repository would be useful.

          Show
          Karthik K added a comment - Marking this as critical since HBASE-1433 (ivy configuration of hbase ) is not successful because of this confusion. Also - if possible a fresh upload of the jars , along with the sources , into the maven repository would be useful.
          Hide
          Giridharan Kesavan added a comment -

          this patch updates the version in the template pom file

          Show
          Giridharan Kesavan added a comment - this patch updates the version in the template pom file
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12429322/mapreduce-1352.patch
          against trunk revision 894964.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed core unit tests.

          -1 contrib tests. The patch failed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12429322/mapreduce-1352.patch against trunk revision 894964. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/353/console This message is automatically generated.
          Hide
          stack added a comment -

          Unless objection, I'll commit this patch in next day or so (A change in pom can't have associated unit tests so ignoring the -1s above).

          Show
          stack added a comment - Unless objection, I'll commit this patch in next day or so (A change in pom can't have associated unit tests so ignoring the -1s above).
          Hide
          stack added a comment -

          Or, in case some one else wants to commit it: +1.

          Show
          stack added a comment - Or, in case some one else wants to commit it: +1.
          Hide
          stack added a comment -

          Now I see that there were test failures too. 3 look to have been present before application of this patch. This failure might be related to this change: org.apache.hadoop.mapreduce.TestMRJobClient.testMissingProfileOutput .

          Show
          stack added a comment - Now I see that there were test failures too. 3 look to have been present before application of this patch. This failure might be related to this change: org.apache.hadoop.mapreduce.TestMRJobClient.testMissingProfileOutput .
          Hide
          Karthik K added a comment -

          Are we looking at the trunk ( 0.22, I guess ) or 0.21 branch. Since the 0.21 branch seems to have a quite a lot of failures - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/ .

          That might be because - mapreduce-0.21 , depends on hdfs-0.21 , that in turn depends on hadoop-core-0.22 by mistake and hence causing strange dynamic link issues.

          So - we can have this as a dependency on HDFS-869 , get a green build on hdfs trunk with revised .pom and then retry this again.

          Show
          Karthik K added a comment - Are we looking at the trunk ( 0.22, I guess ) or 0.21 branch. Since the 0.21 branch seems to have a quite a lot of failures - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/ . That might be because - mapreduce-0.21 , depends on hdfs-0.21 , that in turn depends on hadoop-core-0.22 by mistake and hence causing strange dynamic link issues. So - we can have this as a dependency on HDFS-869 , get a green build on hdfs trunk with revised .pom and then retry this again.
          Hide
          Karthik K added a comment -

          HDFS-869 is in now and republished.

          @Giri: Can we help get this patch applied on branch-0.21 too .

          Also the most recently build on hudson for 0.21 - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/51/testReport/org.apache.hadoop.cli/TestMRCLI/testAll/

          fails with the same dynamic linking error that we are facing in hbase currently. Can you help commit the patch and get a new build to see if this still persists. Thanks.

          Show
          Karthik K added a comment - HDFS-869 is in now and republished. @Giri: Can we help get this patch applied on branch-0.21 too . Also the most recently build on hudson for 0.21 - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/51/testReport/org.apache.hadoop.cli/TestMRCLI/testAll/ fails with the same dynamic linking error that we are facing in hbase currently. Can you help commit the patch and get a new build to see if this still persists. Thanks.
          Hide
          Karthik K added a comment -

          It seems like the artifacts published on https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ are not from branch-0.21 .

          TODO:

          • Checkin the patch to branch-0.21
          • Republish hadoop-mapred and hadoop-mapred-test from the same.

          That should resolve the dynamic link issue faced by HBASE-1433 . Thanks for taking this on a priority since it is blocking the ivy configuration of hbase.

          Show
          Karthik K added a comment - It seems like the artifacts published on https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ are not from branch-0.21 . TODO: Checkin the patch to branch-0.21 Republish hadoop-mapred and hadoop-mapred-test from the same. That should resolve the dynamic link issue faced by HBASE-1433 . Thanks for taking this on a priority since it is blocking the ivy configuration of hbase.
          Hide
          Karthik K added a comment -

          @Giri / @stack - can you help with the publishing this patch to the branch / republishing artifacts to validate hbase-1433 before that patch could be taken up for consideration with hbase community.

          Show
          Karthik K added a comment - @Giri / @stack - can you help with the publishing this patch to the branch / republishing artifacts to validate hbase-1433 before that patch could be taken up for consideration with hbase community.
          Hide
          Karthik K added a comment -

          Thanks Giri. Looks good with the revised upload to apache mapred snapshots. The builds in hudson are failing (for branch-0.21 - mapreduce ) though . We need to make sure that is consistent - but that is not immediately affecting hbase at the moment though ( Seems like an environment / CP issue ).

          Show
          Karthik K added a comment - Thanks Giri. Looks good with the revised upload to apache mapred snapshots. The builds in hudson are failing (for branch-0.21 - mapreduce ) though . We need to make sure that is consistent - but that is not immediately affecting hbase at the moment though ( Seems like an environment / CP issue ).

            People

            • Assignee:
              Giridharan Kesavan
              Reporter:
              Karthik K
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development