Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2753

Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOT

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: build
    • Labels:
      None
    • Environment:

      RHEL 6.1 & Ubuntu 11.04; Sun JDK 1.6_016 & Sun JDK 1.6.0_26; Ant 1.8.2

    • Hadoop Flags:
      Reviewed

      Description

      The generated poms inject the version of mapred itself, but hardcode the version of hadoop-common they depend on.
      When trying to build downstream projects (HBase), then they will require hadoop-common-0.22.0-SNAPSHOT.jar instead of the version they compiled against.

      When trying to do an offline build this will fail to resolve as another hadoop-common has been installed in the local maven repo.
      Even during online build, it should compile against the hadoop-common that hdfs compiled against.

      When versions mismatch one cannot do a coherent build. That is particularly problematic when making simultaneous change in hadoop-common and hadoop-mapreduce and you want to try this locally before committing each.

      1. MAPREDUCE-2753-1.patch
        2 kB
        Joep Rottinghuis
      2. MAPREDUCE-2753.patch
        13 kB
        Joep Rottinghuis

        Issue Links

          Activity

          Hide
          Joep Rottinghuis added a comment -

          Wrong patch for this issue.

          Show
          Joep Rottinghuis added a comment - Wrong patch for this issue.
          Hide
          Joep Rottinghuis added a comment -

          Uploaded new patch MAPREDUCE-2753-1.patch

          Show
          Joep Rottinghuis added a comment - Uploaded new patch MAPREDUCE-2753 -1.patch
          Hide
          Konstantin Boudnik added a comment -

          +1 patch looks good. I can see that correct version is generated in the newly installed pom file for MR artifacts.

          Show
          Konstantin Boudnik added a comment - +1 patch looks good. I can see that correct version is generated in the newly installed pom file for MR artifacts.
          Hide
          Konstantin Boudnik added a comment -

          I have just committed it. Thanks Joep.

          Show
          Konstantin Boudnik added a comment - I have just committed it. Thanks Joep.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-22-branch #62 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/62/)
          MAPREDUCE-2753. Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOT. Contributed by Joep Rottinghuis.

          cos : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1154806
          Files :

          • /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
          • /hadoop/common/branches/branch-0.22/mapreduce/build.xml
          • /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-mapred-instrumented-template.xml
          • /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-mapred-template.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-22-branch #62 (See https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/62/ ) MAPREDUCE-2753 . Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOT. Contributed by Joep Rottinghuis. cos : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1154806 Files : /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt /hadoop/common/branches/branch-0.22/mapreduce/build.xml /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-mapred-instrumented-template.xml /hadoop/common/branches/branch-0.22/mapreduce/ivy/hadoop-mapred-template.xml

            People

            • Assignee:
              Joep Rottinghuis
              Reporter:
              Joep Rottinghuis
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development