Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2741

Make ant build system work with hadoop-common JAR generated by Maven

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Some tweaks must be done in MAPRED & its contribs ivy configuration to work with HADOOP-6671.

      This wil be a temporary fix until MAPRED is mavenized.

      1. MAPRED-2741.patch
        13 kB
        Alejandro Abdelnur
      2. MAPREDUCE-2741.patch
        14 kB
        Tom White

        Issue Links

          Activity

          Hide
          Alejandro Abdelnur added a comment -

          it requires JARs generated by HADOOP-6671.

          Edits MAPRED and all its contribs ivy.xml.

          Show
          Alejandro Abdelnur added a comment - it requires JARs generated by HADOOP-6671 . Edits MAPRED and all its contribs ivy.xml.
          Hide
          Alejandro Abdelnur added a comment -

          examples build (when doing ant tar) is failing as it tries to pull jmx/jms & co.

          Show
          Alejandro Abdelnur added a comment - examples build (when doing ant tar) is failing as it tries to pull jmx/jms & co.
          Hide
          Tom White added a comment -

          Here's a working patch that does a full tar build with Common built by Maven. I used ivy module-wide excludes (http://ant.apache.org/ivy/history/2.1.0/ivyfile/exclude.html) to exclude the problematic transitive dependencies since I couldn't see where they were being pulled in.

          Show
          Tom White added a comment - Here's a working patch that does a full tar build with Common built by Maven. I used ivy module-wide excludes ( http://ant.apache.org/ivy/history/2.1.0/ivyfile/exclude.html ) to exclude the problematic transitive dependencies since I couldn't see where they were being pulled in.
          Hide
          Alejandro Abdelnur added a comment -

          Thxs Tom

          Show
          Alejandro Abdelnur added a comment - Thxs Tom
          Hide
          Tom White added a comment -

          I've committed this. Thanks, Alejandro.

          Show
          Tom White added a comment - I've committed this. Thanks, Alejandro.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #760 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/)
          MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur.

          tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209
          Files :

          • /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #760 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/ ) MAPREDUCE-2741 . Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209 Files : /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/mapreduce/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #751 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/)
          MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur.

          tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209
          Files :

          • /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #751 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/ ) MAPREDUCE-2741 . Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209 Files : /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/mapreduce/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development