Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2741

Make ant build system work with hadoop-common JAR generated by Maven

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Some tweaks must be done in MAPRED & its contribs ivy configuration to work with HADOOP-6671.

      This wil be a temporary fix until MAPRED is mavenized.

      1. MAPREDUCE-2741.patch
        14 kB
        Tom White
      2. MAPRED-2741.patch
        13 kB
        Alejandro Abdelnur

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          2m 11s 1 Alejandro Abdelnur 28/Jul/11 23:38
          Patch Available Patch Available Open Open
          15h 22m 1 Alejandro Abdelnur 29/Jul/11 15:01
          Open Open Resolved Resolved
          4d 5h 48m 1 Tom White 02/Aug/11 20:50
          Resolved Resolved Closed Closed
          104d 3h 58m 1 Arun C Murthy 15/Nov/11 00:48
          Gavin made changes -
          Link This issue depends upon HADOOP-6671 [ HADOOP-6671 ]
          Gavin made changes -
          Link This issue depends on HADOOP-6671 [ HADOOP-6671 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #751 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/)
          MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur.

          tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209
          Files :

          • /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #751 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/751/ ) MAPREDUCE-2741 . Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209 Files : /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/mapreduce/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #760 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/)
          MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur.

          tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209
          Files :

          • /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/mapreduce/CHANGES.txt
          • /hadoop/common/trunk/mapreduce/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #760 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/760/ ) MAPREDUCE-2741 . Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur. tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1153209 Files : /hadoop/common/trunk/mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/dynamic-scheduler/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/mapreduce/CHANGES.txt /hadoop/common/trunk/mapreduce/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vaidya/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/vertica/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/mapreduce/src/contrib/fairscheduler/ivy.xml
          Tom White made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Hide
          Tom White added a comment -

          I've committed this. Thanks, Alejandro.

          Show
          Tom White added a comment - I've committed this. Thanks, Alejandro.
          Hide
          Alejandro Abdelnur added a comment -

          Thxs Tom

          Show
          Alejandro Abdelnur added a comment - Thxs Tom
          Tom White made changes -
          Attachment MAPREDUCE-2741.patch [ 12488271 ]
          Hide
          Tom White added a comment -

          Here's a working patch that does a full tar build with Common built by Maven. I used ivy module-wide excludes (http://ant.apache.org/ivy/history/2.1.0/ivyfile/exclude.html) to exclude the problematic transitive dependencies since I couldn't see where they were being pulled in.

          Show
          Tom White added a comment - Here's a working patch that does a full tar build with Common built by Maven. I used ivy module-wide excludes ( http://ant.apache.org/ivy/history/2.1.0/ivyfile/exclude.html ) to exclude the problematic transitive dependencies since I couldn't see where they were being pulled in.
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Alejandro Abdelnur added a comment -

          examples build (when doing ant tar) is failing as it tries to pull jmx/jms & co.

          Show
          Alejandro Abdelnur added a comment - examples build (when doing ant tar) is failing as it tries to pull jmx/jms & co.
          Alejandro Abdelnur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Alejandro Abdelnur made changes -
          Attachment MAPRED-2741.patch [ 12488154 ]
          Hide
          Alejandro Abdelnur added a comment -

          it requires JARs generated by HADOOP-6671.

          Edits MAPRED and all its contribs ivy.xml.

          Show
          Alejandro Abdelnur added a comment - it requires JARs generated by HADOOP-6671 . Edits MAPRED and all its contribs ivy.xml.
          Alejandro Abdelnur made changes -
          Field Original Value New Value
          Link This issue depends on HADOOP-6671 [ HADOOP-6671 ]
          Alejandro Abdelnur created issue -

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development