Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2838

to fix mapreduce builds to use the new hadoop common test jars

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      maprecude builds are still resolving the old hadoop-common-test jars.. Instead ivy classifiers should be used to resolve the new hadoop-common test jars ; as maven publishes test jars with classifier tests and not as a separate artifact.

      [ivy:resolve] [SUCCESSFUL ] org.apache.hadoop#hadoop-common;0.23.0-SNAPSHOT!hadoop-common.jar (1979ms)
      [ivy:resolve] downloading https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.23.0-SNAPSHOT/hadoop-common-test-0.23.0-20110727.191243-218.jar ...
      [ivy:resolve] ........................................................................................................................ (885kB)

      1. MAPREDUCE-2838.patch
        16 kB
        Arun C Murthy
      2. MAPREDUCE-2838.patch
        19 kB
        Arun C Murthy
      3. mr-2838.patch
        20 kB
        Giridharan Kesavan

        Issue Links

          Activity

          Hide
          Arun C Murthy added a comment -

          Correct way for common/hdfs tests deps.

          Show
          Arun C Murthy added a comment - Correct way for common/hdfs tests deps.
          Hide
          Arun C Murthy added a comment -

          Updated patch, still having trouble with mumak.

          Show
          Arun C Murthy added a comment - Updated patch, still having trouble with mumak.
          Hide
          Giridharan Kesavan added a comment -

          with this patch mr compiles fine.

          PS: make sure to cleanup your ivy and maven cache before trying this patch.

          Show
          Giridharan Kesavan added a comment - with this patch mr compiles fine. PS: make sure to cleanup your ivy and maven cache before trying this patch.
          Hide
          Arun C Murthy added a comment -

          PA on giri's behalf.

          Show
          Arun C Murthy added a comment - PA on giri's behalf.
          Hide
          Arun C Murthy added a comment -

          I just committed this. Thanks Giri!

          Show
          Arun C Murthy added a comment - I just committed this. Thanks Giri!
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/850/)
          MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/850/ ) MAPREDUCE-2838 . Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #773 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/773/)
          MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #773 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/773/ ) MAPREDUCE-2838 . Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #770 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/770/)
          MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #770 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/770/ ) MAPREDUCE-2838 . Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #783 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/783/)
          MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #783 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/783/ ) MAPREDUCE-2838 . Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #764 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/764/)
          MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #764 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/764/ ) MAPREDUCE-2838 . Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160896 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/capacity-scheduler/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/build-contrib.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/raid/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/data_join/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/mumak/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/index/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/streaming/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/gridmix/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/fairscheduler/ivy.xml

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Giridharan Kesavan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development