Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2690

Adding support into build.xml to build a special hadoop jar file that has the MiniDFSCluster and MiniMRCluster classes among others necessary for building and running the unit tests of Pig on the local mini cluster

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.17.0
    • 0.17.0
    • build
    • None

    Description

      In order to build Pig and run its unit tests with ant, Pig needs to be built and run against a hadoop jar file that not only has the MiniDFSCluster and MiniMRCluster classes but also has classes from several 3rd party libraries. I added a target to the build.xml file of Hadoop for that purpose (see the "Compile code for Pig" section in the attached build.xml). I also attached the resulted hadoop jar with this report.

      Attachments

        1. jar-test_v2.patch
          3 kB
          Enis Soztutar
        2. jar-test_v1.patch
          2 kB
          Enis Soztutar
        3. hadoop-0.16.0-dev-test-utils.jar
          4.88 MB
          Xu Zhang
        4. build.xml
          43 kB
          Xu Zhang
        5. AddTestUtilsJarTarget.patch
          2 kB
          Xu Zhang

        Activity

          People

            enis Enis Soztutar
            xuzh Xu Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: