Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1790

Automatic resolution of Lzo codecs is needed.

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None
    • Environment:

      Herriot system test case automation

      Description

      The test cases are failing due to non-availablity of the jar hadoop-gpl-compression-0.1.0-1005060043.jar, need changes to aop xml to fix this.

      1. build_change.patch
        0.6 kB
        Balaji Rajagopalan
      2. ivy_lzcodec_1.patch
        2 kB
        Balaji Rajagopalan
      3. ivy_lzcodec.patch
        2 kB
        Balaji Rajagopalan
      4. lzcodec_fix.txt
        0.9 kB
        Balaji Rajagopalan

        Issue Links

          Activity

          Hide
          Konstantin Boudnik added a comment -

          Sorry, is it two patches for the same JIRA? If so, please combine them together - having multiple patches for the same fix is a pretty bad idea for some apparent reasons.

          Show
          Konstantin Boudnik added a comment - Sorry, is it two patches for the same JIRA? If so, please combine them together - having multiple patches for the same fix is a pretty bad idea for some apparent reasons.
          Hide
          Balaji Rajagopalan added a comment -

          Failed to get the build.xml changes with previous checkin.

          Show
          Balaji Rajagopalan added a comment - Failed to get the build.xml changes with previous checkin.
          Hide
          Konstantin Boudnik added a comment -

          I don't see from where lib.file.path is coming....
          I have applied this patch to 0.20S and all my tests are failing with ClassNotFoundException

          Show
          Konstantin Boudnik added a comment - I don't see from where lib.file.path is coming.... I have applied this patch to 0.20S and all my tests are failing with ClassNotFoundException
          Hide
          Balaji Rajagopalan added a comment -

          latest patch from giri.

          Show
          Balaji Rajagopalan added a comment - latest patch from giri.
          Hide
          Konstantin Boudnik added a comment -

          +1 patch looks good and does what is expected: the gpl codes jar is pulled into the build directory.

          Show
          Konstantin Boudnik added a comment - +1 patch looks good and does what is expected: the gpl codes jar is pulled into the build directory.
          Hide
          Konstantin Boudnik added a comment -

          It'd be nice to have the same for the trunk

          Show
          Konstantin Boudnik added a comment - It'd be nice to have the same for the trunk
          Hide
          Balaji Rajagopalan added a comment -

          This patch is provided by giri.

          Show
          Balaji Rajagopalan added a comment - This patch is provided by giri.
          Hide
          Giridharan Kesavan added a comment -

          The idea is to get the hadoop-gpl-compression.jar to the maven repository and resolve it through ivy.

          Show
          Giridharan Kesavan added a comment - The idea is to get the hadoop-gpl-compression.jar to the maven repository and resolve it through ivy.
          Hide
          Balaji Rajagopalan added a comment -

          Giri is working towards a fix for this issue.

          Show
          Balaji Rajagopalan added a comment - Giri is working towards a fix for this issue.
          Hide
          Balaji Rajagopalan added a comment -

          I have attached the fix, to fix the automation in the hudson build server, the env variable hadoop.externaljar.dir has to be passed using -D option. example,

          ant test-system -Dhadoop.conf.dir.deployed=$conf_dir -Dhadoop.externaljar.dir=$external_jar_dir -Dtestcase=TestJobKillhsitory

          and make sure the
          hadoop-gpl-compression-0.1.0-1005060043.jar is present in the external jar directory.

          Please give me your comments.

          Show
          Balaji Rajagopalan added a comment - I have attached the fix, to fix the automation in the hudson build server, the env variable hadoop.externaljar.dir has to be passed using -D option. example, ant test-system -Dhadoop.conf.dir.deployed=$conf_dir -Dhadoop.externaljar.dir=$external_jar_dir -Dtestcase=TestJobKillhsitory and make sure the hadoop-gpl-compression-0.1.0-1005060043.jar is present in the external jar directory. Please give me your comments.

            People

            • Assignee:
              Giridharan Kesavan
              Reporter:
              Balaji Rajagopalan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development