Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-924

Make Pig work with multiple versions of Hadoop

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • None
    • None

    Description

      The current Pig build scripts package hadoop and other dependencies into the pig.jar file.
      This means that if users upgrade Hadoop, they also need to upgrade Pig.

      Pig has relatively few dependencies on Hadoop interfaces that changed between 18, 19, and 20. It is possibly to write a dynamic shim that allows Pig to use the correct calls for any of the above versions of Hadoop. Unfortunately, the building process precludes us from the ability to do this at runtime, and forces an unnecessary Pig rebuild even if dynamic shims are created.

      Attachments

        1. pig_924.patch
          43 kB
          Dmitriy V. Ryaboy
        2. pig_924.3.patch
          39 kB
          Dmitriy V. Ryaboy
        3. pig_924.2.patch
          42 kB
          Dmitriy V. Ryaboy

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. PIG-660 Integration with Hadoop 0.20

          • Major - Major loss of function.
          • Closed

          Activity

            People

              dvryaboy Dmitriy V. Ryaboy
              dvryaboy Dmitriy V. Ryaboy
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: