Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-924

Make Pig work with multiple versions of Hadoop

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      The current Pig build scripts package hadoop and other dependencies into the pig.jar file.
      This means that if users upgrade Hadoop, they also need to upgrade Pig.

      Pig has relatively few dependencies on Hadoop interfaces that changed between 18, 19, and 20. It is possibly to write a dynamic shim that allows Pig to use the correct calls for any of the above versions of Hadoop. Unfortunately, the building process precludes us from the ability to do this at runtime, and forces an unnecessary Pig rebuild even if dynamic shims are created.

        Attachments

        1. pig_924.2.patch
          42 kB
          Dmitriy V. Ryaboy
        2. pig_924.3.patch
          39 kB
          Dmitriy V. Ryaboy
        3. pig_924.patch
          43 kB
          Dmitriy V. Ryaboy

          Issue Links

            Activity

              People

              • Assignee:
                dvryaboy Dmitriy V. Ryaboy
                Reporter:
                dvryaboy Dmitriy V. Ryaboy
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: