Pig
  1. Pig
  2. PIG-924

Make Pig work with multiple versions of Hadoop

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      The current Pig build scripts package hadoop and other dependencies into the pig.jar file.
      This means that if users upgrade Hadoop, they also need to upgrade Pig.

      Pig has relatively few dependencies on Hadoop interfaces that changed between 18, 19, and 20. It is possibly to write a dynamic shim that allows Pig to use the correct calls for any of the above versions of Hadoop. Unfortunately, the building process precludes us from the ability to do this at runtime, and forces an unnecessary Pig rebuild even if dynamic shims are created.

      1. pig_924.patch
        43 kB
        Dmitriy V. Ryaboy
      2. pig_924.3.patch
        39 kB
        Dmitriy V. Ryaboy
      3. pig_924.2.patch
        42 kB
        Dmitriy V. Ryaboy

        Issue Links

          Activity

            People

            • Assignee:
              Dmitriy V. Ryaboy
              Reporter:
              Dmitriy V. Ryaboy
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development