[PIG-2388] Make shim for Hadoop 0.20 and 0.23 support dynamic

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.2, 0.10.0
• Fix Version/s: 0.9.2, 0.10.0
• Assignee: Unassigned
• Reporter: Thomas Weise
• Created: 29/Nov/11 01:42
• Updated: 19/Mar/13 00:38
• Resolved: 08/Dec/11 23:30

Description

We need a single Pig installation that works with both Hadoop versions. The current shim implementation assumes different builds for each version. We can solve this statically through internal build/installation system or by making the shim dynamic so that pig.jar will work on both version with runtime detection. Attached patch is to convert the static shims into a shim interface with 2 implementations, each of which will be compiled against the respective Hadoop version and included into single pig.jar (similar to what Hive does).

The default build behavior remains unchanged, only the shim for ${hadoopversion} will be compiled. Both shims can be built via: ant -Dbuild-all-shims=true

Issue Links

• is related to: PIG-2125 Make Pig work with hadoop .NEXT
• relates to: HCATALOG-10 Shouldn't assume the secure hadoop installation