[PIG-1814] mapred.output.compress in SET statement does not work

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.9.0
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 20/Jan/11 22:22
• Updated: 04/Aug/11 00:34
• Resolved: 25/Apr/11 21:42

Description

Setting output compression using "SET" in the script does not work:
SET mapred.output.compress true;
SET mapred.output.compression.codec org.apache.hadoop.io.compress.GzipCodec;

We did some trick to make individual compression setting for multistore work. Instead of the above parameter, using the following works:
SET output.compression.enabled true;
SET output.compression.codec org.apache.hadoop.io.compress.GzipCodec;

However, this is against intuition. We should use mapred.output.compress/mapred.output.compression.codec.

Issue Links

• relates to: PIG-1714 Option mapred.output.compress doesn't work in Pig 0.8 but worked in 0.7