[PIG-3731] Ability to specify local-mode specific configuration (useful for local/auto-local mode)

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Assignee: Aniket Namadeo Mokashi
• Reporter: Aniket Namadeo Mokashi
• Created: 29/Jan/14 23:33
• Updated: 07/Jul/14 18:08
• Resolved: 07/Mar/14 07:03

Description

This could be done in several ways, however, adding a namespace (pig.local.) for this is better so that only a few number of jobs that require this can make use of it.

set pig.local.io.sort.mb 50 will set io.sort.mb=50 for local mode jobs allowing many jobs to run in parallel. Another setting that might be required is - io.compression.codecs.

Issue Links

• relates to: PIG-3745 Document auto local mode for pig