[PIG-4349] Avoid shipping same jar twice for a pig script

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.14.0
• Assignee: Unassigned
• Reporter: Rohini Palaniswamy
• Created: 01/Dec/14 22:25
• Updated: 01/Dec/14 22:25

Description

If a pig script has n number of jobs, then for each job all the dependencies are shipped to HDFS again to a different tmp location before being added to DistributedCache. Need to dedup and reuse.