[PIG-3798] registered jar in pig script are appended to the classpath multiple times

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Labels: newbie

Environment

Apache Pig version 0.11.0-cdh4.4.0

• Assignee: Cheolsoo Park
• Reporter: Dotan Patrich
• Created: 06/Mar/14 08:33
• Updated: 07/Jul/14 18:07
• Resolved: 02/Apr/14 11:50

Description

when running several pig scripts one after another using java class PigServer, the classpath in taskjvm.sh gets longer and longer, eventually execution breaks on having a too long classpath.

The jar registered at the pig script are appended to the classpath on every execution. It seems that PigContext's skipJars member is the root cause for this as it is added jars that already exists in the list multiple times.

Issue Links

• is required by: PIG-3861 duplicate jars get added to distributed cache