[PIG-1489] Pig MapReduceLauncher does not use jars in register statement

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Hadoop Flags: Reviewed
• Assignee: Richard Ding
• Reporter: Olga Natkovich
• Created: 08/Jul/10 22:03
• Updated: 17/Dec/10 22:44
• Resolved: 26/Jul/10 17:03

Description

If my Pig StorFunc has its own OutputFormat class then Pig MapReducelauncher will try to instantiate it before
launching the mapreduce job and fail with ClassNotFoundException.

This happens because Pig MapReduce launcher uses its own classloader and ignores the classes in the jars in the
register statement.

The effect is that the jars not only have to be in "register " statement in the script but also in the pig
classpath with the -classpath tag.

This can be remedied by making the Pig MapReduceLauncher constructing a classloader that includes the registered jars
and using that to instantiate the OutputFormat class.