[PIG-4908] JythonFunction refers to Oozie launcher script absolute path

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16.0
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 23/May/16 16:22
• Updated: 14/Jun/16 20:19
• Resolved: 23/May/16 22:39

Description

We had a scenario where a user had multiple udfs all named udfs.py. JythonFunction was referring to the absolute localized path of udfs.py in the Oozie launcher. Tasks which ran on a node and which had a different version of udfs.py localized to same path (hashcode conflict) as the Oozie launcher failed. We should be referring to relative path of the files. The current code check is the canonical path starts with cwd, but that does not work as the files are downloaded to a different location and symlinked to the current working directory of the task attempt.