[PIG-2554] /tmp/temp* pig temporary directories should be unique.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.8.0, 0.9.0, 0.9.1
• Assignee: Unassigned
• Reporter: Mitesh Singh Jat
• Created: 24/Feb/12 09:25
• Updated: 11/Feb/15 18:28
• Resolved: 11/Feb/15 18:28

Description

The /tmp/temp* directory is generated using Random.nextInt(). The collision of the random integers generated may occur. This issue was seen quite a few times.

4418 [main] ERROR org.apache.pig.tools.grunt.Grunt  - You don't have permission to perform the operation. Error from
the server: org.apache.hadoop.security.AccessControlException: Permission denied: user=user1, access=EXECUTE,
inode="temp-1980965992":user2:hdfs:rwx------
4419 [main] ERROR org.apache.pig.tools.grunt.Grunt  - ERROR 6007: Unable to check name
hdfs://nn1/tmp/temp-1980965992/tmp-33521837
4430 [main] ERROR org.apache.pig.impl.io.FileLocalizer  - org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied: user=user1, access=ALL,
inode="temp-1980965992":user2:hdfs:rwx------

A workaround is to change the base directory(for some group) pig.temp.dir to avoid this rare conflict.
for example:

pig -Dpig.temp.dir=/tmp/$USER/$RANDOM pig_script.pig

Issue Links

• duplicates: PIG-3874 FileLocalizer temp path can sometimes be non-unique