[HADOOP-10191] Missing executable permission on viewfs internal dirs

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Component/s: viewfs
• Target Version/s: 2.4.0
• Hadoop Flags: Reviewed
• Assignee: Gera Shegalov
• Reporter: Gera Shegalov
• Created: 27/Dec/13 00:59
• Updated: 04/Sep/14 01:16
• Resolved: 22/Mar/14 05:22

Description

ViewFileSystem allows 1) unconditional listing of internal directories (mount points) and 2) and changing work directories.

1) requires read permission
2) requires executable permission

However, the hardcoded PERMISSION_RRR == 444 for FileStatus representing an internal dir does not have executable bit set.

This confuses YARN localizer for public resources on viewfs because it requires executable permission for "other" on all of the ancestor directories of the resource.

java.io.IOException: Resource viewfs:/pubcache/cache.txt is not publicly accessable and as such cannot be part of the public cache.
        at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:182)
        at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:51)
        at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:279)
        at org.apache.hadoop.yarn.util.FSDownload$1.run(FSDownload.java:277)

Issue Links

• blocks: YARN-1542 Add unit test for public resource on viewfs
• relates to: HADOOP-7257 A client side mount table to give per-application/per-job file system view