[HADOOP-9652] Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Hadoop Flags: Reviewed
• Assignee: Andrew Wang Assign to me
• Reporter: Colin McCabe
• Created: 18/Jun/13 23:01
• Updated: 24/Feb/14 20:56
• Resolved: 24/Jan/14 15:51

Description

RawLocalFs#getFileLinkStatus does not actually get the owner and mode of the symlink, but instead uses the owner and mode of the symlink target. If the target can't be found, it fills in bogus values (the empty string and FsPermission.getDefault) for these.

Symlinks have an owner distinct from the owner of the target they point to, and getFileLinkStatus ought to expose this.

In some operating systems, symlinks can have a permission other than 0777. We ought to expose this in RawLocalFilesystem and other places, although we don't necessarily have to support this behavior in HDFS.

Issue Links

• breaks: MAPREDUCE-5584 ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors
• breaks: HADOOP-9782 Datanode daemon cannot be started on OS X
• breaks: HADOOP-9981 globStatus should minimize its listStatus and getFileStatus calls
• incorporates: HADOOP-9693 Shell should add a probe for OSX
• is cloned by: HADOOP-10276 RawLocalFs#getFileLinkStatus does not fill in the link owner and mode by default
• is duplicated by: HADOOP-9783 Fix OS detection for RawLocalFileSystem#getFileLinkStatus fallback path
• is duplicated by: HADOOP-9788 Add sticky bit support to org.apache.hadoop.fs.Stat
• is duplicated by: MAPREDUCE-5430 TestMRApps#testSetClasspathWithArchives is failing
• is related to: HADOOP-9371 Define Semantics of FileSystem more rigorously
• is related to: HADOOP-9788 Add sticky bit support to org.apache.hadoop.fs.Stat
• is related to: HADOOP-9769 Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped
• relates to: HADOOP-9783 Fix OS detection for RawLocalFileSystem#getFileLinkStatus fallback path
• relates to: HADOOP-8040 Add symlink support to FileSystem