[HDFS-4205] fsck fails with symlinks

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.2-alpha, 3.0.0-alpha1
• Fix Version/s: 2.1.0-beta, 0.23.9
• Component/s: hdfs-client
• Target Version/s: 0.23.9
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Andy Isaacson
• Created: 17/Nov/12 00:54
• Updated: 12/May/16 18:14
• Resolved: 22/Jun/13 01:05

Description

I created a symlink using

...
    FileContext fc = FileContext.getFileContext(dst.fs.getUri());
    for (PathData src : srcs) {
      fc.createSymlink(src.path, dst.path, false);
    }

After doing this to create a symlink /foo/too.txt -> /foo/hello.txt, I tried to hdfs fsck and got the following:

[adi@host01 ~]$ hdfs fsck /
Connecting to namenode via http://host01:21070
FSCK started by adi (auth:SIMPLE) from /172.29.122.91 for path / at Fri Nov 16 15:59:18 PST 2012
FSCK ended at Fri Nov 16 15:59:18 PST 2012 in 3 milliseconds
hdfs://host01:21020/foo/hello.txt


Fsck on path '/' FAILED

It's very surprising that an unprivileged user can run code which so easily causes a fundamental administration tool to fail.

Issue Links

• relates to: HADOOP-7905 Port FileContext symlinks to FileSystem
• relates to: HADOOP-8040 Add symlink support to FileSystem
• relates to: HADOOP-6424 Port FsShell to FileContext