[HDFS-786] Implement getContentSummary(..) in HftpFileSystem

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Hadoop Flags: Reviewed
• Assignee: Tsz-wo Sze
• Reporter: Tsz-wo Sze
• Created: 25/Nov/09 00:26
• Updated: 24/Aug/10 20:50
• Resolved: 08/Jan/10 00:56

Description

HftpFileSystem does not override getContentSummary(..). As a result, it uses FileSystem's default implementation, which computes content summary on the client side by calling listStatus(..) recursively. In contrast, DistributedFileSystem has overridden getContentSummary(..) and does the computation on the NameNode.

As a result, running "fs -dus" on hftp is much slower than running it on hdfs.