[HADOOP-909] dfs "du" shows that the size of a subdirectory is 0

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1
• Fix Version/s: 0.11.0
• Assignee: Hairong Kuang
• Reporter: Hairong Kuang
• Created: 19/Jan/07 01:44
• Updated: 08/Jul/09 16:42
• Resolved: 26/Jan/07 21:21

Description

dfs "du" is implemented by sending a listPaths request to the namenode to get the size of each file/subdir under the directory. At the namenode side, the size of subdir was calculated by recursively going through the whole subtree with the subdir as the root. But starting from the release 0.10.0, the size of subdir is no longer gets calculated. So dfs "du" shows its size as 0.

The problem is that both "du" and "list" send the same request "listPaths" to the namenode. The previous implmentation made list very expensive, but the current implementation makes du not working.

Issue Links

• is related to: HADOOP-713 dfs list operation is too expensive