[HDFS-2938] Recursive delete of a large directory makes namenode unresponsive

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 0.23.2
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Hari Mankude
• Reporter: Suresh Srinivas
• Created: 12/Feb/12 02:50
• Updated: 06/Jun/12 00:29
• Resolved: 15/Feb/12 22:03

Description

When deleting a large directory with millions of files, namenode holding FSNamesystem lock will make it unresponsive for other request. In this scenario HDFS-173 added a mechanism to delete blocks in smaller chunks holding the locks. With new read/write lock changes, the mechanism from HDFS-173 is lost. Need to resurrect the mechanism back. Also a good unit test/update to existing unit test is needed to catch future errors with this functionality.

Issue Links

• is related to: HDFS-173 Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes