[HDFS-2703] removedStorageDirs is not updated everywhere we remove a storage dir

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.2
• Component/s: namenode
• Target Version/s: 1.0.2
• Hadoop Flags: Reviewed
• Assignee: Eli Collins
• Reporter: Eli Collins
• Created: 17/Dec/11 20:03
• Updated: 05/Apr/12 18:42
• Resolved: 20/Dec/11 05:01

Description

There are a number of places (FSEditLog#open, purgeEditLog, and rollEditLog) where we remove a storage directory but don't add it to the removedStorageDirs list. This means a storage dir may have been removed but we don't see it in the log or Web UI. This doesn't affect trunk/23 since the code there is totally different.

Issue Links

• blocks: HDFS-2702 A single failed name dir can cause the NN to exit
• is blocked by: HDFS-2701 Cleanup FS* processIOError methods