[HDFS-2137] Datanode Disk Fail Inplace

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.203.0
• Fix Version/s: 0.21.0, 1.0.0
• Component/s: datanode
• Assignee: Unassigned
• Reporter: Bharath Mundlapudi
• Created: 28/Jan/11 21:07
• Updated: 14/Mar/12 04:06
• Resolved: 14/Mar/12 04:06

Description

This sub-task will be a place holder for all the disk fail inplace issues related to Datanode.

Issue Links

• incorporates: HDFS-1592 Datanode startup doesn't honor volumes.tolerated
• incorporates: HDFS-1692 In secure mode, Datanode process doesn't exit when disks fail.
• incorporates: HDFS-1847 Datanodes should decomission themselves on volume failure
• incorporates: HDFS-1848 Datanodes should shutdown when a critical volume fails
• incorporates: HDFS-1849 Respect failed.volumes.tolerated on startup
• is part of: HADOOP-7123 Hadoop Disk Fail Inplace
• is related to: HADOOP-7431 Test DiskChecker's functionality in identifying bad directories (Part 2 of testing DiskChecker)
• is related to: HDFS-2111 Add tests for ensuring that the DN will start with a few bad data directories (Part 1 of testing DiskChecker)
• relates to: HDFS-1940 Datanode can have more than one copy of same block when a failed disk is coming back in datanode
• relates to: HADOOP-7040 DiskChecker:mkdirsWithExistsCheck swallows FileNotFoundException.
• relates to: HDFS-1934 Fix NullPointerException when File.listFiles() API returns null
• relates to: HADOOP-7322 Adding a util method in FileUtil for JDK File.listFiles
• relates to: HADOOP-7342 Add an utility API in FileUtil for JDK File.list
• relates to: HDFS-2019 Fix all the places where Java method File.list is used with FileUtil.list API
• relates to: HDFS-664 Add a way to efficiently replace a disk in a live datanode
• relates to: HDFS-1362 Provide volume management functionality for DataNode