[HDFS-7877] [Umbrella] Support maintenance state for datanodes

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-beta1, 3.1.0
• Component/s: datanode, namenode
• Hadoop Flags: Reviewed
• Assignee: Ming Ma
• Reporter: Ming Ma
• Created: 03/Mar/15 18:33
• Updated: 19/Nov/19 10:09
• Resolved: 20/Sep/17 16:57

Description

This requirement came up during the design for HDFS-7541. Given this feature is mostly independent of upgrade domain feature, it is better to track it under a separate jira. The design and draft patch will be available soon.

Issue Links

• is duplicated by: HDFS-6729 Support maintenance mode for DN
• is related to: HDFS-14465 When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit.
• relates to: HDFS-7541 Upgrade Domains in HDFS

Sub-Tasks

• Refactor decommission related code to support maintenance state for datanodes: Resolved
• Add maintenance states to AdminStates: Resolved
• Block management for maintenance states: Resolved
• Update webUI/JMX to display maintenance state info: Resolved
• Admins support for maintenance state: Resolved
• Better documentation for maintenace mode and upgrade domain: Resolved
• Update fsck to display maintenance state info: Resolved
• Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI: Resolved
• Maintenance state expiry should be an epoch time and not jvm monotonic: Resolved
• DFSAdmin report command supports displaying maintenance state datanodes: Resolved
• Avoid OutOfMemoryError in TestMaintenanceState test runs: Resolved
• Maintenance minimum replication config value allowable range should be [0, DefaultReplication]: Resolved
• TestMaintenanceState#testWithNNAndDNRestart fails intermittently: Resolved
• Change hosts JSON file format: Resolved