[HDFS-11856] Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3
• Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha4, 2.8.2
• Component/s: hdfs-client, rolling upgrades
• Target Version/s: 2.9.0, 2.7.4, 2.8.1
• Hadoop Flags: Reviewed
• Assignee: Vinayakumar B
• Reporter: Vinayakumar B
• Created: 19/May/17 12:13
• Updated: 24/Apr/18 20:51
• Resolved: 01/Jun/17 21:47

Description

During rolling upgrade if the DN gets restarted, then it will send special OOB_RESTART status to all streams opened for write.
1. Local clients will wait for 30 seconds to datanode to come back.
2. Remote clients will consider these nodes as bad nodes and continue with pipeline recoveries and write. These restarted nodes will be considered as bad, and will be excluded for lifetime of stream.

In case of small cluster, where total nodes itself is 3, each time a remote node restarts for upgrade, it will be excluded.
So a stream writing to 3 nodes initial, will end-up writing to only one node at the end, there are no other nodes to replace.