[HDDS-5277] Recon shows operational status as "DECOMMISSIONING" for "DECOMMISSIONED" DNs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: Ozone Recon
• Labels: pull-request-available
• Assignee: Aravindan Vijayan
• Reporter: Nilotpal Nandi
• Created: 26/May/21 21:20
• Updated: 02/Jun/21 17:18
• Resolved: 02/Jun/21 17:18

Description

Decommissioned nodes have "DECOMMISSIONING" operational status in recon.

RCA
Recon relies on DN heartbeats to understand Node operational state. If the node goes down before it reports itself as DECOMMISSIONED, then there is a loss of information on Recon side. It is the SCM that moves a node form DECOMMISSIONING to DECOMMISSIONED state first, then the Datanode persists the state change locally, and then heartbeats with the new state to SCM & Recon subsequently. If the DN is shutdown before it can heartbeat the state change to Recon, then Recon lives with the stale information.

Issue Links

• links to: GitHub Pull Request #2286