[HDDS-1561] Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.5.0
• Component/s: Ozone Datanode, SCM
• Labels: pull-request-available
• Target Version/s: 0.5.0
• Assignee: Lokesh Jain
• Reporter: Mukul Kumar Singh
• Created: 20/May/19 07:17
• Updated: 24/Feb/20 20:53
• Resolved: 06/Sep/19 07:46

Description

Right now, if a pipeline is destroyed by SCM, all the container on the pipeline are marked as quasi closed when datanode received close container command. SCM while processing these containers reports, marks these containers as closed once majority of the nodes are available.

This is however not a sufficient condition in cases where the raft log directory is missing or corrupted. As the containers will not have all the applied transaction.
To solve this problem, we should QUASI_CLOSE the containers in datanode as part of ratis groupRemove. If a container is in OPEN state in datanode without any active pipeline, it will be marked as Unhealthy while processing close container command.

cc jnp, shashikant, sdeka, nandakumar131

Issue Links

• links to: GitHub Pull Request #1401