[HDDS-6885] Allow HDDS layout features to specify their finalization requirements

• Type: Sub-task
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Ozone Datanode, SCM
• Labels: pull-request-available
• Target Version/s: 1.3.0
• Assignee: Ethan Rose
• Reporter: Ethan Rose
• Created: 14/Jun/22 20:08
• Updated: 20/Jun/23 06:11

Description

Add a field to each HDDS layout feature object that allows it to specify the requirements SCM must enforce when it needs to be finalized. Currently there will be two options:

1. Close all containers: The current way finalization works, which involves closing all pipelines and containers and moving datanodes to a readonly state until they finalize.

2. None: No special requirements. The layout feature can be finalized while datanodes are serving reads and writes. Individual datanodes must still be finalized before they can use new layout features.

Another requirement could be the number of datanodes that must finalize before SCM declares finalization as complete. A minimum number may be configured by default, but some features like erasure coding may have a specific number, like 5, needed before the feature can be declared finalized.

Issue Links

• requires: HDDS-6887 Make SCM determine the schema version of new containers
• links to: GitHub Pull Request #3595