[HDDS-11481] Enhanced SCM Support for DataNode Management

• Type: Wish
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: SCM
• Assignee: Shilun Fan
• Reporter: Shilun Fan
• Created: 23/Sep/24 16:22
• Updated: 03/Oct/24 16:36

Description

I plan to enhance SCM's support for DataNode management, including features like blacklist and whitelist.

Compared to the DataNode management functionality in HDFS, SCM's DataNode management still has some incomplete features:

1. For instance, the blacklist and whitelist functionality is missing. Currently, all DataNodes can register with SCM once they are started, but for the sake of completeness, we should implement a blacklist feature.

2. The display list function for DataNodes in SCM is not user-friendly, with the following issues:
-The list does not support global sorting.

• It cannot display the decommissioning progress. Once the decommissioning process begins, we can only passively refresh the page or rely on metrics to make judgments.
• Key information about DataNodes is missing from the list, such as the number of containers and the number of pipelines.

3. In HDFS, if multiple DataNode versions are detected in the cluster, there are helpful prompts, but SCM's recognition and support for multiple DataNode versions are insufficient.

Issue Links

• relates to: HDDS-11153 [UI] Recon UI Improvements
• relates to: HDDS-11341 Add Grafana dashboard for HDDS health and replication progress
• split to: HDDS-11525 Create Grafana dashboard for cluster membership