Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
-
None
Description
When decommissioning datanode, blocks will be checked one by one disk, then blocks will be sent to trigger tranfer works in DN. This will make one disk of decommissioning dn very busy and cpus stuck in io-wait with high loads, and sometime even lead to OOM as below:
Proposal to add priority queue for transfering blocks when decommisioning datanode.
Attachments
Attachments
Issue Links
- is duplicated by
-
HDFS-14854 Create improved decommission monitor implementation
-
- Resolved
-