Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Reviewed
Description
Based on the offline discussion, one potential improvement to the chooseRandomWithStorageType added in HDFS-11482 is that, currently given a node, the method iterates all its children to sum up the number of candidate datanodes. Since datanode status change is much less frequent than block placement request. It is more efficient to get rid of this iteration check, by probably maintaining another disk type counter map. This JIRA tracks (but not limited) this optimization.
Attachments
Attachments
Issue Links
- depends upon
-
HDFS-11482 Add storage type demand to into DFSNetworkTopology#chooseRandom
- Resolved
- is duplicated by
-
HDFS-12334 [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom
- Resolved