Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
2.2.0
-
None
-
None
-
Hadoop cluster with 4 nodes: 3 with 500Gb drives and one with 4Tb drive.
Description
In a cluster with a set of small nodes and one much larger node balancer always selects the large node as the target even though it already has a copy of each block in the cluster.
This causes the balancer to enter an infinite loop and stop balancing other nodes because each balancing iteration selects the same target and then could not find a single block to move.
Attachments
Issue Links
- duplicates
-
HDFS-8826 Balancer may not move blocks efficiently in some cases
- Resolved