Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.0.0, 2.0.0-alpha
-
None
-
Reviewed
Description
ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, the Replica Removal Policy is still nested in BlockManager that need to be separated out into a ReplicaPlacementPolicy then can be override later. Also it looks like hadoop unit test lack the testing on replica removal policy, so we add it here.
On the other hand, as a implementation of ReplicaPlacementPolicy, ReplicaPlacementDefault still show lots of generic for other topology cases like: virtualization, and we want to make code in ReplicaPlacementPolicyDefault can be reused as much as possible so a few of its methods were changed from private to protected.
Attachments
Attachments
Issue Links
- is depended upon by
-
HDFS-4240 In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup
- Closed
-
HDFS-3601 Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology
- Closed
- is part of
-
HADOOP-8468 Umbrella of enhancements to support different failure and locality topologies
- Resolved
- is related to
-
HDFS-3941 Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology
- Closed