Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8647

Abstract BlockManager's rack policy into BlockPlacementPolicy


    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • Component/s: None
    • Labels:
    • Target Version/s:


      Sometimes we want to have namenode use alternative block placement policy such as upgrade domains in HDFS-7541.

      BlockManager has built-in assumption about rack policy in functions such as useDelHint, blockHasEnoughRacks. That means when we have new block placement policy, we need to modify BlockManager to account for the new policy. Ideally BlockManager should ask BlockPlacementPolicy object instead. That will allow us to provide new BlockPlacementPolicy without changing BlockManager.


        1. HDFS-8647-001.patch
          17 kB
          Brahma Reddy Battula
        2. HDFS-8647-002.patch
          17 kB
          Brahma Reddy Battula
        3. HDFS-8647-003.patch
          29 kB
          Brahma Reddy Battula
        4. HDFS-8647-004.patch
          37 kB
          Brahma Reddy Battula
        5. HDFS-8647-004.patch
          33 kB
          Brahma Reddy Battula
        6. HDFS-8647-005.patch
          46 kB
          Brahma Reddy Battula
        7. HDFS-8647-006.patch
          48 kB
          Brahma Reddy Battula
        8. HDFS-8647-007.patch
          50 kB
          Brahma Reddy Battula
        9. HDFS-8647-008.patch
          50 kB
          Brahma Reddy Battula
        10. HDFS-8647-009.patch
          50 kB
          Brahma Reddy Battula
        11. HDFS-8647-branch26.patch
          38 kB
          Xiao Chen
        12. HDFS-8647-branch27.patch
          40 kB
          Xiao Chen

          Issue Links



              • Assignee:
                brahmareddy Brahma Reddy Battula
                mingma Ming Ma
              • Votes:
                0 Vote for this issue
                14 Start watching this issue


                • Created: