Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8647

Abstract BlockManager's rack policy into BlockPlacementPolicy

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Sometimes we want to have namenode use alternative block placement policy such as upgrade domains in HDFS-7541.

      BlockManager has built-in assumption about rack policy in functions such as useDelHint, blockHasEnoughRacks. That means when we have new block placement policy, we need to modify BlockManager to account for the new policy. Ideally BlockManager should ask BlockPlacementPolicy object instead. That will allow us to provide new BlockPlacementPolicy without changing BlockManager.

        Attachments

        1. HDFS-8647-branch27.patch
          40 kB
          Xiao Chen
        2. HDFS-8647-branch26.patch
          38 kB
          Xiao Chen
        3. HDFS-8647-009.patch
          50 kB
          Brahma Reddy Battula
        4. HDFS-8647-008.patch
          50 kB
          Brahma Reddy Battula
        5. HDFS-8647-007.patch
          50 kB
          Brahma Reddy Battula
        6. HDFS-8647-006.patch
          48 kB
          Brahma Reddy Battula
        7. HDFS-8647-005.patch
          46 kB
          Brahma Reddy Battula
        8. HDFS-8647-004.patch
          33 kB
          Brahma Reddy Battula
        9. HDFS-8647-004.patch
          37 kB
          Brahma Reddy Battula
        10. HDFS-8647-003.patch
          29 kB
          Brahma Reddy Battula
        11. HDFS-8647-002.patch
          17 kB
          Brahma Reddy Battula
        12. HDFS-8647-001.patch
          17 kB
          Brahma Reddy Battula

          Issue Links

            Activity

              People

              • Assignee:
                brahmareddy Brahma Reddy Battula
                Reporter:
                mingma Ming Ma
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: