Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8647

Abstract BlockManager's rack policy into BlockPlacementPolicy

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • None
    • None

    Description

      Sometimes we want to have namenode use alternative block placement policy such as upgrade domains in HDFS-7541.

      BlockManager has built-in assumption about rack policy in functions such as useDelHint, blockHasEnoughRacks. That means when we have new block placement policy, we need to modify BlockManager to account for the new policy. Ideally BlockManager should ask BlockPlacementPolicy object instead. That will allow us to provide new BlockPlacementPolicy without changing BlockManager.

      Attachments

        1. HDFS-8647-001.patch
          17 kB
          Brahma Reddy Battula
        2. HDFS-8647-002.patch
          17 kB
          Brahma Reddy Battula
        3. HDFS-8647-003.patch
          29 kB
          Brahma Reddy Battula
        4. HDFS-8647-004.patch
          37 kB
          Brahma Reddy Battula
        5. HDFS-8647-004.patch
          33 kB
          Brahma Reddy Battula
        6. HDFS-8647-005.patch
          46 kB
          Brahma Reddy Battula
        7. HDFS-8647-006.patch
          48 kB
          Brahma Reddy Battula
        8. HDFS-8647-007.patch
          50 kB
          Brahma Reddy Battula
        9. HDFS-8647-008.patch
          50 kB
          Brahma Reddy Battula
        10. HDFS-8647-009.patch
          50 kB
          Brahma Reddy Battula
        11. HDFS-8647-branch26.patch
          38 kB
          Xiao Chen
        12. HDFS-8647-branch27.patch
          40 kB
          Xiao Chen

        Issue Links

          Activity

            People

              brahmareddy Brahma Reddy Battula
              mingma Ming Ma
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: