Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3564

Design enhancements to the pluggable blockplacementpolicy

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1-win
    • namenode
    • None
    • Reviewed

    Description

      Currently, it is assumed that no placement policy other than the default can work with the balancer and that the minimum racks required for any placement policy is always 2. The attached pdf suggests enhancements to the existing block placement policy abstraction to enable the following
      a) Let placement policies decide if they are compatible with balancer
      b) Provide an api to move blocks for balancing
      c) Let the placement policy decide the minimum number of racks given the replication factor
      d) Also, the private methods in the default policy are made protected, similar to the way its done in trunk, to enable easy derivation of custom policies.
      Please refer the pdf and the patch for details.

      Attachments

        1. policyenhancements-branch-1-win.patch
          17 kB
          Sumadhur Reddy Bolli
        2. blockPlacementPolicy enhancements.pdf
          53 kB
          Sumadhur Reddy Bolli

        Issue Links

          Activity

            People

              sumab Sumadhur Reddy Bolli
              sumab Sumadhur Reddy Bolli
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: