Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3564

Design enhancements to the pluggable blockplacementpolicy

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1-win
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, it is assumed that no placement policy other than the default can work with the balancer and that the minimum racks required for any placement policy is always 2. The attached pdf suggests enhancements to the existing block placement policy abstraction to enable the following
      a) Let placement policies decide if they are compatible with balancer
      b) Provide an api to move blocks for balancing
      c) Let the placement policy decide the minimum number of racks given the replication factor
      d) Also, the private methods in the default policy are made protected, similar to the way its done in trunk, to enable easy derivation of custom policies.
      Please refer the pdf and the patch for details.

        Attachments

        1. policyenhancements-branch-1-win.patch
          17 kB
          Sumadhur Reddy Bolli
        2. blockPlacementPolicy enhancements.pdf
          53 kB
          Sumadhur Reddy Bolli

          Issue Links

            Activity

              People

              • Assignee:
                sumab Sumadhur Reddy Bolli
                Reporter:
                sumab Sumadhur Reddy Bolli
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: