Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9375

Set balancer bandwidth for specific node

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.1
    • Fix Version/s: None
    • Component/s: balancer & mover
    • Labels:
      None
    • Target Version/s:

      Description

      Now even though the balancer is impove a lot, but In some cases that is still slow. For example when the cluster is extended,the new nodes all need balancer datas from existed nodes.In order to improve the balancer velocity,generally,we will use setBalancerBandwidth of dfsadmin command.But this is set for every node, obviously,we can increase more bandwidth for new nodes because these nodes lacking of data.When the new nodes balancer data enough,we can let new nodes to work.So we can define a new clientDatanode interface to set specific node's bandwidth.

        Attachments

        1. HDFS-9375.001.patch
          13 kB
          Yiqun Lin
        2. HDFS-9375.002.patch
          15 kB
          Yiqun Lin
        3. HDFS-9375.003.patch
          19 kB
          Yiqun Lin
        4. HDFS-9375.004.patch
          19 kB
          Yiqun Lin
        5. HDFS-9375.005.patch
          19 kB
          Yiqun Lin

          Issue Links

            Activity

              People

              • Assignee:
                linyiqun Yiqun Lin
                Reporter:
                linyiqun Yiqun Lin
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: