Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9375

Set balancer bandwidth for specific node

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.7.1
    • None
    • balancer & mover
    • None

    Description

      Now even though the balancer is impove a lot, but In some cases that is still slow. For example when the cluster is extended,the new nodes all need balancer datas from existed nodes.In order to improve the balancer velocity,generally,we will use setBalancerBandwidth of dfsadmin command.But this is set for every node, obviously,we can increase more bandwidth for new nodes because these nodes lacking of data.When the new nodes balancer data enough,we can let new nodes to work.So we can define a new clientDatanode interface to set specific node's bandwidth.

      Attachments

        1. HDFS-9375.001.patch
          13 kB
          Yiqun Lin
        2. HDFS-9375.002.patch
          15 kB
          Yiqun Lin
        3. HDFS-9375.003.patch
          19 kB
          Yiqun Lin
        4. HDFS-9375.004.patch
          19 kB
          Yiqun Lin
        5. HDFS-9375.005.patch
          19 kB
          Yiqun Lin

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9468 DfsAdmin command set dataXceiver count for datanode

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              linyiqun Yiqun Lin
              linyiqun Yiqun Lin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: