Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10297

Increase default balance bandwidth and concurrent moves

    XMLWordPrintableJSON

Details

    Description

      Adjust the default values to better support the current level of customer host and network configurations.

      Increase the default for property dfs.datanode.balance.bandwidthPerSec from 1 to 10 MB. Apply to DN. 10 MB/s is about 10% of the GbE network.

      Increase the default for property dfs.datanode.balance.max.concurrent.moves from 5 to 50. Apply to DN and Balancer. The default number of DN receiver threads is 4096. The default number of balancer mover threads is 1000.

      Attachments

        1. HDFS-10297.001.patch
          3 kB
          John Zhuge
        2. HDFS-10297.002.patch
          3 kB
          John Zhuge
        3. HDFS-10297.003.patch
          3 kB
          John Zhuge
        4. HDFS-10297.003.branch-2.8.patch
          3 kB
          John Zhuge

        Activity

          People

            jzhuge John Zhuge
            jzhuge John Zhuge
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: