Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8825 Enhancements to Balancer
  3. HDFS-8876

Make hard coded parameters used by balancer and other tools configurable

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      During investigation of how to speed up balancer, at least to the level specified by dfs.datanode.balance.bandwidthPerSec, we found that parameters such as MAX_BLOCKS_SIZE_TO_FETCH and SOURCE_BLOCKS_MIN_SIZE are hard coded. These parameters are related to block size and other configurable parameters used by balancer. So least we should make it configurable. In the longer term, it might be interesting to understand if we simplify all these related configurations.

        Attachments

          Activity

            People

            • Assignee:
              ctrezzo Chris Trezzo
              Reporter:
              mingma Ming Ma
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: