[HDFS-9720] DiskBalancer : Add configuration parameters

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-1312
• Fix Version/s: HDFS-1312
• Component/s: balancer & mover
• Target Version/s: HDFS-1312
• Hadoop Flags: Reviewed
• Assignee: Anu Engineer
• Reporter: Anu Engineer
• Created: 28/Jan/16 22:48
• Updated: 24/Jun/16 06:19
• Resolved: 05/Apr/16 19:27

Description

Add the following config params:

1. Max Disk Throughput - This allows users to control how much disk I/O is generated while disk balancer is running
2. Max Disk Errors - For each move operation, this allows user to specify how many I/O failures are tolerated before we declare the operation as failed.
   #Block Tolerance - Specifies how much movement of data is good enough. since the datanodes are active while the copy is going on, tolerance lets the user specify that if we reached something like 5% of projected Ideal storage on the destination disk, we can consider that move to be successful.

Each of these parameter can be specified for each MoveStep. if not specified then the config parameters are used.