[HDFS-15640] Add diff threshold to FedBalance

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: rbf
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Jinglun
• Reporter: Jinglun
• Created: 19/Oct/20 09:46
• Updated: 12/Feb/24 00:49
• Resolved: 27/Oct/20 02:44

Description

Currently in the DistCpProcedure it must submit distcp round by round until there is no diff to go to the final distcp stage. The condition is very strict. During incremental copy stage, if the diff size is under the given threshold scope then we don't need to wait for no diff. We can start the final distcp directly.