[HDDS-8110] ReplicationManager: Introduce basic limits on ReplicateContainer commands

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: SCM
• Labels: pull-request-available
• Assignee: Stephen O'Donnell
• Reporter: Stephen O'Donnell
• Created: 08/Mar/23 11:23
• Updated: 09/Mar/23 18:15
• Resolved: 09/Mar/23 18:15

Description

Create a configuration on Replication Manager that sets the limit of inflight replicate container commands to 20. The intention is to revisit this limit later to make it more dynamic, but this is a starting point.

Then create a method on ReplicationManager createThrottledReplicateContainerCommand, which create the replicateContainerCommands and take into consideration the pending commands on the target datanode. If not targets for the command have capacity, it will throw an exception.

Adjust the various places in ReplicationManager which send the replicateContainer commands to use the new method.

Additionally switch the default replication mode to Push (rather than download) and ensure the LegacyReplicationManager continues to use download as before.

Issue Links

• links to: GitHub Pull Request #4364