[HDDS-1569] Add ability to SCM for creating multiple pipelines with same datanode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: SCM
• Labels: pull-request-available
• Target Version/s: 0.5.0
• Assignee: Li Cheng
• Reporter: Siddharth Wagle
• Created: 21/May/19 21:47
• Updated: 14/Apr/20 04:15
• Resolved: 29/Oct/19 04:47

Description

• Refactor RatisPipelineProvider.create() to be able to create pipelines with datanodes that are not a part of sufficient pipelines
• Define soft and hard upper bounds for pipeline membership
• Create SCMAllocationManager that can be leveraged to get a candidate set of datanodes based on placement policies
• Add the datanodes to internal datastructures

Issue Links

• duplicates: HDDS-2033 Support join multiple pipelines on datanode
• links to: GitHub Pull Request #28
• links to: GitHub Pull Request #1431