[HDDS-5820] Intermittent failure in TestPipelinePlacementPolicy#testPickLowestLoadAnchor

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.3.0
• Labels: pull-request-available
• Target Version/s: 1.3.0
• Assignee: Keyi Song
• Reporter: Ethan Rose
• Created: 05/Oct/21 16:37
• Updated: 12/Nov/21 04:28
• Resolved: 12/Nov/21 04:28

Description

Failure was observed in this CI run: https://github.com/apache/ozone/runs/3794516460

Reproducible locally after about 150-200 runs of the test.

org.apache.hadoop.hdds.scm.exceptions.SCMException: Pipeline creation failed because nodes are engaged in other pipelines and every node can only be engaged in max 5 pipelines. Required 3. Found 2 
[1047|https://github.com/apache/ozone/runs/3794516460#step:4:1047] at org.apache.hadoop.hdds.scm.pipeline.PipelinePlacementPolicy.filterViableNodes(PipelinePlacementPolicy.java:184) 
[1048|https://github.com/apache/ozone/runs/3794516460#step:4:1048] at org.apache.hadoop.hdds.scm.pipeline.PipelinePlacementPolicy.chooseDatanodes(PipelinePlacementPolicy.java:237) 
[1049|https://github.com/apache/ozone/runs/3794516460#step:4:1049] at org.apache.hadoop.hdds.scm.pipeline.TestPipelinePlacementPolicy.testPickLowestLoadAnchor(TestPipelinePlacementPolicy.java:277)

Issue Links

• is caused by: HDDS-4710 Pipeline: chooseDatanodes function random pick not working
• links to: GitHub Pull Request #2757