[HDFS-15368] TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.6
• Fix Version/s: 3.4.0, 3.3.6
• Component/s: balancer, test
• Labels: balancer test
• Target Version/s: 3.4.0, 3.3.6
• Hadoop Flags: Reviewed
• External issue URL: https://issues.apache.org/jira/browse/HDFS-13183
• Assignee: Xiaoqiao He
• Reporter: Xiaoqiao He
• Created: 21/May/20 07:39
• Updated: 11/Feb/24 06:24
• Resolved: 28/May/20 15:28

Description

When I am working on HDFS-13183, I found that TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally, because the following code segment. Consider there are 1 ANN + 1 SBN + 2ONN, when invoke getBlocks with opening Observer Read feature, it could request any one of two ObserverNN based on my observation. So only verify the first ObserverNN and check times of invoke #getBlocks is not expected.

      for (int i = 0; i < cluster.getNumNameNodes(); i++) {
        // First observer node is at idx 2, or 3 if 2 has been shut down
        // It should get both getBlocks calls, all other NNs should see 0 calls
        int expectedObserverIdx = withObserverFailure ? 3 : 2;
        int expectedCount = (i == expectedObserverIdx) ? 2 : 0;
        verify(namesystemSpies.get(i), times(expectedCount))
            .getBlocks(any(), anyLong(), anyLong());
      }

cc xkrogen,weichiu. I am not very familiar for Observer Read feature, would you like give some suggestions?

Issue Links

• is blocked by: HDFS-13183 Standby NameNode process getBlocks request to reduce Active load