[HBASE-20044] TestClientClusterStatus is flakey

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: test
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 21/Feb/18 22:51
• Updated: 07/May/19 16:08
• Resolved: 22/Feb/18 18:18

Description

It killed a nightly. Failed in flakey suite. The compare is too sensitive to slightest variance. Here are two failiures... one because the previous test had not finished putting back a Region that had been offlined, and the other because the count of requests was off slightly. Let me make the compare coarser....

Test set: org.apache.hadoop.hbase.TestClientClusterStatus
-------------------------------------------------------------------------------
Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 27.858 s <<< FAILURE! - in org.apache.hadoop.hbase.TestClientClusterStatus
testNone(org.apache.hadoop.hbase.TestClientClusterStatus)  Time elapsed: 0.236 s  <<< FAILURE!
java.lang.AssertionError: 
expected:<Master: asf903.gq1.ygridcore.net,45687,1519246533030
Number of backup masters: 2
  asf903.gq1.ygridcore.net,34661,1519246530655
  asf903.gq1.ygridcore.net,34734,1519246533133
Number of live region servers: 4
  asf903.gq1.ygridcore.net,37432,1519246533632
  asf903.gq1.ygridcore.net,42964,1519246533554
  asf903.gq1.ygridcore.net,43699,1519246533376
  asf903.gq1.ygridcore.net,56911,1519246533711
Number of dead region servers: 1
  asf903.gq1.ygridcore.net,57278,1519246533770
Average load: 0.25
Number of requests: 17
Number of regions: 1
Number of regions in transition: 0> but was:<Master: asf903.gq1.ygridcore.net,45687,1519246533030
Number of backup masters: 2
  asf903.gq1.ygridcore.net,34661,1519246530655
  asf903.gq1.ygridcore.net,34734,1519246533133
Number of live region servers: 4
  asf903.gq1.ygridcore.net,37432,1519246533632
  asf903.gq1.ygridcore.net,42964,1519246533554
  asf903.gq1.ygridcore.net,43699,1519246533376
  asf903.gq1.ygridcore.net,56911,1519246533711
Number of dead region servers: 1
  asf903.gq1.ygridcore.net,57278,1519246533770
Average load: 0.5
Number of requests: 17
Number of regions: 2
Number of regions in transition: 0>
	at org.apache.hadoop.hbase.TestClientClusterStatus.testNone(TestClientClusterStatus.java:107)

and

[ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.416 s <<< FAILURE! - in org.apache.hadoop.hbase.TestClientClusterStatus
[ERROR] testNone(org.apache.hadoop.hbase.TestClientClusterStatus)  Time elapsed: 0.065 s  <<< FAILURE!
java.lang.AssertionError: 
expected:<Master: 9845c79afe69,46509,1519227084385
Number of backup masters: 2
  9845c79afe69,35076,1519227086213
  9845c79afe69,45963,1519227086363
Number of live region servers: 4
  9845c79afe69,34709,1519227086571
  9845c79afe69,34961,1519227086645
  9845c79afe69,35891,1519227086720
  9845c79afe69,36139,1519227086486
Number of dead region servers: 1
  9845c79afe69,41992,1519227086820
Average load: 0.5
Number of requests: 17
Number of regions: 2
Number of regions in transition: 0> but was:<Master: 9845c79afe69,46509,1519227084385
Number of backup masters: 2
  9845c79afe69,35076,1519227086213
  9845c79afe69,45963,1519227086363
Number of live region servers: 4
  9845c79afe69,34709,1519227086571
  9845c79afe69,34961,1519227086645
  9845c79afe69,35891,1519227086720
  9845c79afe69,36139,1519227086486
Number of dead region servers: 1
  9845c79afe69,41992,1519227086820
Average load: 0.5
Number of requests: 19
Number of regions: 2
Number of regions in transition: 0>
	at org.apache.hadoop.hbase.TestClientClusterStatus.testNone(TestClientClusterStatus.java:107)

Issue Links

• links to: Review Board (branch-2)