[HDFS-12347] TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.0.0-beta1, 2.7.5, 3.0.1
• Fix Version/s: 2.10.0, 2.9.1, 3.0.1, 2.8.4, 2.7.6
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Bharat Viswanadham
• Reporter: Xiao Chen
• Created: 24/Aug/17 00:04
• Updated: 04/Jan/18 17:13
• Resolved: 19/Dec/17 02:05

Description

Seems to be failing consistently on trunk from yesterday-ish.

A sample failure is https://builds.apache.org/job/PreCommit-HDFS-Build/20824/testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerRPCDelay/testBalancerRPCDelay/

Running locally failed with:

<failure message="expected:&lt;0&gt; but was:&lt;-3&gt;" type="java.lang.AssertionError"><![CDATA[java.lang.AssertionError: expected:<0> but was:<-3>
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.failNotEquals(Assert.java:743)
        at org.junit.Assert.assertEquals(Assert.java:118)
        at org.junit.Assert.assertEquals(Assert.java:555)
        at org.junit.Assert.assertEquals(Assert.java:542)
        at org.apache.hadoop.hdfs.server.balancer.TestBalancer.runBalancer(TestBalancer.java:953)
        at org.apache.hadoop.hdfs.server.balancer.TestBalancer.doTest(TestBalancer.java:921)
        at org.apache.hadoop.hdfs.server.balancer.TestBalancer.testBalancerRPCDelay(TestBalancer.java:2094)
        at org.apache.hadoop.hdfs.server.balancer.TestBalancerRPCDelay.testBalancerRPCDelay(TestBalancerRPCDelay.java:30)
]]></failure>

Issue Links

• duplicates: HDFS-12816 Fix TestBalancerRPCDelay#testBalancerRPCDelay
• is broken by: HDFS-11384 Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike