[ACCUMULO-2198] Concurrent randomwalk fails with unbalanced servers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.4
• Fix Version/s: 1.4.5, 1.5.1, 1.6.0
• Component/s: test
• Labels: randomwalk test
• Assignee: Bill Havanki
• Reporter: Bill Havanki
• Created: 15/Jan/14 14:29
• Updated: 17/Mar/14 21:11
• Resolved: 16/Jan/14 20:25

Description

Not always, but sometimes I am seeing the Concurrent randomwalk test fail with:

java.lang.Exception: Error running node Concurrent.xml
        at org.apache.accumulo.server.test.randomwalk.Module.visit(Module.java:259)
...
Caused by: java.lang.Exception: Error running node ct.CheckBalance
        at org.apache.accumulo.server.test.randomwalk.Module.visit(Module.java:259)
        at org.apache.accumulo.server.test.randomwalk.Module.visit(Module.java:251)
        ... 8 more
Caused by: java.lang.Exception: servers are unbalanced!
        at org.apache.accumulo.server.test.randomwalk.concurrent.CheckBalance.visit(CheckBalance.java:74)
        at org.apache.accumulo.server.test.randomwalk.Module.visit(Module.java:251)
        ... 9 more

In one case, the 15-minute allowance for balancing extended to a prior run of Concurrent.xml within the same overall test run. In another case, the time span begins at a point when HDFS failed to contact a datanode.

Issue Links

• is related to: ACCUMULO-2488 Concurrent randomwalk balance check needs refinement
• relates to: ACCUMULO-1239 CheckBalance is ending random walk tests
• links to: Review 1
• links to: Review 2