[ACCUMULO-2695] Failure while running conditional RW test w/ agitation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0

Environment

Hadoop 2.2.0, Zookeeper 3.4.5, Accumulo 1.6.0 RC2, 20 node EC2 cluster

• Assignee: Keith Turner
• Reporter: Keith Turner
• Created: 18/Apr/14 15:06
• Updated: 28/Apr/14 19:05
• Resolved: 21/Apr/14 21:10

Description

Was running RW Conditional test w/ agitation overnight and saw the following error:

17 22:54:05,448 [conditional.Init] DEBUG: Added bank b845 0
17 22:54:08,306 [conditional.Init] DEBUG: Added bank b422 9
17 22:54:08,314 [impl.ConditionalWriterImpl] ERROR: Thread "pool-2-thread-1" died null
java.lang.IllegalStateException
        at org.apache.accumulo.core.client.impl.ConditionalWriterImpl.unreserveSessionID(ConditionalWriterImpl.java:528)
        at org.apache.accumulo.core.client.impl.ConditionalWriterImpl.sendToServer(ConditionalWriterImpl.java:618)
        at org.apache.accumulo.core.client.impl.ConditionalWriterImpl.access$700(ConditionalWriterImpl.java:90)
        at org.apache.accumulo.core.client.impl.ConditionalWriterImpl$SendTask.run(ConditionalWriterImpl.java:448)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)

This error occurred w/ 7 walkers. The walkers where this error occurred hung. The failure was right around the time a tserver was killed.