[ACCUMULO-3808] Sequential Bulk RW modules might error

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Abandoned
• Affects Version/s: 1.7.0
• Component/s: test
• Labels: 1.7.0_QA
• Assignee: Unassigned
• Reporter: Josh Elser
• Created: 12/May/15 21:06
• Updated: 28/Oct/20 23:15
• Resolved: 28/Oct/20 23:15

Description

Noticed the following while running RandomWalk LongClean.xml:

We ran the Bulk.xml file for a while, eventually, the 3600s timeout was hit and the module was torn stopped:

11 22:29:20,566 [randomwalk.Module] INFO : Timed out waiting for Split to complete (waited 30 seconds). Exiting.
java.util.concurrent.TimeoutException
        at java.util.concurrent.FutureTask.get(FutureTask.java:201)
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:298)
        at org.apache.accumulo.test.randomwalk.Module$1.call(Module.java:283)
        at org.apache.accumulo.test.randomwalk.Module$1.call(Module.java:278)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at java.lang.Thread.run(Thread.java:745)

We went right back into Bulk after that.

11 22:29:20,567 [bulk.Setup] INFO : Starting bulk test on bulk_cn020_l42scl_hortonworks_com_23476_1431408560567

We near immediately errored out after that

11 22:29:24,466 [randomwalk.Framework] ERROR: Error during random walk
java.lang.Exception: Error running node Bulk.xml
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:346)
        at org.apache.accumulo.test.randomwalk.Framework.run(Framework.java:59)
        at org.apache.accumulo.test.randomwalk.Framework.main(Framework.java:119)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.accumulo.start.Main$2.run(Main.java:130)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Error running node bulk.BulkPlusOne
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:346)
        at org.apache.accumulo.test.randomwalk.Module$1.call(Module.java:283)
        at org.apache.accumulo.test.randomwalk.Module$1.call(Module.java:278)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        ... 1 more
Caused by: java.lang.IllegalStateException: Should not have a skipped import marker for a class other than org.apache.accumulo.test.randomwalk.bulk.BulkMinusOne but was org.apache.accumulo.test.randomwalk.bulk.BulkPlusOne
        at org.apache.accumulo.test.randomwalk.bulk.BulkImportTest.visit(BulkImportTest.java:44)
        ... 9 more

I believe the error is due to the State containing the old value for SKIPPED_IMPORT from the previous Bulk.xml invocation. Bulk.Setup should likely remove any state from previous runs since a new State is not passed in for each invocation of a new module.