[ACCUMULO-2090] Concurrent random walk test fails to rename table

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0

Environment

db746960fbcafb1651c15ec2e5493d56acb5065c

• Assignee: Josh Elser
• Reporter: Keith Turner
• Created: 24/Dec/13 19:23
• Updated: 13/Feb/14 23:05
• Resolved: 13/Feb/14 23:05

Description

Saw the following random walker log

24 17:44:13,374 [randomwalk.Framework] ERROR: Error during random walk
java.lang.Exception: Error running node Concurrent.xml
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:285)
        at org.apache.accumulo.test.randomwalk.Framework.run(Framework.java:65)
        at org.apache.accumulo.test.randomwalk.Framework.main(Framework.java:125)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.accumulo.start.Main$1.run(Main.java:137)
        at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.Exception: Error running node ct.RenameTable
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:285)
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:254)
        ... 8 more
Caused by: org.apache.accumulo.core.client.AccumuloException: Internal error processing waitForTableOperation
        at org.apache.accumulo.core.client.admin.TableOperationsImpl.doTableOperation(TableOperationsImpl.java:334)
        at org.apache.accumulo.core.client.admin.TableOperationsImpl.doTableOperation(TableOperationsImpl.java:300)
        at org.apache.accumulo.core.client.admin.TableOperationsImpl.rename(TableOperationsImpl.java:773)
        at org.apache.accumulo.test.randomwalk.concurrent.RenameTable.visit(RenameTable.java:44)
        at org.apache.accumulo.test.randomwalk.Module.visit(Module.java:254)
        ... 9 more
Caused by: org.apache.thrift.TApplicationException: Internal error processing waitForTableOperation
        at org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
        at org.apache.accumulo.core.master.thrift.MasterClientService$Client.recv_waitForTableOperation(MasterClientService.java:610)
        at org.apache.accumulo.core.master.thrift.MasterClientService$Client.waitForTableOperation(MasterClientService.java:595)
        at org.apache.accumulo.core.client.admin.TableOperationsImpl.waitForTableOperation(TableOperationsImpl.java:272)
        at org.apache.accumulo.core.client.admin.TableOperationsImpl.doTableOperation(TableOperationsImpl.java:314)
        ... 13 more

Saw the following in master log.

2013-12-24 17:44:13,342 [thrift.ProcessFunction] ERROR: Internal error processing waitForTableOperation
java.lang.RuntimeException: org.apache.accumulo.core.client.NamespaceNotFoundException: Namespace nspc_000 does not exist (getNamespaceId() failed to find namespace)
        at org.apache.accumulo.master.Master$MasterClientServiceHandler.waitForTableOperation(Master.java:1163)
        at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.invoke(TraceWrap.java:63)
        at com.sun.proxy.$Proxy16.waitForTableOperation(Unknown Source)
        at org.apache.accumulo.core.master.thrift.MasterClientService$Processor$waitForTableOperation.getResult(MasterClientService.java:2119)
        at org.apache.accumulo.core.master.thrift.MasterClientService$Processor$waitForTableOperation.getResult(MasterClientService.java:2103)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
        at org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:171)
        at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:478)
        at org.apache.accumulo.server.util.TServerUtils$THsHaServer$Invocation.run(TServerUtils.java:231)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.accumulo.core.client.NamespaceNotFoundException: Namespace nspc_000 does not exist (getNamespaceId() failed to find namespace)
        at org.apache.accumulo.core.client.impl.Namespaces.getNamespaceId(Namespaces.java:64)
        at org.apache.accumulo.master.tableOps.RenameTable.call(RenameTable.java:66)
        at org.apache.accumulo.master.tableOps.RenameTable.call(RenameTable.java:37)
        at org.apache.accumulo.master.tableOps.TraceRepo.call(TraceRepo.java:54)
        at org.apache.accumulo.fate.Fate$TransactionRunner.run(Fate.java:67)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:34)

Issue Links

• is related to: ACCUMULO-2070 concurrent randomwalk fails