[DRILL-1758] Drill stops abrupt

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: 0.5.0
• Fix Version/s: 0.9.0
• Component/s: Functions - Drill
• Labels: abrupt crashed drill immediately stop

Environment

Hortonworks sandbox 2.1

• Assignee: Chun Chang
• Reporter: Laszlo Prohaszka
• Created: 20/Nov/14 11:19
• Updated: 29/Apr/15 15:13
• Resolved: 04/Mar/15 23:29

Description

Hi,
My drill does the following problem, and it's quite disturbing, because it stops my job, and I have to wait for it for really long time.
Sometimes, if I create a table, or I'd like to query something, it stops without any answer. I have to restart drillbit, but also this is very slow. For example it takes about 15-20 minutes for.

Last, when it stopped I gave it the command below:
0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime, request, response1, response2) as select columns[0] AS `host`, columns[1] AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`, columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;

My drillbit.out log (last 2000 lines):
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"TxCleanupService,org.apache.drill.exec.proto.ExecProtos$FragmentHandle,sandbox-5107" daemon prio=10 tid=0x00007f7d49970800 nid=0x1371 waiting on condition [0x00007f7cea787000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5a6bbc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0" daemon prio=10 tid=0x00000000010bb800 nid=0x1366 waiting on condition [0x00007f7ceba8a000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
  at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
  at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
  at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
  at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
  at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
  at ch.qos.logback.classic.Logger.filterAndLog_1(Logger.java:413)
  at ch.qos.logback.classic.Logger.debug(Logger.java:506)
  at org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext(WriterRecordBatch.java:112)
  at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:95)
  at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:116)
  at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:59)
  at org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext(SingleSenderCreator.java:92)
  at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:49)
  at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:104)
  at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• <0x00000006f5fc9440> (a java.util.concurrent.ThreadPoolExecutor$Worker)

"Timer-5,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d49128800 nid=0x1314 waiting on condition [0x00007f7cebc8d000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-4,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d4935c800 nid=0x12e2 waiting on condition [0x00007f7cebd8e000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"threadDeathWatcher-2-1" daemon prio=10 tid=0x00007f7cf8116800 nid=0x12d2 waiting on condition [0x00007f7cece90000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:113)
at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-3,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d49916800 nid=0x1262 waiting on condition [0x00007f7cecf91000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Scheduler-2070747378" prio=10 tid=0x00007f7cf81ef000 nid=0x1253 waiting on condition [0x00007f7ced092000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f4d4bea8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-2,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d48b2e800 nid=0x1247 waiting on condition [0x00007f7ced193000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f59ec0e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"DestroyJavaVM" prio=10 tid=0x00007f7d4800e000 nid=0x11ea waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"qtp770569897-73" prio=10 tid=0x00007f7d49592000 nid=0x1232 waiting on condition [0x00007f7ced291000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
  at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
  at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
  at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
  at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
  at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
  at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
  at ch.qos.logback.classic.Logger.debug(Logger.java:510)
  at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
  at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
  at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
  at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
  at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
  at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
  at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
  at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
  at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
  at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
  at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
  at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
  at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
  at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
  at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
  at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
  at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
  at org.eclipse.jetty.server.Server.handle(Server.java:462)
  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
  at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-72" prio=10 tid=0x00007f7d49385800 nid=0x1231 waiting on condition [0x00007f7ced392000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
  at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
  at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
  at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
  at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
  at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
  at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
  at ch.qos.logback.classic.Logger.debug(Logger.java:510)
  at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
  at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
  at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
  at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
  at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
  at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
  at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
  at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
  at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
  at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
  at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
  at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
  at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
  at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
  at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
  at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
  at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
  at org.eclipse.jetty.server.Server.handle(Server.java:462)
  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
  at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-71" prio=10 tid=0x00007f7d49383800 nid=0x1230 waiting on condition [0x00007f7ced493000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
  at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
  at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
  at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
  at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
  at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
  at ch.qos.logback.classic.Logger.filterAndLog_2(Logger.java:432)
  at ch.qos.logback.classic.Logger.debug(Logger.java:510)
  at org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig.<init>(HBaseStoragePluginConfig.java:52)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125)
  at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:240)
  at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:158)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:352)
  at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:976)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:276)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:157)
  at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:123)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
  at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:82)
  at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:106)
  at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:36)
  at com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1216)
  at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:846)
  at org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
  at org.apache.drill.exec.store.sys.zk.ZkPStore.get(ZkPStore.java:79)
  at org.apache.drill.exec.store.sys.zk.ZkPStore$Iter$DeferredEntry.getValue(ZkPStore.java:168)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePluginsJSON(StorageResources.java:74)
  at org.apache.drill.exec.server.rest.StorageResources.getStoragePlugins(StorageResources.java:87)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
  at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
  at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:387)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:331)
  at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:103)
  at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:269)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
  at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
  at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
  at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:297)
  at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:252)
  at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1023)
  at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:372)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:382)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:345)
  at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:220)
  at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:738)
  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:551)
  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1111)
  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:478)
  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1045)
  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
  at org.eclipse.jetty.server.Server.handle(Server.java:462)
  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:279)
  at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
  at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:534)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-70-acceptor-0-ServerConnector@1e87130a

{HTTP/1.1} {0.0.0.0:8047}

" prio=10 tid=0x00007f7d49381800 nid=0x122f runnable [0x00007f7ced597000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)

• locked <0x00000006f4dc3800> (a java.lang.Object)
  at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:336)
  at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:467)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-69-selector-ServerConnectorManager@7640c83f/3" prio=10 tid=0x00007f7d49380000 nid=0x122e runnable [0x00007f7ced698000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f4dc78c0> (a sun.nio.ch.Util$2)
• locked <0x00000006f4dc78a8> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5c60570> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
  at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-68-selector-ServerConnectorManager@7640c83f/2" prio=10 tid=0x00007f7d4937e800 nid=0x122d runnable [0x00007f7ced799000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f4dd24c8> (a sun.nio.ch.Util$2)
• locked <0x00000006f4dd24b0> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5c604e0> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
  at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-67-selector-ServerConnectorManager@7640c83f/1" prio=10 tid=0x00007f7d4937a800 nid=0x122c runnable [0x00007f7ced89a000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f4ddb400> (a sun.nio.ch.Util$2)
• locked <0x00000006f4ddb3e8> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5c60450> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
  at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"qtp770569897-66-selector-ServerConnectorManager@7640c83f/0" prio=10 tid=0x00007f7d49371800 nid=0x122b runnable [0x00007f7cedb9c000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f4ddfba0> (a sun.nio.ch.Util$2)
• locked <0x00000006f4ddfb88> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5c603c0> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:532)
  at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:485)
  at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"WorkManager Event Thread" daemon prio=10 tid=0x00007f7d4945e800 nid=0x1224 waiting on condition [0x00007f7cedc9d000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5612208> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at org.apache.drill.exec.work.WorkManager$EventThread.run(WorkManager.java:219)

Locked ownable synchronizers:

• None

"BitServer-2" prio=10 tid=0x00007f7d4914c000 nid=0x1221 runnable [0x00007f7cedd9e000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f52376f8> (a io.netty.channel.nio.SelectedSelectionKeySet)
• locked <0x00000006f5391f08> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f516d250> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:618)
  at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:306)
  at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"BitServer-1" prio=10 tid=0x00007f7d49142000 nid=0x121f runnable [0x00007f7cede9f000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f51e1bd8> (a io.netty.channel.nio.SelectedSelectionKeySet)
• locked <0x00000006f5226cf8> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5232ae0> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:618)
  at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:306)
  at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"UserServer-1" prio=10 tid=0x00007f7d49139000 nid=0x121e waiting on condition [0x00007f7cfc1ad000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.sendBytes(MultiplexSocketAppenderBase.java:336)
  at de.huxhorn.lilith.logback.appender.MultiplexSocketAppenderBase.append(MultiplexSocketAppenderBase.java:348)
  at ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
  at ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
  at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
  at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
  at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
  at ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:395)
  at ch.qos.logback.classic.Logger.error(Logger.java:558)
  at org.apache.drill.exec.rpc.RpcExceptionHandler.exceptionCaught(RpcExceptionHandler.java:37)
  at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
  at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
  at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
  at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
  at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
  at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
  at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
  at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
  at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:88)
  at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
  at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:248)
  at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131)
  at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:270)
  at io.netty.channel.AbstractChannelHandlerContext.notifyHandlerException(AbstractChannelHandlerContext.java:767)
  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:334)
  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
  at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:163)
  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
  at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:318)
  at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787)
  at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:125)
  at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:507)
  at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:464)
  at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:378)
  at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:350)
  at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"ServiceCache-0" daemon prio=10 tid=0x00007f7d49123000 nid=0x121c waiting on condition [0x00007f7cfc2af000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f50a8aa8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer runner-1,<CLUSTER>,<ADDR>" daemon prio=10 tid=0x00007f7d4911e000 nid=0x121a waiting on condition [0x00007f7cfc3b0000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5835180> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:220)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
  at org.jgroups.util.TimeScheduler3.run(TimeScheduler3.java:164)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"transport-thread-0" daemon prio=10 tid=0x00007f7d4911b000 nid=0x1219 waiting on condition [0x00007f7cfc4b1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f57f82f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"TxCleanupService,first,sandbox-5107" daemon prio=10 tid=0x00007f7d49114000 nid=0x1218 waiting on condition [0x00007f7cfc5b2000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f57f8340> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Scheduled-eviction-thread-0" daemon prio=10 tid=0x00007f7d49113000 nid=0x1217 waiting on condition [0x00007f7cfc6b3000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5857488> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-5,sandbox-5107" daemon prio=10 tid=0x00007f7d00006800 nid=0x1216 waiting on condition [0x00007f7cfc7b4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-4,sandbox-5107" daemon prio=10 tid=0x00007f7d0000c800 nid=0x1215 waiting on condition [0x00007f7cfc8b5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"INT-1,sandbox-5107" prio=10 tid=0x00007f7d49037800 nid=0x1214 waiting on condition [0x00007f7cfc9b6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58351f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"FD_SOCK acceptor,sandbox-5107" daemon prio=10 tid=0x00007f7d4904f000 nid=0x1213 runnable [0x00007f7cfcab7000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at org.jgroups.protocols.FD_SOCK$ServerSocketHandler.run(FD_SOCK.java:1052)
at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"multicast receiver,sandbox-5107" prio=10 tid=0x00007f7d4903d000 nid=0x1212 runnable [0x00007f7cfcbb8000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainDatagramSocketImpl.receive0(Native Method)

• locked <0x00000006f57cf630> (a java.net.PlainDatagramSocketImpl)
  at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
• locked <0x00000006f57cf630> (a java.net.PlainDatagramSocketImpl)
  at java.net.DatagramSocket.receive(DatagramSocket.java:786)
• locked <0x00000006f4e7b340> (a java.net.DatagramPacket)
• locked <0x00000006f539a190> (a java.net.MulticastSocket)
  at org.jgroups.protocols.UDP$PacketReceiver.run(UDP.java:683)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"unicast receiver,sandbox-5107" prio=10 tid=0x00007f7d4903b000 nid=0x1211 runnable [0x00007f7cfccb9000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainDatagramSocketImpl.receive0(Native Method)

• locked <0x00000006f5805b98> (a java.net.PlainDatagramSocketImpl)
  at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:145)
• locked <0x00000006f5805b98> (a java.net.PlainDatagramSocketImpl)
  at java.net.DatagramSocket.receive(DatagramSocket.java:786)
• locked <0x00000006f55fa830> (a java.net.DatagramPacket)
• locked <0x00000006f55fa858> (a java.net.DatagramSocket)
  at org.jgroups.protocols.UDP$PacketReceiver.run(UDP.java:683)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-3,sandbox-5107" daemon prio=10 tid=0x00007f7d49038800 nid=0x1210 waiting on condition [0x00007f7cfcdba000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Timer-2,sandbox-5107" daemon prio=10 tid=0x00007f7d49035000 nid=0x120f waiting on condition [0x00007f7cfcebb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58351b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"TOA-Delivery-Thread-sandbox-5107" prio=10 tid=0x00007f7d49036800 nid=0x120e in Object.wait() [0x00007f7cfcfbc000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

• waiting on <0x00000006f57f83b8> (a java.util.TreeSet)
  at java.lang.Object.wait(Object.java:503)
  at org.jgroups.protocols.tom.DeliveryManagerImpl.getNextMessagesToDeliver(DeliveryManagerImpl.java:132)
• locked <0x00000006f57f83b8> (a java.util.TreeSet)
  at org.jgroups.protocols.tom.DeliveryThread.run(DeliveryThread.java:52)

Locked ownable synchronizers:

• None

"Timer runner-1,sandbox-5107" daemon prio=10 tid=0x00007f7d49033000 nid=0x120c runnable [0x00007f7cfd0bd000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f58574d0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:220)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
  at org.jgroups.util.TimeScheduler3.run(TimeScheduler3.java:164)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"CuratorFramework-0" daemon prio=10 tid=0x00007f7d48d6e000 nid=0x1209 waiting on condition [0x00007f7cfd1be000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5391f38> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:209)
  at java.util.concurrent.DelayQueue.take(DelayQueue.java:68)
  at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:781)
  at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57)
  at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275)
  at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• <0x00000006f4e2c148> (a java.util.concurrent.ThreadPoolExecutor$Worker)

"main-EventThread" daemon prio=10 tid=0x00007f7d48d7d800 nid=0x1208 waiting on condition [0x00007f7cfd2bf000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5226cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)

Locked ownable synchronizers:

• None

"main-SendThread(sandbox.hortonworks.com:2181)" daemon prio=10 tid=0x00007f7d48d95800 nid=0x1207 runnable [0x00007f7cfd3c0000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)

• locked <0x00000006f522a290> (a sun.nio.ch.Util$2)
• locked <0x00000006f522a248> (a java.util.Collections$UnmodifiableSet)
• locked <0x00000006f5232a50> (a sun.nio.ch.EPollSelectorImpl)
  at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
  at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)

Locked ownable synchronizers:

• None

"ConnectionStateManager-0" daemon prio=10 tid=0x00007f7d48d69000 nid=0x1206 waiting on condition [0x00007f7cfd4c1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f4ed4da0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:374)
  at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:208)
  at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:42)
  at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:110)
  at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• <0x00000006f4e2c1a8> (a java.util.concurrent.ThreadPoolExecutor$Worker)

"TimeoutOutputStream Watchdog-Thread" daemon prio=10 tid=0x00007f7d00009800 nid=0x1200 waiting for monitor entry [0x00007f7cfd9db000]
java.lang.Thread.State: BLOCKED (on object monitor)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)

• waiting to lock <0x00000006f51277b0> (a java.io.BufferedOutputStream)
  at java.io.FilterOutputStream.close(FilterOutputStream.java:157)
  at de.huxhorn.sulky.io.TimeoutOutputStream.internalClose(TimeoutOutputStream.java:185)
  at de.huxhorn.sulky.io.TimeoutOutputStream.access$500(TimeoutOutputStream.java:42)
  at de.huxhorn.sulky.io.TimeoutOutputStream$TimeoutRunnable.run(TimeoutOutputStream.java:226)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"SOCKET Heartbeat" daemon prio=10 tid=0x00007f7d48879800 nid=0x11fe waiting on condition [0x00007f7cfdadc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f5127840> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService.sendBytes(MultiplexSendBytesService.java:132)
  at de.huxhorn.lilith.sender.HeartbeatRunnable.run(HeartbeatRunnable.java:68)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"SOCKET Dispatcher" daemon prio=10 tid=0x00007f7d48877800 nid=0x11fd waiting on condition [0x00007f7cfdbdd000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)

• parking to wait for <0x00000006f4d06748> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:324)
  at de.huxhorn.lilith.sender.SimpleSendBytesService.sendBytes(SimpleSendBytesService.java:131)
  at de.huxhorn.lilith.sender.MultiplexSendBytesService$DispatcherRunnable.run(MultiplexSendBytesService.java:152)
  at java.lang.Thread.run(Thread.java:744)

Locked ownable synchronizers:

• None

"Reconnection@SocketDataOutputStreamFactory[hostName=localhost, port=10000, connectionTimeout=10000, writeTimeout=5000]" daemon prio=10 tid=0x0000000000c1d800 nid=0x11fc in Object.wait() [0x00007f7cfdcde000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

• waiting on <0x00000006f4d03d58> (a java.lang.Object)
  at de.huxhorn.lilith.sender.SimpleSendBytesService$SendBytesThread$ReconnectionThread.run(SimpleSendBytesService.java:350)
• locked <0x00000006f4d03d58> (a java.lang.Object)

Locked ownable synchronizers:

• None

"SendBytes@SocketDataOutputStreamFactory[hostName=localhost, port=10000, connectionTimeout=10000, writeTimeout=5000]" daemon prio=10 tid=0x00007f7d48883000 nid=0x11fb runnable [0x00007f7cfdddf000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113)
at java.net.SocketOutputStream.write(SocketOutputStream.java:159)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)

• locked <0x00000006f51277b0> (a java.io.BufferedOutputStream)
  at de.huxhorn.sulky.io.TimeoutOutputStream.write(TimeoutOutputStream.java:109)
  at java.io.DataOutputStream.write(DataOutputStream.java:107)
• locked <0x00000006f5127368> (a java.io.DataOutputStream)
  at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
  at de.huxhorn.lilith.sender.MessageWriteByteStrategy.writeBytes(MessageWriteByteStrategy.java:56)
  at de.huxhorn.lilith.sender.SimpleSendBytesService$SendBytesThread.run(SimpleSendBytesService.java:243)

Locked ownable synchronizers:

• None

"Service Thread" daemon prio=10 tid=0x00007f7d48117000 nid=0x11f7 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"C2 CompilerThread1" daemon prio=10 tid=0x00007f7d48114800 nid=0x11f6 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"C2 CompilerThread0" daemon prio=10 tid=0x00007f7d48112800 nid=0x11f5 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"Signal Dispatcher" daemon prio=10 tid=0x00007f7d48110000 nid=0x11f4 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007f7d48106000 nid=0x11f3 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:

• None

"Finalizer" daemon prio=10 tid=0x00007f7d480ef000 nid=0x11f2 in Object.wait() [0x00007f7cfef08000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

• waiting on <0x00000006f4ce5ca0> (a java.lang.ref.ReferenceQueue$Lock)
  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
• locked <0x00000006f4ce5ca0> (a java.lang.ref.ReferenceQueue$Lock)
  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
  at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)

Locked ownable synchronizers:

• None

"Reference Handler" daemon prio=10 tid=0x00007f7d480eb000 nid=0x11f1 in Object.wait() [0x00007f7cff009000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

• waiting on <0x00000006f4ce5cb8> (a java.lang.ref.Reference$Lock)
  at java.lang.Object.wait(Object.java:503)
  at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
• locked <0x00000006f4ce5cb8> (a java.lang.ref.Reference$Lock)

Locked ownable synchronizers:

• None

"VM Thread" prio=10 tid=0x00007f7d480e8800 nid=0x11f0 runnable

"Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007f7d4801f000 nid=0x11eb runnable

"Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007f7d48021000 nid=0x11ec runnable

"Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007f7d48023000 nid=0x11ed runnable

"Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007f7d48024800 nid=0x11ee runnable

"Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007f7d480a5000 nid=0x11ef runnable
"VM Periodic Task Thread" prio=10 tid=0x00007f7d48122800 nid=0x11f8 waiting on condition

JNI global references: 356

/opt/drill/bin/drillbit.sh: line 189: 4557 Killed nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 19, 2014 9:23:44 AM org.glassfish.jersey.server.ApplicationHandler initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...

09:43:53.069 [aa4237ca-db2e-4fe4-b77e-5836a7189554:foreman] ERROR hive.log - Got exception: org.apache.thrift.transport.TTransportException java.net.SocketTimeoutException: Read timed out
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_all_databases(ThriftHiveMetastore.java:525) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_all_databases(ThriftHiveMetastore.java:513) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:732) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:126) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:119) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache.get(LocalCache.java:4000) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874) [guava-14.0.1.jar:na]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSubSchema(HiveSchemaFactory.java:207) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.<init>(HiveSchemaFactory.java:200) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory.registerSchemas(HiveSchemaFactory.java:189) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.HiveStoragePlugin.registerSchemas(HiveStoragePlugin.java:83) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.StoragePluginRegistry$DrillSchemaFactory.registerSchemas(StoragePluginRegistry.java:313) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:90) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.ops.QueryContext.getNewDefaultSchema(QueryContext.java:79) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.planner.sql.DrillSqlWorker.<init>(DrillSqlWorker.java:70) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:420) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:220) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_45]
at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_45]
at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_45]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_45]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_45]
at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_45]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
... 31 common frames omitted
09:43:53.096 [aa4237ca-db2e-4fe4-b77e-5836a7189554:foreman] ERROR hive.log - Converting exception to MetaException
Nov 19, 2014 9:44:54 AM org.eigenbase.sql.validate.SqlValidatorException <init>
SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
Nov 19, 2014 9:44:54 AM org.eigenbase.util.EigenbaseException <init>
SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 213: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
Nov 19, 2014 9:45:52 AM org.eigenbase.sql.validate.SqlValidatorException <init>
SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table '/drill/datafiles/log_Aug.csv' not found
Nov 19, 2014 9:45:52 AM org.eigenbase.util.EigenbaseException <init>
SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 240: Table '/drill/datafiles/log_Aug.csv' not found
/opt/drill/bin/drillbit.sh: line 189: 5389 Killed nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 19, 2014 9:57:45 AM org.glassfish.jersey.server.ApplicationHandler initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...

10:01:11.095 [7d1da985-3ac3-48e3-9253-8bb971a2a9c7:foreman] ERROR hive.log - Got exception: org.apache.thrift.transport.TTransportException java.net.SocketTimeoutException: Read timed out
org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_all_databases(ThriftHiveMetastore.java:525) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_all_databases(ThriftHiveMetastore.java:513) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getAllDatabases(HiveMetaStoreClient.java:732) ~[hive-metastore-0.12.0.jar:0.12.0]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:126) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$DatabaseLoader.load(HiveSchemaFactory.java:119) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache.get(LocalCache.java:4000) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004) [guava-14.0.1.jar:na]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874) [guava-14.0.1.jar:na]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSubSchema(HiveSchemaFactory.java:207) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.<init>(HiveSchemaFactory.java:200) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory.registerSchemas(HiveSchemaFactory.java:189) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.hive.HiveStoragePlugin.registerSchemas(HiveStoragePlugin.java:83) [drill-storage-hive-core-0.5.0-incubating.jar:0.5.0-incubating]
at org.apache.drill.exec.store.StoragePluginRegistry$DrillSchemaFactory.registerSchemas(StoragePluginRegistry.java:313) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:90) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.ops.QueryContext.getNewDefaultSchema(QueryContext.java:79) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.planner.sql.DrillSqlWorker.<init>(DrillSqlWorker.java:70) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:420) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:220) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_45]
at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_45]
at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_45]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_45]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_45]
at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_45]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[drill-hive-exec-shaded-0.5.0-incubating.jar:0.5.0-incubating]
... 31 common frames omitted
10:01:11.110 [7d1da985-3ac3-48e3-9253-8bb971a2a9c7:foreman] ERROR hive.log - Converting exception to MetaException
Nov 19, 2014 10:02:39 AM org.eigenbase.sql.validate.SqlValidatorException <init>
SEVERE: org.eigenbase.sql.validate.SqlValidatorException: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
Nov 19, 2014 10:02:39 AM org.eigenbase.util.EigenbaseException <init>
SEVERE: org.eigenbase.util.EigenbaseContextException: From line 1, column 211 to line 1, column 213: Table 'dfs.tmp./drill/datafiles/log_Aug.csv' not found
/opt/drill/bin/drillbit.sh: line 189: 6447 Killed nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 19, 2014 10:21:09 AM org.glassfish.jersey.server.ApplicationHandler initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...

11:08:56.646 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (30973)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:08:58.001 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (33033)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:08:58.962 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (34015)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:00.296 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (35016)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:00.942 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (35872)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:01.487 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (36541)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:01.990 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (37043)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:02.493 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (37546)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:03.049 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (38101)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
11:09:03.611 [CuratorFramework-0] ERROR org.apache.curator.ConnectionState - Connection timed out for connection string (master:2181) and timeout (5000) / elapsed (38604)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:198) [curator-client-2.5.0.jar:na]
at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:88) [curator-client-2.5.0.jar:na]
at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115) [curator-client-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:807) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:793) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$400(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:na]
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:275) [curator-framework-2.5.0.jar:na]
at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
12:12:15.754 [Thread-4] ERROR org.apache.hadoop.hdfs.DFSClient - Failed to close file /tmp/nasadata/1_0_0.csv
java.io.IOException: Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try. (Nodes: current=[192.168.152.143:50010], original=[192.168.152.143:50010]). The current failed datanode replacement policy is DEFAULT, and a client may configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' in its configuration.
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.findNewDatanode(DFSOutputStream.java:960) ~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.addDatanode2ExistingPipeline(DFSOutputStream.java:1026) ~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1175) ~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:924) ~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:486) ~[hadoop-hdfs-2.4.1.jar:na]
/opt/drill/bin/drillbit.sh: line 189: 7265 Killed nice -n $DRILL_NICENESS "$DRILL_HOME"/bin/runbit $command "$@" start >> "$logout" 2>&1
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 19, 2014 12:17:14 PM org.glassfish.jersey.server.ApplicationHandler initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...

My drillbit.log log (last 100 lines) after I queried the CTAS command above:

[root@sandbox /]# tail -n 100 /opt/drill/log/drillbit.log
2014-11-19 12:35:11,103 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
2014-11-19 12:35:11,123 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 777038
2014-11-19 12:35:11,130 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 777632
2014-11-19 12:35:11,135 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200065
2014-11-19 12:35:11,175 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 778997
2014-11-19 12:35:11,197 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 779560
2014-11-19 12:35:11,201 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200017
2014-11-19 12:35:11,214 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 780925
2014-11-19 12:35:11,232 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 781458
2014-11-19 12:35:11,237 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200075
2014-11-19 12:35:11,251 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 782823
2014-11-19 12:35:11,264 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 783413
2014-11-19 12:35:11,272 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200079
2014-11-19 12:35:11,287 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 784778
2014-11-19 12:35:11,292 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 785347
2014-11-19 12:35:11,297 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200038
2014-11-19 12:35:11,306 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 786705
2014-11-19 12:35:11,311 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 787310
2014-11-19 12:35:11,933 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200058
2014-11-19 12:35:12,020 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 788675
2014-11-19 12:35:12,026 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 789250
2014-11-19 12:35:12,032 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200117
2014-11-19 12:35:12,043 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 790615
2014-11-19 12:35:12,048 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 791202
2014-11-19 12:35:12,052 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200020
2014-11-19 12:35:12,060 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 792567
2014-11-19 12:35:12,065 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 793167
2014-11-19 12:35:12,069 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200089
2014-11-19 12:35:12,077 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 794532
2014-11-19 12:35:12,083 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 795117
2014-11-19 12:35:12,087 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200016
2014-11-19 12:35:12,096 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 796482
2014-11-19 12:35:12,100 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 797072
2014-11-19 12:35:12,684 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200070
2014-11-19 12:35:12,692 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 798437
2014-11-19 12:35:12,697 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 799021
2014-11-19 12:35:12,705 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200032
2014-11-19 12:35:12,713 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 800386
2014-11-19 12:35:12,718 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 800997
2014-11-19 12:35:12,723 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200007
2014-11-19 12:35:12,730 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 802362
2014-11-19 12:35:12,735 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 802970
2014-11-19 12:35:12,741 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200090
2014-11-19 12:35:12,749 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 804332
2014-11-19 12:35:12,754 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 804900
2014-11-19 12:35:12,758 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200043
2014-11-19 12:35:12,767 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 806265
2014-11-19 12:35:12,775 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 806821
2014-11-19 12:35:12,780 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
2014-11-19 12:35:12,791 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 808186
2014-11-19 12:35:12,796 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 808749
2014-11-19 12:35:12,802 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200042
2014-11-19 12:35:12,812 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 810114
2014-11-19 12:35:12,819 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 810708
2014-11-19 12:35:12,825 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200029
2014-11-19 12:35:12,836 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 812073
2014-11-19 12:35:12,842 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 812666
2014-11-19 12:35:12,863 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200018
2014-11-19 12:35:12,874 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 814031
2014-11-19 12:35:12,878 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 814614
2014-11-19 12:35:12,884 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
2014-11-19 12:35:12,923 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 815979
2014-11-19 12:35:13,022 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 816544
2014-11-19 12:35:13,027 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200083
2014-11-19 12:35:13,160 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 817909
2014-11-19 12:35:13,236 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 818504
2014-11-19 12:35:13,241 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200060
2014-11-19 12:35:13,299 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 819869
2014-11-19 12:35:18,355 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 820466
2014-11-19 12:35:18,360 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200022
2014-11-19 12:35:17,411 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:1] DEBUG o.a.d.e.s.text.DrillTextRecordWriter - closing file
2014-11-19 12:35:18,368 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 821831
2014-11-19 12:35:18,372 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 822478
2014-11-19 12:35:18,377 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200062
2014-11-19 12:35:18,436 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 823843
2014-11-19 12:35:18,699 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 824492
2014-11-19 12:35:18,703 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
2014-11-19 12:35:18,711 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 825857
2014-11-19 12:35:18,750 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 826504
2014-11-19 12:35:18,755 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200053
2014-11-19 12:35:18,774 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 827869
2014-11-19 12:35:18,783 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 828499
2014-11-19 12:35:18,789 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200022
2014-11-19 12:35:18,797 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 829864
2014-11-19 12:35:18,802 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 830518
2014-11-19 12:35:18,806 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200089
2014-11-19 12:35:18,814 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 831883
2014-11-19 12:35:18,819 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 832531
2014-11-19 12:35:18,824 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200042
2014-11-19 12:35:19,047 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 833896
2014-11-19 12:35:19,055 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 834513
2014-11-19 12:35:19,062 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200027
2014-11-19 12:35:19,077 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 835878
2014-11-19 12:35:19,084 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 836542
2014-11-19 12:35:19,089 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200039
2014-11-19 12:35:19,411 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 837907
2014-11-19 12:35:19,415 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 838568
2014-11-19 12:35:19,420 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200062
2014-11-19 12:35:20,241 [WorkManager Event Thread] DEBUG o.apache.drill.exec.work.WorkManager - Starting pending task org.apache.drill.exec.work.WorkManager$RunnableWrapper@1f95fd5a
2014-11-19 12:35:20,243 [73096cb7-56ee-4bff-83c5-3bbefe553f53:frag:1:1] DEBUG o.a.drill.exec.ops.OperatorContext - Closing context for org.apache.drill.exec.physical.config.SingleSender

The last 500 lines of sqlline.log

[root@sandbox /]# tail -n 500 /opt/drill/log/sqlline.log
mode: OPTIONAL
}
name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
2014-11-19 09:44:13,492 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -6178314394398732316
part2: -5224641525948312236
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 09:44:52,419 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5305604006993543794
part2: -4691027028283251311
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@1f84b826
2014-11-19 09:44:55,037 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 5305604006993543794
part2: -4691027028283251311
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 154
buffer_length: 163
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 164, cap: 164/164, unwrapped: DrillBuf(ridx: 256, widx: 256, cap: 256/256, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 256/256))))]
2014-11-19 09:44:55,182 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 5305604006993543794
part2: -4691027028283251311
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 09:45:48,470 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -4704022649256656017
part2: -6152847041478674731
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@397cec35
2014-11-19 09:45:53,020 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -4704022649256656017
part2: -6152847041478674731
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 146
buffer_length: 155
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 156, cap: 156/156, unwrapped: DrillBuf(ridx: 248, widx: 248, cap: 248/248, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 248/248))))]
2014-11-19 09:45:53,034 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -4704022649256656017
part2: -6152847041478674731
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 09:46:09,718 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5597752468244350252
part2: -7052779758698764261
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@6c49743c
2014-11-19 09:58:57,569 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 09:59:03,441 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 09:59:20,409 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.WindowFrame]
2014-11-19 09:59:20,728 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig]
2014-11-19 09:59:20,747 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.parquet.ParquetFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig]
2014-11-19 09:59:20,835 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
2014-11-19 09:59:23,068 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
2014-11-19 09:59:24,828 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
2014-11-19 10:00:38,173 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 9015548418747222243
part2: -7902819292513392185
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@60cd886a
2014-11-19 10:01:34,121 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 9015548418747222243
part2: -7902819292513392185
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 111
buffer_length: 120
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 121, cap: 121/121, unwrapped: DrillBuf(ridx: 210, widx: 210, cap: 210/210, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 210/210))))]
2014-11-19 10:01:34,194 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 9015548418747222243
part2: -7902819292513392185
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 10:02:37,473 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -4276429314455944130
part2: -5105296223301485661
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@6ada317
2014-11-19 10:02:40,023 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -4276429314455944130
part2: -5105296223301485661
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 154
buffer_length: 163
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 164, cap: 164/164, unwrapped: DrillBuf(ridx: 256, widx: 256, cap: 256/256, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 256/256))))]
2014-11-19 10:02:40,065 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -4276429314455944130
part2: -5105296223301485661
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 10:02:50,650 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 3008993818340312151
part2: -6521594594521895198
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@7e82c636
2014-11-19 10:02:50,968 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 3008993818340312151
part2: -6521594594521895198
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
2014-11-19 10:02:50,978 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 3008993818340312151
part2: -6521594594521895198
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 10:02:59,844 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 7398639825816144341
part2: -6396148652452939646
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@16cde937
2014-11-19 10:03:07,895 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 7398639825816144341
part2: -6396148652452939646
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 32
buffer_length: 41
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 42, cap: 42/42, unwrapped: DrillBuf(ridx: 131, widx: 131, cap: 131/131, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 131/131))))]
2014-11-19 10:03:07,945 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 7398639825816144341
part2: -6396148652452939646
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 10:04:45,239 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 5860477397739652325
part2: -5393944332054804316
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@7c2ab5da
2014-11-19 10:22:06,144 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 10:22:13,182 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 10:22:54,222 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Constant]
2014-11-19 10:22:54,349 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.sys.SystemTablePluginConfig]
2014-11-19 10:22:54,357 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.parquet.ParquetFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig]
2014-11-19 10:22:55,110 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
2014-11-19 10:23:03,543 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
2014-11-19 10:23:07,458 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
2014-11-19 10:23:41,462 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 3858814417780293762
part2: -5472977680643858892
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@3c2b05bf
2014-11-19 10:23:46,393 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 3858814417780293762
part2: -5472977680643858892
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
2014-11-19 10:23:46,406 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 3858814417780293762
part2: -5472977680643858892
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 10:23:52,412 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 2202511821636718132
part2: -7017803918036951922
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@71268d7e
2014-11-19 10:51:23,211 [ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Cache changed, updating.
2014-11-19 10:51:24,665 [ServiceCache-0] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Cache changed, updating.
2014-11-19 11:57:02,571 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 11:57:14,838 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 11:57:46,477 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Transform]
2014-11-19 11:57:46,488 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig]
2014-11-19 11:57:46,510 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.parquet.ParquetFormatConfig]
2014-11-19 11:57:46,555 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
2014-11-19 11:57:50,810 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
2014-11-19 11:57:51,971 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
2014-11-19 12:29:41,958 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 12:29:51,819 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following URLs [jar:file:/opt/drill/jars/drill-storage-hbase-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-hive-exec-shaded-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-java-exec-0.5.0-incubating-rebuffed.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-storage-hive-core-0.5.0-incubating.jar!/drill-module.conf, jar:file:/opt/drill/jars/drill-common-0.5.0-incubating-rebuffed.jar!/drill-module.conf]
2014-11-19 12:30:25,381 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub types: [class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Transform, class org.apache.drill.common.logical.data.Order, class org.apache.drill.common.logical.data.Writer, class org.apache.drill.common.logical.data.GroupingAggregate, class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Scan, class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Constant, class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Store, class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Union, class org.apache.drill.common.logical.data.RunningAggregate]
2014-11-19 12:30:25,740 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding Storage Engine Configs including [class org.apache.drill.exec.store.sys.SystemTablePluginConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.store.hive.HiveStoragePluginConfig, class org.apache.drill.exec.store.dfs.FileSystemFormatConfig, class org.apache.drill.exec.store.dfs.FileSystemConfig, class org.apache.drill.exec.store.hbase.HBaseStoragePluginConfig, class org.apache.drill.exec.store.NamedStoragePluginConfig, class org.apache.drill.exec.store.ischema.InfoSchemaConfig]
2014-11-19 12:30:25,780 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding Format Plugin Configs including [class org.apache.drill.exec.store.easy.text.TextFormatPlugin$TextFormatConfig, class org.apache.drill.exec.store.dfs.NamedFormatPluginConfig, class org.apache.drill.exec.store.easy.json.JSONFormatPlugin$JSONFormatConfig, class org.apache.drill.exec.store.parquet.ParquetFormatConfig]
2014-11-19 12:30:25,893 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect master:2181, zkRoot drill, clusterId: mydrillcluster_1
2014-11-19 12:30:32,206 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting ZKClusterCoordination.
2014-11-19 12:30:34,663 [main] DEBUG o.a.drill.exec.client.DrillClient - Connecting to server sandbox.hortonworks.com:31010
2014-11-19 12:30:52,215 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 7634595741619538955
part2: -5887474601922138781
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@8def7d1
2014-11-19 12:30:57,832 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 7634595741619538955
part2: -5887474601922138781
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 35
buffer_length: 44
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 45, cap: 45/45, unwrapped: DrillBuf(ridx: 134, widx: 134, cap: 134/134, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 134/134))))]
2014-11-19 12:30:57,859 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: 7634595741619538955
part2: -5887474601922138781
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 12:31:15,115 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: -6192947750506705109
part2: -9120915659300383702
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@5a7c8e16
2014-11-19 12:31:34,433 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -6192947750506705109
part2: -9120915659300383702
}
is_last_chunk: false
row_count: 1
def {
record_count: 1
field {
major_type

{ minor_type: BIT mode: REQUIRED }

name_part

{ type: NAME name: "ok" }

value_count: 1
buffer_length: 1
}
field {
major_type

{ minor_type: VARCHAR mode: OPTIONAL }

name_part

{ type: NAME name: "summary" }

value_count: 1
var_byte_length: 32
buffer_length: 41
}
carries_two_byte_selection_vector: false
}
, data=DrillBuf(ridx: 0, widx: 42, cap: 42/42, unwrapped: DrillBuf(ridx: 131, widx: 131, cap: 131/131, unwrapped: UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, cap: 131/131))))]
2014-11-19 12:31:34,446 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - Result arrived QueryResultBatch [header=query_id {
part1: -6192947750506705109
part2: -9120915659300383702
}
is_last_chunk: true
row_count: 0
def {
}
, data=null]
2014-11-19 12:32:41,665 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1: 8289276123845381119
part2: -8951682992832168109
succesfully. Adding listener org.apache.drill.jdbc.DrillResultSet$Listener@5bccea81

During the whole process, while I copied out the log files, the query was stopped, crashed, and I didn't get any answer from it.