RegionServer status for dx-pipe-regionserver14-online,16020,1464166068185 as of Fri May 27 14:43:15 CST 2016 Version Info: =========================================================== HBase 1.1.1 Source code repository git://hw11397.local/Volumes/hbase-1.1.1RC0/hbase revision=d0a115a7267f54e01c72c603ec53e91ec418292f Compiled by ndimiduk on Tue Jun 23 14:44:07 PDT 2015 From source with checksum 6e2d8cecbd28738ad86daacb25dc467e Hadoop 2.5.1 Source code repository Unknown revision=2e18d179e4a8065b6a9f29cf2de9451891265cce Compiled by ndimiduk on 2015-03-26T16:58Z Tasks: =========================================================== Task: Flushing ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130. Status: RUNNING:Flushing cf: reopening flushed file Running for 20144s Executors: =========================================================== Status for executor: Executor-2-RS_OPEN_META-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Status for executor: Executor-3-RS_CLOSE_REGION-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Status for executor: Executor-5-RS_LOG_REPLAY_OPS-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Status for executor: Executor-4-RS_CLOSE_META-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Status for executor: Executor-6-RS_REGION_REPLICA_FLUSH_OPS-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Status for executor: Executor-1-RS_OPEN_REGION-dx-pipe-regionserver14-online:16020 ======================================= 0 events queued, 0 running Process Thread Dump: 260 active threads Thread 176210 (1448791568@qtp-777341499-60): State: TIMED_WAITING Blocked count: 1 Waited count: 2 Stack: java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Thread 176209 (911746963@qtp-777341499-59): State: RUNNABLE Blocked count: 5 Waited count: 5 Stack: sun.management.ThreadImpl.getThreadInfo1(Native Method) sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:174) sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:139) org.apache.hadoop.util.ReflectionUtils.printThreadInfo(ReflectionUtils.java:165) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:483) org.apache.hadoop.hbase.util.Threads.printThreadInfo(Threads.java:302) org.apache.hadoop.hbase.regionserver.RSDumpServlet.doGet(RSDumpServlet.java:79) javax.servlet.http.HttpServlet.service(HttpServlet.java:707) javax.servlet.http.HttpServlet.service(HttpServlet.java:820) org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113) org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1350) org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49) org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) Thread 174632 (1208159918@qtp-777341499-58): State: TIMED_WAITING Blocked count: 143 Waited count: 171 Stack: java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Thread 174095 (ResponseProcessor for block BP-133847077-10.1.0.4-1413174984773:blk_1393364892_349261501): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1998) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176) org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:798) Thread 174094 (DataStreamer for file /hbase/WALs/dx-pipe-regionserver14-online,16020,1464166068185/dx-pipe-regionserver14-online%2C16020%2C1464166068185.default.1464329181530 block BP-133847077-10.1.0.4-1413174984773:blk_1393364892_349261501): State: TIMED_WAITING Blocked count: 4 Waited count: 81 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:503) Thread 171125 (IPC Parameter Sending Thread #30): State: TIMED_WAITING Blocked count: 114 Waited count: 18223 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 131750 (IPC Client (171493374) connection to f04/10.11.53.50:8020 from maintain): State: TIMED_WAITING Blocked count: 157500 Waited count: 156627 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:904) org.apache.hadoop.ipc.Client$Connection.run(Client.java:949) Thread 33491 (member: 'dx-pipe-regionserver14-online,16020,1464166068185' subprocedure-pool2-thread-1): State: WAITING Blocked count: 831 Waited count: 1385 Waiting on java.util.concurrent.SynchronousQueue$TransferStack@1361d31b Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 12002 (RS_CLOSE_REGION-dx-pipe-regionserver14-online:16020-2): State: WAITING Blocked count: 729 Waited count: 1184 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@42905ad Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 12001 (RS_CLOSE_REGION-dx-pipe-regionserver14-online:16020-1): State: WAITING Blocked count: 675 Waited count: 1101 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@42905ad Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 12000 (RS_CLOSE_REGION-dx-pipe-regionserver14-online:16020-0): State: WAITING Blocked count: 695 Waited count: 1133 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@42905ad Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 7317 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-splits-1464171710168): State: WAITING Blocked count: 6754 Waited count: 11532 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7bc42c68 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 7008 (ResponseProcessor for block BP-133847077-10.1.0.4-1413174984773:blk_1389692117_345588702): State: RUNNABLE Blocked count: 1 Waited count: 0 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1998) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176) org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:798) Thread 6946 (IPC Client (171493374) connection to f04/10.11.53.50:16000 from maintain): State: TIMED_WAITING Blocked count: 62947 Waited count: 220504 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.waitForWork(RpcClientImpl.java:542) org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:557) Thread 6436 (DataStreamer for file /hbase/data/default/REALTIME_RESEARCH.APE_QUESTION_REPORT/9d54badceb489710dae95dca0797bdc1/.tmp/3eb97f92af9c4314bdf7c6f09da0161d block BP-133847077-10.1.0.4-1413174984773:blk_1389692117_345588702): State: TIMED_WAITING Blocked count: 128589 Waited count: 133936 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:503) Thread 2925 (RS_LOG_REPLAY_OPS-dx-pipe-regionserver14-online:16020-1): State: WAITING Blocked count: 12747 Waited count: 12794 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3e3a66a4 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 2919 (RS_LOG_REPLAY_OPS-dx-pipe-regionserver14-online:16020-0): State: WAITING Blocked count: 12715 Waited count: 12844 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3e3a66a4 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 859 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-longCompactions-1464166648035): State: RUNNABLE Blocked count: 721119 Waited count: 722204 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.readChannelFully(PacketReceiver.java:258) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:171) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:102) org.apache.hadoop.hdfs.RemoteBlockReader2.readNextPacket(RemoteBlockReader2.java:186) org.apache.hadoop.hdfs.RemoteBlockReader2.read(RemoteBlockReader2.java:146) org.apache.hadoop.hdfs.DFSInputStream$ByteArrayStrategy.doRead(DFSInputStream.java:686) org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:742) org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:799) org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:840) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.hbase.io.hfile.HFileBlock.readWithExtra(HFileBlock.java:678) Thread 840 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-shortCompactions-1464166647562): State: WAITING Blocked count: 931916 Waited count: 1073351 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.removeUnneededFiles(HStore.java:1603) org.apache.hadoop.hbase.regionserver.HStore.requestCompaction(HStore.java:1507) org.apache.hadoop.hbase.regionserver.CompactSplitThread.selectCompaction(CompactSplitThread.java:362) org.apache.hadoop.hbase.regionserver.CompactSplitThread.access$200(CompactSplitThread.java:58) org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:491) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 825 (RS_OPEN_REGION-dx-pipe-regionserver14-online:16020-2): State: WAITING Blocked count: 4866 Waited count: 8060 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3c7fe899 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 824 (RS_OPEN_REGION-dx-pipe-regionserver14-online:16020-1): State: WAITING Blocked count: 4280 Waited count: 6974 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3c7fe899 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 823 (RS_OPEN_REGION-dx-pipe-regionserver14-online:16020-0): State: WAITING Blocked count: 4148 Waited count: 6819 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3c7fe899 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 273 (org.apache.hadoop.hdfs.PeerCache@383b255): State: TIMED_WAITING Blocked count: 0 Waited count: 55099 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:244) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:41) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:119) java.lang.Thread.run(Thread.java:745) Thread 272 (SplitLogWorker-dx-pipe-regionserver14-online:16020): State: TIMED_WAITING Blocked count: 10479 Waited count: 43521 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination.taskLoop(ZkSplitLogWorkerCoordination.java:445) org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:142) java.lang.Thread.run(Thread.java:745) Thread 270 (dx-pipe-regionserver14-online:16020Replication Statistics #0): State: TIMED_WAITING Blocked count: 0 Waited count: 552 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 268 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-EventThread): State: WAITING Blocked count: 0 Waited count: 6 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6ac98756 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Thread 267 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-SendThread(10.11.51.78:2181)): State: RUNNABLE Blocked count: 0 Waited count: 2 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Thread 264 (ReplicationExecutor-0): State: WAITING Blocked count: 9969 Waited count: 10026 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@29b191b6 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 262 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.replicationSource,1-EventThread): State: WAITING Blocked count: 0 Waited count: 3 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@41106040 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Thread 261 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.replicationSource,1-SendThread(10.11.51.79:2181)): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Thread 258 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.replicationSource,1): State: TIMED_WAITING Blocked count: 483205 Waited count: 1080248 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.sleepForRetries(ReplicationSource.java:630) org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:400) Thread 260 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-EventThread): State: WAITING Blocked count: 0 Waited count: 3 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@56bdddbe Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Thread 259 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-SendThread(10.11.51.78:2181)): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Thread 230 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.leaseChecker): State: TIMED_WAITING Blocked count: 0 Waited count: 44897 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:94) java.lang.Thread.run(Thread.java:745) Thread 257 (dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1): State: TIMED_WAITING Blocked count: 23758 Waited count: 65953 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 255 (MemStoreFlusher.1): State: WAITING Blocked count: 219905 Waited count: 281158 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199) java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943) org.apache.hadoop.hbase.regionserver.HStore.updateStorefiles(HStore.java:1050) org.apache.hadoop.hbase.regionserver.HStore.access$500(HStore.java:128) org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.commit(HStore.java:2231) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2307) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2049) org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2011) org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:1903) org.apache.hadoop.hbase.regionserver.HRegion.flush(HRegion.java:1829) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:510) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushOneForGlobalPressure(MemStoreFlusher.java:215) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$500(MemStoreFlusher.java:75) org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:244) java.lang.Thread.run(Thread.java:745) Thread 253 (MemStoreFlusher.0): State: WAITING Blocked count: 237353 Waited count: 308099 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.canSplit(HStore.java:1941) org.apache.hadoop.hbase.regionserver.IncreasingToUpperBoundRegionSplitPolicy.shouldSplit(IncreasingToUpperBoundRegionSplitPolicy.java:78) org.apache.hadoop.hbase.regionserver.HRegion.checkSplit(HRegion.java:7503) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:513) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:471) org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$800(MemStoreFlusher.java:75) org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:259) java.lang.Thread.run(Thread.java:745) Thread 226 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.logRoller): State: TIMED_WAITING Blocked count: 5542 Waited count: 24682 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.regionserver.LogRoller.run(LogRoller.java:116) java.lang.Thread.run(Thread.java:745) Thread 252 (HBase-Metrics2-1): State: TIMED_WAITING Blocked count: 32 Waited count: 570122 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 250 (sync.4): State: WAITING Blocked count: 18096964 Waited count: 18605496 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2fc9177b Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Thread 249 (sync.3): State: WAITING Blocked count: 18105356 Waited count: 18612978 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1f09a1d9 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Thread 248 (sync.2): State: WAITING Blocked count: 18106317 Waited count: 18613847 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@42a1d73a Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Thread 247 (sync.1): State: WAITING Blocked count: 18101743 Waited count: 18608995 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5edca66a Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Thread 246 (sync.0): State: WAITING Blocked count: 18100564 Waited count: 18608077 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@39490005 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1323) java.lang.Thread.run(Thread.java:745) Thread 251 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.append-pool1-t1): State: WAITING Blocked count: 344510 Waited count: 14794950 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6b9c699c Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45) com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55) com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 244 (LeaseRenewer:maintain@f04): State: TIMED_WAITING Blocked count: 5477 Waited count: 176201 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:438) org.apache.hadoop.hdfs.LeaseRenewer.access$700(LeaseRenewer.java:71) org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:298) java.lang.Thread.run(Thread.java:745) Thread 240 (BucketCacheStatsExecutor): State: TIMED_WAITING Blocked count: 1 Waited count: 552 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 238 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-BucketCacheWriter-2): State: WAITING Blocked count: 73 Waited count: 33542 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1c9c76a7 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:884) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:741) java.lang.Thread.run(Thread.java:745) Thread 237 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-BucketCacheWriter-1): State: WAITING Blocked count: 65 Waited count: 33630 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6da41419 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:884) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:741) java.lang.Thread.run(Thread.java:745) Thread 236 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-BucketCacheWriter-0): State: WAITING Blocked count: 63 Waited count: 33416 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@657c40b8 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getRAMQueueEntries(BucketCache.java:884) org.apache.hadoop.hbase.io.hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:741) java.lang.Thread.run(Thread.java:745) Thread 235 (LruBlockCacheStatsExecutor): State: TIMED_WAITING Blocked count: 0 Waited count: 552 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 233 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020.LruBlockCache.EvictionThread): State: TIMED_WAITING Blocked count: 0 Waited count: 16532 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:803) java.lang.Thread.run(Thread.java:745) Thread 229 (JvmPauseMonitor): State: TIMED_WAITING Blocked count: 0 Waited count: 330407 Stack: java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:159) java.lang.Thread.run(Thread.java:745) Thread 228 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-EventThread): State: WAITING Blocked count: 0 Waited count: 6 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@339101e8 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Thread 227 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020-SendThread(10.11.51.77:2181)): State: RUNNABLE Blocked count: 0 Waited count: 2 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Thread 22 (regionserver/dx-pipe-regionserver14-online/10.11.52.77:16020): State: TIMED_WAITING Blocked count: 55316 Waited count: 108982 Stack: java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:56) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:951) java.lang.Thread.run(Thread.java:745) Thread 225 (Timer-0): State: TIMED_WAITING Blocked count: 0 Waited count: 5511 Stack: java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Thread 224 (1765900922@qtp-777341499-1 - Acceptor0 SelectChannelConnector@0.0.0.0:16030): State: RUNNABLE Blocked count: 568073 Waited count: 33539 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Thread 221 (MetadataRpcServer.handler=29,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 220 (MetadataRpcServer.handler=28,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 219 (MetadataRpcServer.handler=27,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 218 (MetadataRpcServer.handler=26,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 217 (MetadataRpcServer.handler=25,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 216 (MetadataRpcServer.handler=24,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 215 (MetadataRpcServer.handler=23,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 214 (MetadataRpcServer.handler=22,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 213 (MetadataRpcServer.handler=21,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 212 (MetadataRpcServer.handler=20,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 211 (MetadataRpcServer.handler=19,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 210 (MetadataRpcServer.handler=18,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 209 (MetadataRpcServer.handler=17,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 208 (MetadataRpcServer.handler=16,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 207 (MetadataRpcServer.handler=15,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 206 (MetadataRpcServer.handler=14,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 205 (MetadataRpcServer.handler=13,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 204 (MetadataRpcServer.handler=12,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 203 (MetadataRpcServer.handler=11,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 202 (MetadataRpcServer.handler=10,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 201 (MetadataRpcServer.handler=9,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 200 (MetadataRpcServer.handler=8,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 199 (MetadataRpcServer.handler=7,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 198 (MetadataRpcServer.handler=6,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 197 (MetadataRpcServer.handler=5,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 196 (MetadataRpcServer.handler=4,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 195 (MetadataRpcServer.handler=3,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 194 (MetadataRpcServer.handler=2,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 193 (MetadataRpcServer.handler=1,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 192 (MetadataRpcServer.handler=0,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@78cb2fc3 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 191 (IndexRpcServer.handler=29,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 190 (IndexRpcServer.handler=28,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 189 (IndexRpcServer.handler=27,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 188 (IndexRpcServer.handler=26,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 187 (IndexRpcServer.handler=25,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 186 (IndexRpcServer.handler=24,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 185 (IndexRpcServer.handler=23,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 184 (IndexRpcServer.handler=22,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 183 (IndexRpcServer.handler=21,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 182 (IndexRpcServer.handler=20,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 181 (IndexRpcServer.handler=19,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 180 (IndexRpcServer.handler=18,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 179 (IndexRpcServer.handler=17,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 178 (IndexRpcServer.handler=16,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 177 (IndexRpcServer.handler=15,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 176 (IndexRpcServer.handler=14,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 175 (IndexRpcServer.handler=13,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 174 (IndexRpcServer.handler=12,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 173 (IndexRpcServer.handler=11,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 172 (IndexRpcServer.handler=10,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 171 (IndexRpcServer.handler=9,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 170 (IndexRpcServer.handler=8,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 169 (IndexRpcServer.handler=7,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 168 (IndexRpcServer.handler=6,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 167 (IndexRpcServer.handler=5,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 166 (IndexRpcServer.handler=4,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 165 (IndexRpcServer.handler=3,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 164 (IndexRpcServer.handler=2,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 163 (IndexRpcServer.handler=1,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 162 (IndexRpcServer.handler=0,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@436eff73 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 161 (ReplicationRpcServer.handler=2,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@83f1342 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 160 (ReplicationRpcServer.handler=1,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@83f1342 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 159 (ReplicationRpcServer.handler=0,queue=0,port=16020): State: WAITING Blocked count: 0 Waited count: 1 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@83f1342 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 158 (PriorityRpcServer.handler=19,queue=1,port=16020): State: WAITING Blocked count: 116 Waited count: 233 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 157 (PriorityRpcServer.handler=18,queue=0,port=16020): State: WAITING Blocked count: 73 Waited count: 177 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 156 (PriorityRpcServer.handler=17,queue=1,port=16020): State: WAITING Blocked count: 55 Waited count: 146 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 155 (PriorityRpcServer.handler=16,queue=0,port=16020): State: WAITING Blocked count: 103 Waited count: 216 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 154 (PriorityRpcServer.handler=15,queue=1,port=16020): State: WAITING Blocked count: 44 Waited count: 134 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 153 (PriorityRpcServer.handler=14,queue=0,port=16020): State: WAITING Blocked count: 96 Waited count: 203 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 152 (PriorityRpcServer.handler=13,queue=1,port=16020): State: WAITING Blocked count: 48 Waited count: 141 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 151 (PriorityRpcServer.handler=12,queue=0,port=16020): State: WAITING Blocked count: 108 Waited count: 228 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 150 (PriorityRpcServer.handler=11,queue=1,port=16020): State: WAITING Blocked count: 45 Waited count: 133 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 149 (PriorityRpcServer.handler=10,queue=0,port=16020): State: WAITING Blocked count: 116 Waited count: 238 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 148 (PriorityRpcServer.handler=9,queue=1,port=16020): State: WAITING Blocked count: 85 Waited count: 190 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 147 (PriorityRpcServer.handler=8,queue=0,port=16020): State: WAITING Blocked count: 82 Waited count: 187 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 146 (PriorityRpcServer.handler=7,queue=1,port=16020): State: WAITING Blocked count: 99 Waited count: 205 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 145 (PriorityRpcServer.handler=6,queue=0,port=16020): State: WAITING Blocked count: 102 Waited count: 212 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 144 (PriorityRpcServer.handler=5,queue=1,port=16020): State: WAITING Blocked count: 32 Waited count: 112 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 143 (PriorityRpcServer.handler=4,queue=0,port=16020): State: WAITING Blocked count: 69 Waited count: 172 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 142 (PriorityRpcServer.handler=3,queue=1,port=16020): State: WAITING Blocked count: 91 Waited count: 194 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 141 (PriorityRpcServer.handler=2,queue=0,port=16020): State: WAITING Blocked count: 39 Waited count: 128 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 140 (PriorityRpcServer.handler=1,queue=1,port=16020): State: WAITING Blocked count: 58 Waited count: 147 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2d7442bb Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 139 (PriorityRpcServer.handler=0,queue=0,port=16020): State: WAITING Blocked count: 88 Waited count: 194 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ce0d5e1 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 138 (B.defaultRpcServer.handler=99,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452563 Waited count: 509374 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 137 (B.defaultRpcServer.handler=98,queue=8,port=16020): State: RUNNABLE Blocked count: 118214 Waited count: 136318 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.readChannelFully(PacketReceiver.java:258) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:171) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:102) org.apache.hadoop.hdfs.RemoteBlockReader2.readNextPacket(RemoteBlockReader2.java:186) org.apache.hadoop.hdfs.RemoteBlockReader2.read(RemoteBlockReader2.java:146) org.apache.hadoop.hdfs.DFSInputStream$ByteArrayStrategy.doRead(DFSInputStream.java:686) org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:742) org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:799) org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:840) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.hbase.io.hfile.HFileBlock.readWithExtra(HFileBlock.java:678) Thread 136 (B.defaultRpcServer.handler=97,queue=7,port=16020): State: WAITING Blocked count: 230555 Waited count: 259232 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@48148720 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 135 (B.defaultRpcServer.handler=96,queue=6,port=16020): State: TIMED_WAITING Blocked count: 452045 Waited count: 508940 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 134 (B.defaultRpcServer.handler=95,queue=5,port=16020): State: TIMED_WAITING Blocked count: 583835 Waited count: 646520 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 133 (B.defaultRpcServer.handler=94,queue=4,port=16020): State: WAITING Blocked count: 477816 Waited count: 535255 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 132 (B.defaultRpcServer.handler=93,queue=3,port=16020): State: TIMED_WAITING Blocked count: 452794 Waited count: 509674 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 131 (B.defaultRpcServer.handler=92,queue=2,port=16020): State: WAITING Blocked count: 117729 Waited count: 135827 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@48148720 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 130 (B.defaultRpcServer.handler=91,queue=1,port=16020): State: TIMED_WAITING Blocked count: 452264 Waited count: 509190 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 129 (B.defaultRpcServer.handler=90,queue=0,port=16020): State: TIMED_WAITING Blocked count: 449650 Waited count: 506266 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 128 (B.defaultRpcServer.handler=89,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452641 Waited count: 509539 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 127 (B.defaultRpcServer.handler=88,queue=8,port=16020): State: WAITING Blocked count: 489111 Waited count: 546758 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 126 (B.defaultRpcServer.handler=87,queue=7,port=16020): State: WAITING Blocked count: 512791 Waited count: 572135 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 125 (B.defaultRpcServer.handler=86,queue=6,port=16020): State: WAITING Blocked count: 452003 Waited count: 507473 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 124 (B.defaultRpcServer.handler=85,queue=5,port=16020): State: TIMED_WAITING Blocked count: 582134 Waited count: 645295 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 123 (B.defaultRpcServer.handler=84,queue=4,port=16020): State: TIMED_WAITING Blocked count: 477766 Waited count: 535841 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 122 (B.defaultRpcServer.handler=83,queue=3,port=16020): State: WAITING Blocked count: 451423 Waited count: 507165 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 121 (B.defaultRpcServer.handler=82,queue=2,port=16020): State: WAITING Blocked count: 591662 Waited count: 653645 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 120 (B.defaultRpcServer.handler=81,queue=1,port=16020): State: TIMED_WAITING Blocked count: 450800 Waited count: 507637 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 119 (B.defaultRpcServer.handler=80,queue=0,port=16020): State: TIMED_WAITING Blocked count: 450469 Waited count: 507264 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 118 (B.defaultRpcServer.handler=79,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452405 Waited count: 509173 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 117 (B.defaultRpcServer.handler=78,queue=8,port=16020): State: TIMED_WAITING Blocked count: 488801 Waited count: 547993 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 116 (B.defaultRpcServer.handler=77,queue=7,port=16020): State: TIMED_WAITING Blocked count: 513659 Waited count: 574403 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 115 (B.defaultRpcServer.handler=76,queue=6,port=16020): State: WAITING Blocked count: 451937 Waited count: 507401 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 114 (B.defaultRpcServer.handler=75,queue=5,port=16020): State: WAITING Blocked count: 124006 Waited count: 142591 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@78acf542 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 113 (B.defaultRpcServer.handler=74,queue=4,port=16020): State: TIMED_WAITING Blocked count: 480485 Waited count: 538452 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 112 (B.defaultRpcServer.handler=73,queue=3,port=16020): State: WAITING Blocked count: 450920 Waited count: 506517 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 111 (B.defaultRpcServer.handler=72,queue=2,port=16020): State: TIMED_WAITING Blocked count: 591802 Waited count: 655144 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 110 (B.defaultRpcServer.handler=71,queue=1,port=16020): State: TIMED_WAITING Blocked count: 452571 Waited count: 509314 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 109 (B.defaultRpcServer.handler=70,queue=0,port=16020): State: TIMED_WAITING Blocked count: 451821 Waited count: 508367 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 108 (B.defaultRpcServer.handler=69,queue=9,port=16020): State: TIMED_WAITING Blocked count: 451929 Waited count: 508562 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 107 (B.defaultRpcServer.handler=68,queue=8,port=16020): State: WAITING Blocked count: 489640 Waited count: 547450 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 106 (B.defaultRpcServer.handler=67,queue=7,port=16020): State: TIMED_WAITING Blocked count: 513144 Waited count: 573325 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 105 (B.defaultRpcServer.handler=66,queue=6,port=16020): State: TIMED_WAITING Blocked count: 452824 Waited count: 509491 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 104 (B.defaultRpcServer.handler=65,queue=5,port=16020): State: BLOCKED Blocked count: 123353 Waited count: 141980 Blocked on org.apache.hadoop.hdfs.DFSInputStream@68710969 Blocked by 137 (B.defaultRpcServer.handler=98,queue=8,port=16020) Stack: org.apache.hadoop.hdfs.DFSInputStream.getFileLength(DFSInputStream.java:358) org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1278) org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:89) org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader.readAtOffset(HFileBlock.java:1380) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockDataInternal(HFileBlock.java:1591) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockData(HFileBlock.java:1470) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:437) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) Thread 103 (B.defaultRpcServer.handler=64,queue=4,port=16020): State: WAITING Blocked count: 476310 Waited count: 533847 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 102 (B.defaultRpcServer.handler=63,queue=3,port=16020): State: WAITING Blocked count: 452603 Waited count: 508356 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 101 (B.defaultRpcServer.handler=62,queue=2,port=16020): State: WAITING Blocked count: 594632 Waited count: 656609 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 100 (B.defaultRpcServer.handler=61,queue=1,port=16020): State: TIMED_WAITING Blocked count: 452626 Waited count: 509506 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 99 (B.defaultRpcServer.handler=60,queue=0,port=16020): State: TIMED_WAITING Blocked count: 453063 Waited count: 509661 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 98 (B.defaultRpcServer.handler=59,queue=9,port=16020): State: WAITING Blocked count: 462335 Waited count: 517801 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 97 (B.defaultRpcServer.handler=58,queue=8,port=16020): State: TIMED_WAITING Blocked count: 489531 Waited count: 548535 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 96 (B.defaultRpcServer.handler=57,queue=7,port=16020): State: TIMED_WAITING Blocked count: 512907 Waited count: 572976 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 95 (B.defaultRpcServer.handler=56,queue=6,port=16020): State: TIMED_WAITING Blocked count: 452193 Waited count: 509210 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 94 (B.defaultRpcServer.handler=55,queue=5,port=16020): State: WAITING Blocked count: 583314 Waited count: 645282 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 93 (B.defaultRpcServer.handler=54,queue=4,port=16020): State: TIMED_WAITING Blocked count: 477910 Waited count: 536897 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 92 (B.defaultRpcServer.handler=53,queue=3,port=16020): State: WAITING Blocked count: 452209 Waited count: 507957 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 91 (B.defaultRpcServer.handler=52,queue=2,port=16020): State: WAITING Blocked count: 120488 Waited count: 138877 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@7c049efb Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 90 (B.defaultRpcServer.handler=51,queue=1,port=16020): State: TIMED_WAITING Blocked count: 452732 Waited count: 509432 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 89 (B.defaultRpcServer.handler=50,queue=0,port=16020): State: TIMED_WAITING Blocked count: 450872 Waited count: 507715 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 88 (B.defaultRpcServer.handler=49,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452692 Waited count: 508961 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 87 (B.defaultRpcServer.handler=48,queue=8,port=16020): State: WAITING Blocked count: 489779 Waited count: 547413 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 86 (B.defaultRpcServer.handler=47,queue=7,port=16020): State: TIMED_WAITING Blocked count: 513597 Waited count: 573609 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 85 (B.defaultRpcServer.handler=46,queue=6,port=16020): State: TIMED_WAITING Blocked count: 451747 Waited count: 508030 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 84 (B.defaultRpcServer.handler=45,queue=5,port=16020): State: TIMED_WAITING Blocked count: 582313 Waited count: 645030 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 83 (B.defaultRpcServer.handler=44,queue=4,port=16020): State: WAITING Blocked count: 477056 Waited count: 534502 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 82 (B.defaultRpcServer.handler=43,queue=3,port=16020): State: TIMED_WAITING Blocked count: 452911 Waited count: 509847 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 81 (B.defaultRpcServer.handler=42,queue=2,port=16020): State: BLOCKED Blocked count: 120888 Waited count: 139261 Blocked on org.apache.hadoop.hdfs.DFSInputStream@68710969 Blocked by 137 (B.defaultRpcServer.handler=98,queue=8,port=16020) Stack: org.apache.hadoop.hdfs.DFSInputStream.getFileLength(DFSInputStream.java:358) org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1278) org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:89) org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader.readAtOffset(HFileBlock.java:1380) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockDataInternal(HFileBlock.java:1591) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockData(HFileBlock.java:1470) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:437) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) Thread 80 (B.defaultRpcServer.handler=41,queue=1,port=16020): State: TIMED_WAITING Blocked count: 451390 Waited count: 508055 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 79 (B.defaultRpcServer.handler=40,queue=0,port=16020): State: TIMED_WAITING Blocked count: 450717 Waited count: 507584 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 78 (B.defaultRpcServer.handler=39,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452088 Waited count: 508374 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 77 (B.defaultRpcServer.handler=38,queue=8,port=16020): State: TIMED_WAITING Blocked count: 495676 Waited count: 553747 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 76 (B.defaultRpcServer.handler=37,queue=7,port=16020): State: BLOCKED Blocked count: 176464 Waited count: 199878 Blocked on org.apache.hadoop.hdfs.DFSInputStream@68710969 Blocked by 137 (B.defaultRpcServer.handler=98,queue=8,port=16020) Stack: org.apache.hadoop.hdfs.DFSInputStream.getFileLength(DFSInputStream.java:358) org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1278) org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:89) org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader.readAtOffset(HFileBlock.java:1380) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockDataInternal(HFileBlock.java:1591) org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockData(HFileBlock.java:1470) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:437) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) Thread 75 (B.defaultRpcServer.handler=36,queue=6,port=16020): State: WAITING Blocked count: 451722 Waited count: 507121 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 74 (B.defaultRpcServer.handler=35,queue=5,port=16020): State: WAITING Blocked count: 584129 Waited count: 646131 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 73 (B.defaultRpcServer.handler=34,queue=4,port=16020): State: WAITING Blocked count: 476832 Waited count: 534264 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 72 (B.defaultRpcServer.handler=33,queue=3,port=16020): State: TIMED_WAITING Blocked count: 452794 Waited count: 510058 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 71 (B.defaultRpcServer.handler=32,queue=2,port=16020): State: TIMED_WAITING Blocked count: 598956 Waited count: 661782 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 70 (B.defaultRpcServer.handler=31,queue=1,port=16020): State: TIMED_WAITING Blocked count: 452414 Waited count: 509364 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 69 (B.defaultRpcServer.handler=30,queue=0,port=16020): State: TIMED_WAITING Blocked count: 451454 Waited count: 507577 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 68 (B.defaultRpcServer.handler=29,queue=9,port=16020): State: WAITING Blocked count: 455443 Waited count: 511111 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 67 (B.defaultRpcServer.handler=28,queue=8,port=16020): State: WAITING Blocked count: 491432 Waited count: 549111 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 66 (B.defaultRpcServer.handler=27,queue=7,port=16020): State: WAITING Blocked count: 512907 Waited count: 572275 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 65 (B.defaultRpcServer.handler=26,queue=6,port=16020): State: WAITING Blocked count: 452515 Waited count: 507960 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 64 (B.defaultRpcServer.handler=25,queue=5,port=16020): State: WAITING Blocked count: 188989 Waited count: 212629 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@37ae7823 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 63 (B.defaultRpcServer.handler=24,queue=4,port=16020): State: TIMED_WAITING Blocked count: 478349 Waited count: 536389 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 62 (B.defaultRpcServer.handler=23,queue=3,port=16020): State: WAITING Blocked count: 451118 Waited count: 506919 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 61 (B.defaultRpcServer.handler=22,queue=2,port=16020): State: WAITING Blocked count: 591911 Waited count: 654020 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 60 (B.defaultRpcServer.handler=21,queue=1,port=16020): State: WAITING Blocked count: 452355 Waited count: 507957 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 59 (B.defaultRpcServer.handler=20,queue=0,port=16020): State: TIMED_WAITING Blocked count: 450163 Waited count: 507056 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 58 (B.defaultRpcServer.handler=19,queue=9,port=16020): State: TIMED_WAITING Blocked count: 451732 Waited count: 508551 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 57 (B.defaultRpcServer.handler=18,queue=8,port=16020): State: TIMED_WAITING Blocked count: 489371 Waited count: 548474 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 56 (B.defaultRpcServer.handler=17,queue=7,port=16020): State: TIMED_WAITING Blocked count: 513541 Waited count: 574343 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 55 (B.defaultRpcServer.handler=16,queue=6,port=16020): State: TIMED_WAITING Blocked count: 452308 Waited count: 509298 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 54 (B.defaultRpcServer.handler=15,queue=5,port=16020): State: WAITING Blocked count: 583083 Waited count: 645218 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 53 (B.defaultRpcServer.handler=14,queue=4,port=16020): State: WAITING Blocked count: 476575 Waited count: 534197 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 52 (B.defaultRpcServer.handler=13,queue=3,port=16020): State: WAITING Blocked count: 452387 Waited count: 508200 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 51 (B.defaultRpcServer.handler=12,queue=2,port=16020): State: TIMED_WAITING Blocked count: 591780 Waited count: 654628 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 50 (B.defaultRpcServer.handler=11,queue=1,port=16020): State: WAITING Blocked count: 451630 Waited count: 507145 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 49 (B.defaultRpcServer.handler=10,queue=0,port=16020): State: TIMED_WAITING Blocked count: 457862 Waited count: 514541 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 48 (B.defaultRpcServer.handler=9,queue=9,port=16020): State: TIMED_WAITING Blocked count: 452069 Waited count: 508738 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 47 (B.defaultRpcServer.handler=8,queue=8,port=16020): State: TIMED_WAITING Blocked count: 489402 Waited count: 548345 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 46 (B.defaultRpcServer.handler=7,queue=7,port=16020): State: TIMED_WAITING Blocked count: 512574 Waited count: 573146 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 45 (B.defaultRpcServer.handler=6,queue=6,port=16020): State: TIMED_WAITING Blocked count: 451961 Waited count: 509036 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 44 (B.defaultRpcServer.handler=5,queue=5,port=16020): State: TIMED_WAITING Blocked count: 582496 Waited count: 645910 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 43 (B.defaultRpcServer.handler=4,queue=4,port=16020): State: WAITING Blocked count: 224987 Waited count: 253413 Waiting on org.apache.hadoop.hbase.util.IdLock$Entry@48148720 Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.util.IdLock.getLockEntry(IdLock.java:81) org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:397) org.apache.hadoop.hbase.io.hfile.HFileBlockIndex$BlockIndexReader.loadDataBlockWithScanInfo(HFileBlockIndex.java:259) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:634) org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:584) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:247) org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:156) org.apache.hadoop.hbase.regionserver.StoreScanner.seekScanners(StoreScanner.java:363) org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:217) org.apache.hadoop.hbase.regionserver.HStore.getScanner(HStore.java:2003) org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.(HRegion.java:5294) org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:2486) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2472) org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2454) org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2253) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) Thread 42 (B.defaultRpcServer.handler=3,queue=3,port=16020): State: WAITING Blocked count: 451923 Waited count: 507582 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 41 (B.defaultRpcServer.handler=2,queue=2,port=16020): State: TIMED_WAITING Blocked count: 592538 Waited count: 655984 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 40 (B.defaultRpcServer.handler=1,queue=1,port=16020): State: WAITING Blocked count: 452656 Waited count: 508189 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@6447ba67 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283) java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727) org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:666) org.apache.hadoop.hbase.regionserver.HRegion.applyFamilyMapToMemstore(HRegion.java:3621) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3038) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 39 (B.defaultRpcServer.handler=0,queue=0,port=16020): State: TIMED_WAITING Blocked count: 450756 Waited count: 507436 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5003) org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) java.lang.Thread.run(Thread.java:745) Thread 23 (RpcServer.listener,port=16020): State: RUNNABLE Blocked count: 13357 Waited count: 0 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener.run(RpcServer.java:730) Thread 35 (RpcServer.responder): State: RUNNABLE Blocked count: 47 Waited count: 3 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:969) org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:916) Thread 38 (main-EventThread): State: WAITING Blocked count: 3430 Waited count: 5306 Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7617c907 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Thread 37 (main-SendThread(10.11.51.80:2181)): State: RUNNABLE Blocked count: 1053 Waited count: 20 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Thread 34 (Timer for 'HBase' metrics system): State: TIMED_WAITING Blocked count: 0 Waited count: 16533 Stack: java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Thread 33 (RpcServer.reader=9,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1382 Waited count: 1476 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 32 (RpcServer.reader=8,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1383 Waited count: 1478 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 31 (RpcServer.reader=7,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1395 Waited count: 1493 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 30 (RpcServer.reader=6,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1382 Waited count: 1481 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 29 (RpcServer.reader=5,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1391 Waited count: 1475 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 28 (RpcServer.reader=4,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1385 Waited count: 1474 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 27 (RpcServer.reader=3,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1421 Waited count: 1474 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 26 (RpcServer.reader=2,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1414 Waited count: 1470 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 25 (RpcServer.reader=1,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1391 Waited count: 1467 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 24 (RpcServer.reader=0,bindAddress=dx-pipe-regionserver14-online,port=16020): State: RUNNABLE Blocked count: 1395 Waited count: 1463 Stack: sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:627) org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:614) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) java.lang.Thread.run(Thread.java:745) Thread 5 (Signal Dispatcher): State: RUNNABLE Blocked count: 0 Waited count: 0 Stack: Thread 3 (Finalizer): State: WAITING Blocked count: 17405 Waited count: 8394 Waiting on java.lang.ref.ReferenceQueue$Lock@62e7f11d Stack: java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:158) java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) Thread 2 (Reference Handler): State: WAITING Blocked count: 7458 Waited count: 5016 Waiting on java.lang.ref.Reference$Lock@503d687a Stack: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157) Thread 1 (main): State: WAITING Blocked count: 8 Waited count: 6 Waiting on java.lang.Thread@323cd886 Stack: java.lang.Object.wait(Native Method) java.lang.Thread.join(Thread.java:1245) java.lang.Thread.join(Thread.java:1319) org.apache.hadoop.hbase.util.HasThread.join(HasThread.java:89) org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66) org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87) org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2641) Stacks: =========================================================== RS Configuration: =========================================================== dfs.journalnode.rpc-address0.0.0.0:8485hdfs-default.xml io.storefile.bloom.block.size131072hbase-default.xml yarn.ipc.rpc.classorg.apache.hadoop.yarn.ipc.HadoopYarnProtoRPCyarn-default.xml mapreduce.job.maxtaskfailures.per.tracker3mapred-default.xml hbase.rest.threads.min2hbase-default.xml hbase.rs.cacheblocksonwritefalsehbase-default.xml ha.health-monitor.connect-retry-interval.ms1000core-default.xml yarn.resourcemanager.work-preserving-recovery.enabledfalseyarn-default.xml dfs.client.mmap.cache.size256hdfs-default.xml mapreduce.reduce.markreset.buffer.percent0.0mapred-default.xml dfs.datanode.data.dir /disk1/hadoop/hdfs-data/datanode, /disk2/hadoop/hdfs-data/datanode, /disk3/hadoop/hdfs-data/datanode, /disk4/hadoop/hdfs-data/datanode, /disk5/hadoop/hdfs-data/datanode, /disk6/hadoop/hdfs-data/datanode, /disk7/hadoop/hdfs-data/datanode, /disk8/hadoop/hdfs-data/datanode, /disk9/hadoop/hdfs-data/datanode, /disk10/hadoop/hdfs-data/datanode, /disk11/hadoop/hdfs-data/datanode, /disk12/hadoop/hdfs-data/datanode hdfs-site.xml mapreduce.jobhistory.max-age-ms604800000mapred-default.xml mapreduce.job.ubertask.enablefalsemapred-default.xml dfs.namenode.delegation.token.renew-interval86400000hdfs-default.xml yarn.nodemanager.log-aggregation.compression-typenoneyarn-default.xml dfs.namenode.replication.considerLoadtruehdfs-default.xml mapreduce.job.complete.cancel.delegation.tokenstruemapred-default.xml mapreduce.jobhistory.datestring.cache.size200000mapred-default.xml hbase.status.multicast.address.ip226.1.1.3hbase-default.xml dfs.namenode.retrycache.heap.percent0.03fhdfs-default.xml yarn.resourcemanager.scheduler.address${yarn.resourcemanager.hostname}:8030yarn-default.xml dfs.namenode.logging.levelinfohdfs-default.xml dfs.client.file-block-storage-locations.num-threads10hdfs-default.xml dfs.datanode.balance.bandwidthPerSec1048576hdfs-default.xml io.mapfile.bloom.error.rate0.005core-default.xml yarn.nodemanager.resourcemanager.minimum.versionNONEyarn-default.xml yarn.resourcemanager.nodemanagers.heartbeat-interval-ms1000yarn-default.xml dfs.secondary.namenode.kerberos.internal.spnego.principal${dfs.web.authentication.kerberos.principal}hdfs-default.xml yarn.nodemanager.delete.debug-delay-sec0yarn-default.xml dfs.client.read.shortcircuit.streams.cache.size256hdfs-default.xml yarn.scheduler.maximum-allocation-vcores32yarn-default.xml dfs.image.transfer.bandwidthPerSec0hdfs-default.xml hfile.block.bloom.cacheonwritefalsehbase-default.xml hbase.zookeeper.quorumdx-pipe-zk1-online,dx-pipe-zk2-online,dx-pipe-zk3-online,dx-pipe-zk4-online,dx-pipe-zk5-onlinehbase-site.xml hbase.http.staticuser.userdr.stackhbase-default.xml yarn.timeline-service.address${yarn.timeline-service.hostname}:10200yarn-default.xml yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb0yarn-default.xml mapreduce.job.hdfs-servers${fs.defaultFS}yarn-default.xml mapreduce.task.profile.reduce.params${mapreduce.task.profile.params}mapred-default.xml hbase.zookeeper.property.syncLimit5hbase-default.xml dfs.namenode.fs-limits.min-block-size1048576hdfs-default.xml dfs.namenode.http-address.f04.nn2f05:50070hdfs-site.xml dfs.namenode.http-address.f04.nn1f04:50070hdfs-site.xml ftp.stream-buffer-size4096core-default.xml dfs.client.use.legacy.blockreader.localfalsehdfs-default.xml dfs.datanode.directoryscan.threads1hdfs-default.xml dfs.short.circuit.shared.memory.watcher.interrupt.check.ms60000hdfs-default.xml yarn.client.application-client-protocol.poll-interval-ms200yarn-default.xml yarn.timeline-service.leveldb-timeline-store.path${hadoop.tmp.dir}/yarn/timelineyarn-default.xml mapreduce.job.split.metainfo.maxsize10000000mapred-default.xml dfs.namenode.edits.noeditlogchannelflushfalsehdfs-default.xml s3native.bytes-per-checksum512core-default.xml hbase.rest.filter.classesorg.apache.hadoop.hbase.rest.filter.GzipFilterhbase-default.xml yarn.client.failover-retries-on-socket-timeouts0yarn-default.xml dfs.namenode.startup.delay.block.deletion.sec0hdfs-default.xml dfs.webhdfs.user.provider.user.pattern^[A-Za-z_][A-Za-z0-9._-]*[$]?$hdfs-default.xml mapreduce.tasktracker.tasks.sleeptimebeforesigkill5000mapred-default.xml hadoop.http.authentication.typesimplecore-default.xml dfs.namenode.path.based.cache.refresh.interval.ms30000hdfs-default.xml mapreduce.local.clientfactory.class.nameorg.apache.hadoop.mapred.LocalClientFactorymapred-default.xml ipc.client.connection.maxidletime10000core-default.xml dfs.namenode.safemode.threshold-pct0.999fhdfs-default.xml hfile.block.cache.size0.4hbase-default.xml hbase.rpc.controllerfactory.classorg.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactoryhbase-site.xml dfs.namenode.num.checkpoints.retained2hdfs-default.xml hbase.hregion.memstore.mslab.enabledtruehbase-default.xml mapreduce.job.ubertask.maxmaps9mapred-default.xml dfs.namenode.stale.datanode.interval30000hdfs-default.xml yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage100.0yarn-default.xml mapreduce.tasktracker.http.address0.0.0.0:50060mapred-default.xml mapreduce.ifile.readahead.bytes4194304mapred-default.xml mapreduce.jobhistory.admin.address0.0.0.0:10033mapred-default.xml s3.client-write-packet-size65536core-default.xml hbase.master.port16000hbase-default.xml dfs.block.access.token.lifetime600hdfs-default.xml yarn.app.mapreduce.am.resource.cpu-vcores1mapred-default.xml hbase.regionserver.checksum.verifytruehbase-default.xml dfs.namenode.num.extra.edits.retained1000000hdfs-default.xml hbase.security.visibility.mutations.checkauthsfalsehbase-default.xml mapreduce.reduce.shuffle.input.buffer.percent0.70mapred-default.xml hadoop.http.staticuser.userdr.whocore-default.xml mapreduce.reduce.maxattempts4mapred-default.xml hadoop.security.group.mapping.ldap.search.filter.user(&(objectClass=user)(sAMAccountName={0}))core-default.xml mapreduce.jobhistory.admin.acl*mapred-default.xml dfs.client.contextdefaulthdfs-default.xml mapreduce.map.maxattempts4mapred-default.xml yarn.resourcemanager.zk-retry-interval-ms1000yarn-default.xml mapreduce.jobhistory.cleaner.interval-ms86400000mapred-default.xml dfs.datanode.drop.cache.behind.readsfalsehdfs-default.xml hbase.server.versionfile.writeattempts3hbase-default.xml dfs.permissions.superusergroupsupergrouphdfs-default.xml hbase.zookeeper.useMultitruehbase-default.xml fs.s3n.block.size67108864core-default.xml dfs.namenode.list.cache.pools.num.responses100hdfs-default.xml hbase.zookeeper.leaderport3888hbase-default.xml dfs.datanode.slow.io.warning.threshold.ms300hdfs-default.xml hbase.master.info.port60010programatically dfs.namenode.fs-limits.max-blocks-per-file1048576hdfs-default.xml yarn.nodemanager.vmem-check-enabledtrueyarn-default.xml hadoop.security.authenticationsimplecore-default.xml mapreduce.reduce.cpu.vcores1mapred-default.xml net.topology.node.switch.mapping.implorg.apache.hadoop.net.ScriptBasedMappingcore-default.xml fs.s3.sleepTimeSeconds10core-default.xml yarn.timeline-service.ttl-ms604800000yarn-default.xml yarn.resourcemanager.keytab/etc/krb5.keytabyarn-default.xml yarn.resourcemanager.container.liveness-monitor.interval-ms600000yarn-default.xml mapreduce.jobtracker.heartbeats.in.second100mapred-default.xml yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms1000mapred-default.xml yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts3mapred-default.xml yarn.nodemanager.linux-container-executor.cgroups.hierarchy/hadoop-yarnyarn-default.xml s3.bytes-per-checksum512core-default.xml hbase.regionserver.dns.nameserverdefaulthbase-default.xml hadoop.ssl.require.client.certfalsecore-default.xml mapreduce.output.fileoutputformat.compressfalsemapred-default.xml dfs.journalnode.http-address0.0.0.0:8480hdfs-default.xml dfs.ha.automatic-failover.enabledtruehdfs-site.xml hbase.ipc.server.callqueue.read.ratio0hbase-default.xml hbase.cluster.distributedtruehbase-site.xml hbase.rootdirhdfs://f04/hbaseprogramatically yarn.resourcemanager.webapp.delegation-token-auth-filter.enabledtrueyarn-default.xml mapreduce.shuffle.max.threads0mapred-default.xml hbase.coprocessor.regionserver.classesorg.apache.hadoop.hbase.regionserver.LocalIndexMergerhbase-site.xml s3native.client-write-packet-size65536core-default.xml dfs.namenode.invalidate.work.pct.per.iteration0.32fhdfs-default.xml dfs.client.block.write.replace-datanode-on-failure.policyDEFAULThdfs-default.xml mapreduce.client.submit.file.replication10mapred-default.xml yarn.app.mapreduce.am.job.committer.commit-window10000mapred-default.xml yarn.nodemanager.sleep-delay-before-sigkill.ms250yarn-default.xml yarn.nodemanager.env-whitelistJAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOMEyarn-default.xml dfs.namenode.acls.enabledfalsehdfs-default.xml dfs.namenode.secondary.http-address0.0.0.0:50090hdfs-default.xml mapreduce.map.speculativetruemapred-default.xml mapreduce.job.speculative.slowtaskthreshold1.0mapred-default.xml mapreduce.task.tmp.dir./tmpmapred-default.xml yarn.nodemanager.linux-container-executor.cgroups.mountfalseyarn-default.xml hbase.auth.token.max.lifetime604800000hbase-default.xml hbase.regionserver.msginterval3000hbase-default.xml mapreduce.tasktracker.http.threads40mapred-default.xml mapreduce.jobhistory.http.policyHTTP_ONLYmapred-default.xml hbase.ipc.client.fallback-to-simple-auth-allowedfalsehbase-default.xml hbase.rest.threads.max100hbase-default.xml fs.s3.buffer.dir${hadoop.tmp.dir}/s3core-default.xml hbase.snapshot.enabledtruehbase-default.xml hbase.dynamic.jars.dir${hbase.rootdir}/libhbase-default.xml hbase.defaults.for.version1.1.1hbase-default.xml io.native.lib.availabletruecore-default.xml mapreduce.jobhistory.done-dir${yarn.app.mapreduce.am.staging-dir}/history/donemapred-default.xml hbase.regions.slop0.2hbase-default.xml dfs.namenode.avoid.write.stale.datanodefalsehdfs-default.xml dfs.namenode.checkpoint.txns1000000hdfs-default.xml hadoop.ssl.hostname.verifierDEFAULTcore-default.xml zookeeper.znode.rootserverroot-region-serverhbase-default.xml mapreduce.task.timeout600000mapred-default.xml hbase.client.max.perserver.tasks5hbase-default.xml yarn.nodemanager.disk-health-checker.interval-ms120000yarn-default.xml hadoop.security.groups.cache.secs300core-default.xml dfs.journalnode.https-address0.0.0.0:8481hdfs-default.xml mapreduce.input.fileinputformat.split.minsize0mapred-default.xml dfs.datanode.sync.behind.writesfalsehdfs-default.xml zookeeper.session.timeout90000hbase-default.xml ipc.server.tcpnodelayfalsecore-default.xml mapreduce.shuffle.port13562mapred-default.xml hadoop.rpc.protectionauthenticationcore-default.xml dfs.client.https.keystore.resourcessl-client.xmlhdfs-default.xml yarn.client.failover-proxy-providerorg.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvideryarn-default.xml mapreduce.jobtracker.retiredjobs.cache.size1000mapred-default.xml hbase.balancer.period300000hbase-default.xml yarn.nodemanager.resourcemanager.connect.retry_interval.secs30yarn-default.xml ipc.client.tcpnodelayfalsecore-default.xml fs.s3.maxRetries4core-default.xml dfs.datanode.drop.cache.behind.writesfalsehdfs-default.xml dfs.ha.tail-edits.period60hdfs-default.xml mapreduce.jobtracker.addresslocalmapred-default.xml hadoop.http.authentication.kerberos.principalHTTP/_HOST@LOCALHOSTcore-default.xml nfs.server.port2049hdfs-default.xml yarn.resourcemanager.webapp.address${yarn.resourcemanager.hostname}:8088yarn-default.xml mapreduce.task.profile.reduces0-2mapred-default.xml yarn.resourcemanager.am.max-attempts2yarn-default.xml hbase.hstore.blockingWaitTime90000hbase-default.xml nfs.dump.dir/tmp/.hdfs-nfshdfs-default.xml hbase.client.pause100hbase-default.xml hbase.client.write.buffer2097152hbase-default.xml dfs.bytes-per-checksum512hdfs-default.xml mapreduce.job.end-notification.max.retry.interval5000mapred-default.xml ipc.client.connect.retry.interval1000core-default.xml yarn.app.mapreduce.am.command-opts-Xmx1024mmapred-default.xml yarn.nodemanager.process-kill-wait.ms2000yarn-default.xml hbase.rpc.timeout3600000hbase-site.xml hbase.metrics.exposeOperationTimestruehbase-default.xml dfs.namenode.safemode.min.datanodes0hdfs-default.xml hbase.thrift.maxWorkerThreads1000hbase-default.xml dfs.ha.namenodes.f04nn1,nn2hdfs-site.xml dfs.namenode.write.stale.datanode.ratio0.5fhdfs-default.xml hadoop.jetty.logs.serve.aliasestruecore-default.xml fs.du.interval600000core-default.xml mapreduce.tasktracker.dns.nameserverdefaultmapred-default.xml hbase.master.catalog.timeout600000hbase-default.xml mapreduce.task.merge.progress.records10000mapred-default.xml hbase.region.replica.replication.enabledfalsehbase-default.xml dfs.webhdfs.enabledtruehdfs-site.xml hadoop.ssl.client.confssl-client.xmlcore-default.xml mapreduce.job.counters.max120mapred-default.xml yarn.nodemanager.localizer.fetch.thread-count4yarn-default.xml io.mapfile.bloom.size1048576core-default.xml yarn.nodemanager.localizer.client.thread-count5yarn-default.xml fs.automatic.closetruecore-default.xml mapreduce.task.profilefalsemapred-default.xml dfs.namenode.edit.log.autoroll.multiplier.threshold2.0hdfs-default.xml mapreduce.shuffle.ssl.file.buffer.size65536mapred-default.xml fs.swift.implorg.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemcore-default.xml yarn.app.mapreduce.am.container.log.backups0mapred-default.xml hbase.hstore.bytes.per.checksum16384hbase-default.xml yarn.ipc.serializer.typeprotocolbuffersyarn-default.xml dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction0.75fhdfs-default.xml hbase.hstore.flusher.count2hbase-default.xml hbase.bucketcache.ioenginefile:/home/shared/maintain/hbase/cache/cache.datahbase-site.xml dfs.namenode.backup.address0.0.0.0:50100hdfs-default.xml dfs.client.https.need-authfalsehdfs-default.xml mapreduce.app-submission.cross-platformfalsemapred-default.xml yarn.timeline-service.ttl-enabletrueyarn-default.xml yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabledfalseyarn-default.xml yarn.nodemanager.keytab/etc/krb5.keytabyarn-default.xml dfs.namenode.xattrs.enabledtruehdfs-default.xml hbase.region.server.rpc.scheduler.factory.classorg.apache.hadoop.hbase.ipc.PhoenixRpcSchedulerFactoryhbase-site.xml dfs.client.write.exclude.nodes.cache.expiry.interval.millis600000hdfs-default.xml mapreduce.jobtracker.restart.recoverfalsemapred-default.xml mapreduce.map.skip.proc.count.autoincrtruemapred-default.xml dfs.namenode.datanode.registration.ip-hostname-checktruehdfs-default.xml dfs.image.transfer.chunksize65536hdfs-default.xml hadoop.security.instrumentation.requires.adminfalsecore-default.xml io.compression.codec.bzip2.librarysystem-nativecore-default.xml dfs.namenode.name.dir.restorefalsehdfs-default.xml hbase.client.retries.number350programatically hadoop.ssl.keystores.factory.classorg.apache.hadoop.security.ssl.FileBasedKeyStoresFactorycore-default.xml dfs.namenode.list.cache.directives.num.responses100hdfs-default.xml hbase.status.multicast.address.port16100hbase-default.xml fs.ftp.host0.0.0.0core-default.xml hbase.hstore.checksum.algorithmCRC32hbase-default.xml s3.blocksize67108864core-default.xml s3native.stream-buffer-size4096core-default.xml mapreduce.jobtracker.taskschedulerorg.apache.hadoop.mapred.JobQueueTaskSchedulermapred-default.xml dfs.datanode.dns.nameserverdefaulthdfs-default.xml yarn.nodemanager.resource.memory-mb8192yarn-default.xml mapreduce.task.userlog.limit.kb0mapred-default.xml mapreduce.reduce.speculativetruemapred-default.xml yarn.nodemanager.container-monitor.interval-ms3000yarn-default.xml dfs.replication.max512hdfs-default.xml dfs.replication3hdfs-default.xml dfs.ha.fencing.methods sshfence shell(/home/maintain/bin/true.sh) hdfs-site.xml yarn.client.failover-retries0yarn-default.xml yarn.nodemanager.resource.cpu-vcores8yarn-default.xml mapreduce.jobhistory.recovery.enablefalsemapred-default.xml hbase.server.thread.wakefrequency10000hbase-default.xml nfs.exports.allowed.hosts* rwcore-default.xml hbase.lease.recovery.timeout900000hbase-default.xml hbase.coordinated.state.manager.classorg.apache.hadoop.hbase.coordination.ZkCoordinatedStateManagerhbase-default.xml mapreduce.reduce.shuffle.memory.limit.percent0.25mapred-default.xml file.replication1core-default.xml mapreduce.job.reduce.shuffle.consumer.plugin.classorg.apache.hadoop.mapreduce.task.reduce.Shufflemapred-default.xml hfile.format.version3hbase-default.xml mapreduce.job.jvm.numtasks1mapred-default.xml dfs.datanode.fsdatasetcache.max.threads.per.volume4hdfs-default.xml mapreduce.am.max-attempts2mapred-default.xml mapreduce.shuffle.connection-keep-alive.timeout5mapred-default.xml hadoop.fuse.timer.period5hdfs-default.xml mapreduce.job.reduces1mapred-default.xml hbase.thrift.minWorkerThreads16hbase-default.xml hbase.zookeeper.dns.interfacedefaulthbase-default.xml yarn.app.mapreduce.am.job.task.listener.thread-count30mapred-default.xml yarn.resourcemanager.store.classorg.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStoreyarn-default.xml mapreduce.job.speculative.slownodethreshold1.0mapred-default.xml s3native.replication3core-default.xml mapreduce.tasktracker.reduce.tasks.maximum2mapred-default.xml hbase.snapshot.restore.failsafe.namehbase-failsafe-{snapshot.name}-{restore.timestamp}hbase-default.xml fs.permissions.umask-mode022core-default.xml mapreduce.cluster.local.dir${hadoop.tmp.dir}/mapred/localmapred-default.xml mapreduce.client.output.filterFAILEDmapred-default.xml yarn.nodemanager.pmem-check-enabledtrueyarn-default.xml dfs.client.failover.connection.retries.on.timeouts0hdfs-default.xml mapreduce.jobtracker.instrumentationorg.apache.hadoop.mapred.JobTrackerMetricsInstmapred-default.xml ftp.replication3core-default.xml hbase.hstore.blockingStoreFiles10hbase-default.xml hadoop.security.group.mapping.ldap.search.attr.membermembercore-default.xml hbase.regionserver.hlog.reader.implorg.apache.hadoop.hbase.regionserver.wal.ProtobufLogReaderhbase-default.xml dfs.namenode.replication.work.multiplier.per.iteration2hdfs-default.xml yarn.resourcemanager.resource-tracker.address${yarn.resourcemanager.hostname}:8031yarn-default.xml mapreduce.tasktracker.outofband.heartbeatfalsemapred-default.xml hbase.master.info.bindAddress0.0.0.0hbase-default.xml dfs.namenode.edits.dir${dfs.namenode.name.dir}hdfs-default.xml yarn.resourcemanager.scheduler.monitor.enablefalseyarn-default.xml fs.trash.checkpoint.interval0core-default.xml dfs.client.read.shortcircuit.streams.cache.expiry.ms300000hdfs-default.xml yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size10000yarn-default.xml s3.stream-buffer-size4096core-default.xml file.client-write-packet-size65536core-default.xml mapreduce.tasktracker.healthchecker.script.timeout600000mapred-default.xml hbase.status.listener.classorg.apache.hadoop.hbase.client.ClusterStatusListener$MulticastListenerhbase-default.xml dfs.namenode.fs-limits.max-directory-items1048576hdfs-default.xml mapreduce.tasktracker.taskcontrollerorg.apache.hadoop.mapred.DefaultTaskControllermapred-default.xml dfs.namenode.path.based.cache.block.map.allocation.percent0.25hdfs-default.xml dfs.namenode.checkpoint.dirfile://${hadoop.tmp.dir}/dfs/namesecondaryhdfs-default.xml hbase.regionserver.dns.interfacedefaulthbase-default.xml yarn.nodemanager.remote-app-log-dir/tmp/logsyarn-default.xml mapreduce.reduce.shuffle.retry-delay.max.ms60000mapred-default.xml io.map.index.interval128core-default.xml dfs.client.block.write.replace-datanode-on-failure.enabletruehdfs-default.xml dfs.namenode.replication.interval3hdfs-default.xml hbase.rest.port8080hbase-default.xml hbase.regionserver.handler.count100hbase-site.xml hadoop.ssl.server.confssl-server.xmlcore-default.xml dfs.nameservicesf04hdfs-site.xml hadoop.rpc.socket.factory.class.defaultorg.apache.hadoop.net.StandardSocketFactorycore-default.xml yarn.app.mapreduce.client.max-retries3mapred-default.xml yarn.nodemanager.address${yarn.nodemanager.hostname}:0yarn-default.xml hbase.ipc.server.callqueue.scan.ratio0hbase-default.xml dfs.datanode.max.transfer.threads4096hdfs-default.xml ha.failover-controller.graceful-fence.rpc-timeout.ms5000core-default.xml dfs.datanode.ipc.address0.0.0.0:50020hdfs-default.xml yarn.resourcemanager.delayed.delegation-token.removal-interval-ms30000yarn-default.xml yarn.timeline-service.enabledfalseyarn-default.xml dfs.client.cached.conn.retry3hdfs-default.xml dfs.namenode.backup.http-address0.0.0.0:50105hdfs-default.xml mapreduce.tasktracker.report.address127.0.0.1:0mapred-default.xml hbase.bulkload.retries.number10hbase-default.xml dfs.namenode.checkpoint.period3600hdfs-default.xml mapreduce.task.attempt.idhb_rs_dx-pipe-regionserver14-online,16020,1464166068185programatically hbase.hregion.max.filesize10737418240hbase-default.xml dfs.datanode.shared.file.descriptor.paths/dev/shm,/tmphdfs-default.xml hbase.master.loadbalancer.classorg.apache.phoenix.hbase.index.balancer.IndexLoadBalancerhbase-site.xml dfs.http.policyHTTP_ONLYhdfs-default.xml hadoop.security.groups.cache.warn.after.ms5000core-default.xml dfs.namenode.fs-limits.max-xattrs-per-inode32hdfs-default.xml yarn.resourcemanager.zk-aclworld:anyone:rwcdayarn-default.xml mapreduce.job.speculative.speculativecap0.1mapred-default.xml dfs.namenode.support.allow.formattruehdfs-default.xml dfs.namenode.checkpoint.max-retries3hdfs-default.xml zookeeper.znode.acl.parentaclhbase-default.xml hbase.status.publisher.classorg.apache.hadoop.hbase.master.ClusterStatusPublisher$MulticastPublisherhbase-default.xml yarn.resourcemanager.fs.state-store.retry-policy-spec2000, 500yarn-default.xml hbase.tmp.dir${java.io.tmpdir}/hbase-${user.name}hbase-default.xml dfs.namenode.rpc-address.f04.nn2f05:8020hdfs-site.xml dfs.namenode.rpc-address.f04.nn1f04:8020hdfs-site.xml dfs.namenode.decommission.nodes.per.interval5hdfs-default.xml mapreduce.job.committer.setup.cleanup.neededtruemapred-default.xml mapreduce.job.end-notification.retry.attempts0mapred-default.xml yarn.resourcemanager.state-store.max-completed-applications${yarn.resourcemanager.max-completed-applications}yarn-default.xml hbase.http.max.threads10hbase-default.xml mapreduce.map.output.compressfalsemapred-default.xml hbase.client.localityCheck.threadPoolSize2hbase-default.xml yarn.timeline-service.generic-application-history.store-classorg.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStoreyarn-default.xml mapreduce.jobhistory.cleaner.enabletruemapred-default.xml io.seqfile.local.dir${hadoop.tmp.dir}/io/localcore-default.xml dfs.blockreport.split.threshold1000000hdfs-default.xml mapreduce.reduce.shuffle.read.timeout180000mapred-default.xml mapreduce.job.queuenamedefaultmapred-default.xml ipc.client.connect.max.retries10core-default.xml io.seqfile.lazydecompresstruecore-default.xml yarn.app.mapreduce.am.staging-dir/tmp/hadoop-yarn/stagingmapred-default.xml yarn.nodemanager.linux-container-executor.resources-handler.classorg.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandleryarn-default.xml yarn.timeline-service.leveldb-timeline-store.read-cache-size104857600yarn-default.xml hbase.master.distributed.log.replayfalsehbase-default.xml io.file.buffer.size4096core-default.xml ha.zookeeper.parent-znode/hadoop-hacore-default.xml mapreduce.tasktracker.indexcache.mb10mapred-default.xml tfile.io.chunk.size1048576core-default.xml yarn.timeline-service.keytab/etc/krb5.keytabyarn-default.xml yarn.acl.enablefalseyarn-default.xml hbase.regionserver.regionSplitLimit1000hbase-default.xml hadoop.security.group.mapping.ldap.directory.search.timeout10000core-default.xml yarn.nodemanager.resourcemanager.connect.wait.secs900yarn-default.xml mapreduce.job.token.tracking.ids.enabledfalsemapred-default.xml hbase.thrift.maxQueuedRequests1000hbase-default.xml mapreduce.map.output.compress.codecorg.apache.hadoop.io.compress.DefaultCodecmapred-default.xml s3.replication3core-default.xml tfile.fs.input.buffer.size262144core-default.xml ha.failover-controller.graceful-fence.connection.retries1core-default.xml net.topology.script.number.args100core-default.xml fs.s3n.multipart.uploads.block.size67108864core-default.xml hfile.block.index.cacheonwritefalsehbase-default.xml yarn.nodemanager.recovery.dir${hadoop.tmp.dir}/yarn-nm-recoveryyarn-default.xml hadoop.ssl.enabledfalsecore-default.xml yarn.timeline-service.handler-thread-count10yarn-default.xml hbase.config.read.zookeeper.configfalsehbase-default.xml hbase.master.wait.on.regionservers.mintostart1hbase-site.xml hbase.column.max.version1hbase-default.xml dfs.client.read.shortcircuit.buffer.size131072programatically dfs.namenode.reject-unresolved-dn-topology-mappingfalsehdfs-default.xml mapreduce.jobhistory.recovery.store.classorg.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreServicemapred-default.xml yarn.nodemanager.log.retain-seconds10800yarn-default.xml yarn.resourcemanager.admin.address${yarn.resourcemanager.hostname}:8033yarn-default.xml yarn.resourcemanager.recovery.enabledfalseyarn-default.xml dfs.client.slow.io.warning.threshold.ms30000hdfs-default.xml yarn.resourcemanager.ha.automatic-failover.zk-base-path/yarn-leader-electionyarn-default.xml fs.AbstractFileSystem.viewfs.implorg.apache.hadoop.fs.viewfs.ViewFscore-default.xml mapreduce.tasktracker.dns.interfacedefaultmapred-default.xml mapreduce.jobtracker.handler.count10mapred-default.xml dfs.blockreport.initialDelay0hdfs-default.xml fs.AbstractFileSystem.hdfs.implorg.apache.hadoop.fs.Hdfscore-default.xml hbase.bucketcache.size30720hbase-site.xml dfs.namenode.retrycache.expirytime.millis600000hdfs-default.xml dfs.client.failover.sleep.max.millis15000hdfs-default.xml hbase.bucketcache.combinedcache.enabledtruehbase-site.xml hbase.zookeeper.property.clientPort2181hbase-site.xml yarn.resourcemanager.max-completed-applications10000yarn-default.xml yarn.nodemanager.log-dirs${yarn.log.dir}/userlogsyarn-default.xml yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$yarn-default.xml dfs.client.failover.sleep.base.millis500hdfs-default.xml hbase.rest.readonlyfalsehbase-default.xml dfs.default.chunk.view.size32768hdfs-default.xml dfs.client.read.shortcircuitfalsehdfs-default.xml ftp.blocksize67108864core-default.xml mapreduce.job.acl-modify-job mapred-default.xml zookeeper.znode.parent/hbase-testhbase-site.xml fs.defaultFShdfs://f04programatically hbase.rpc.shortoperation.timeout10000hbase-default.xml hadoop.http.filter.initializersorg.apache.hadoop.http.lib.StaticUserWebFiltercore-default.xml fs.s3n.multipart.copy.block.size5368709120core-default.xml yarn.resourcemanager.connect.max-wait.ms900000yarn-default.xml hadoop.security.group.mapping.ldap.sslfalsecore-default.xml dfs.namenode.max.extra.edits.segments.retained10000hdfs-default.xml dfs.namenode.https-address0.0.0.0:50470hdfs-default.xml yarn.resourcemanager.admin.client.thread-count1yarn-default.xml ipc.client.kill.max10core-default.xml hadoop.security.group.mapping.ldap.search.filter.group(objectClass=group)core-default.xml fs.AbstractFileSystem.file.implorg.apache.hadoop.fs.local.LocalFscore-default.xml hadoop.http.authentication.kerberos.keytab${user.home}/hadoop.keytabcore-default.xml mapreduce.job.map.output.collector.classorg.apache.hadoop.mapred.MapTask$MapOutputBuffermapred-default.xml dfs.namenode.path.based.cache.retry.interval.ms30000hdfs-default.xml hadoop.security.uid.cache.secs14400core-default.xml mapreduce.map.cpu.vcores1mapred-default.xml yarn.log-aggregation.retain-check-interval-seconds-1yarn-default.xml mapreduce.map.log.levelINFOmapred-default.xml mapred.child.java.opts-Xmx200mmapred-default.xml hfile.index.block.max.size131072hbase-default.xml hbase.client.scanner.timeout.period60000hbase-default.xml dfs.support.broken.appendtruehdfs-site.xml yarn.nodemanager.local-cache.max-files-per-directory8192yarn-default.xml dfs.https.server.keystore.resourcessl-server.xmlhdfs-default.xml mapreduce.jobtracker.taskcache.levels2mapred-default.xml dfs.datanode.handler.count10hdfs-default.xml s3native.blocksize67108864core-default.xml yarn.resourcemanager.nm.liveness-monitor.interval-ms1000yarn-default.xml mapreduce.client.completion.pollinterval5000mapred-default.xml hbase.hstore.compactionThreshold3hbase-default.xml dfs.stream-buffer-size4096hdfs-default.xml dfs.namenode.delegation.key.update-interval86400000hdfs-default.xml mapreduce.job.maps2mapred-default.xml hbase.master.logcleaner.ttl600000hbase-default.xml mapreduce.job.acl-view-job mapred-default.xml dfs.namenode.enable.retrycachetruehdfs-default.xml yarn.resourcemanager.connect.retry-interval.ms30000yarn-default.xml dfs.namenode.shared.edits.dirqjournal://f04:8485;f05:8485;f06:8485/f04hdfs-site.xml yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms300000yarn-default.xml dfs.namenode.decommission.interval30hdfs-default.xml hbase.rootdir.perms700hbase-default.xml hbase.hregion.majorcompaction604800000hbase-default.xml mapreduce.shuffle.max.connections0mapred-default.xml yarn.log-aggregation-enablefalseyarn-default.xml dfs.client-write-packet-size65536hdfs-default.xml dfs.client.file-block-storage-locations.timeout.millis1000hdfs-default.xml mapreduce.jobtracker.expire.trackers.interval600000mapred-default.xml dfs.client.block.write.retries3hdfs-default.xml mapreduce.task.io.sort.factor10mapred-default.xml hbase.hregion.memstore.flush.size134217728hbase-default.xml ha.health-monitor.sleep-after-disconnect.ms1000core-default.xml ha.zookeeper.session-timeout.ms5000core-default.xml dfs.support.appendtruehdfs-site.xml mapreduce.input.fileinputformat.list-status.num-threads1mapred-default.xml io.skip.checksum.errorsfalsecore-default.xml hbase.ipc.client.tcpnodelaytruehbase-default.xml hbase.regionserver.optionalcacheflushinterval3600000hbase-default.xml yarn.resourcemanager.scheduler.client.thread-count50yarn-default.xml dfs.namenode.safemode.extension30000hdfs-default.xml mapreduce.jobhistory.move.thread-count3mapred-default.xml yarn.resourcemanager.zk-state-store.parent-path/rmstoreyarn-default.xml ipc.client.idlethreshold4000core-default.xml hbase.regionserver.port16020hbase-default.xml dfs.namenode.accesstime.precision3600000hdfs-default.xml mapreduce.task.profile.params-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%smapred-default.xml hbase.hstore.time.to.purge.deletes0hbase-default.xml hbase.regionserver.logroll.errors.tolerated2hbase-default.xml mapreduce.jobhistory.keytab/etc/security/keytab/jhs.service.keytabmapred-default.xml hbase.hstore.compaction.max10hbase-default.xml yarn.resourcemanager.amliveliness-monitor.interval-ms1000yarn-default.xml yarn.scheduler.minimum-allocation-mb1024yarn-default.xml yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs86400yarn-default.xml dfs.datanode.hdfs-blocks-metadata.enabledfalsehdfs-default.xml hbase.master.infoserver.redirecttruehbase-default.xml hadoop.user.group.static.mapping.overridesdr.who=;core-default.xml hbase.hregion.percolumnfamilyflush.size.lower.bound16777216hbase-default.xml dfs.datanode.directoryscan.interval21600hdfs-default.xml hbase.zookeeper.property.initLimit10hbase-default.xml yarn.resourcemanager.scheduler.monitor.policiesorg.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicyyarn-default.xml ipc.server.listen.queue.size128core-default.xml rpc.metrics.quantile.enablefalsecore-default.xml mapreduce.jobtracker.persist.jobstatus.dir/jobtracker/jobsInfomapred-default.xml yarn.client.nodemanager-client-async.thread-pool-max-size500yarn-default.xml hadoop.security.group.mappingorg.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallbackcore-default.xml dfs.namenode.name.dir/home/maintain/hadoop/data/hdfs-namenodehdfs-site.xml hbase.coprocessor.abortonerrortruehbase-default.xml yarn.am.liveness-monitor.expiry-interval-ms600000yarn-default.xml yarn.nm.liveness-monitor.expiry-interval-ms600000yarn-default.xml hbase.hstore.compaction.kv.max10hbase-default.xml hbase.hregion.preclose.flush.size5242880hbase-default.xml ftp.bytes-per-checksum512core-default.xml dfs.namenode.max.objects0hdfs-default.xml hbase.master.hfilecleaner.pluginsorg.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleanerhbase-default.xml hbase.metrics.showTableNametruehbase-default.xml dfs.namenode.edits.journal-plugin.qjournalorg.apache.hadoop.hdfs.qjournal.client.QuorumJournalManagerhdfs-default.xml dfs.client.failover.proxy.provider.f04org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProviderhdfs-site.xml mapreduce.tasktracker.healthchecker.interval60000mapred-default.xml dfs.ha.fencing.ssh.private-key-files/home/maintain/.ssh/id_dsahdfs-site.xml nfs.wtmax1048576hdfs-default.xml yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size10000yarn-default.xml hbase.lease.recovery.dfs.timeout64000hbase-default.xml yarn.resourcemanager.address${yarn.resourcemanager.hostname}:8032yarn-default.xml dfs.cachereport.intervalMsec10000hdfs-default.xml mapreduce.task.skip.start.attempts2mapred-default.xml yarn.resourcemanager.zk-timeout-ms10000yarn-default.xml dfs.namenode.checkpoint.edits.dir${dfs.namenode.checkpoint.dir}hdfs-default.xml hbase.server.scanner.max.result.size104857600hbase-default.xml hadoop.hdfs.configuration.version1hdfs-default.xml mapreduce.map.skip.maxrecords0mapred-default.xml dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold10737418240hdfs-default.xml nfs.allow.insecure.portstruehdfs-default.xml mapreduce.jobtracker.system.dir${hadoop.tmp.dir}/mapred/systemmapred-default.xml yarn.timeline-service.hostname0.0.0.0yarn-default.xml mapreduce.job.reducer.preempt.delay.sec0mapred-default.xml hbase.zookeeper.dns.nameserverdefaulthbase-default.xml hbase.ipc.server.callqueue.handler.factor0.1hbase-default.xml mapreduce.shuffle.ssl.enabledfalsemapred-default.xml yarn.nodemanager.vmem-pmem-ratio2.1yarn-default.xml yarn.nodemanager.container-manager.thread-count20yarn-default.xml dfs.encrypt.data.transferfalsehdfs-default.xml dfs.block.access.key.update.interval600hdfs-default.xml hbase.bulkload.staging.dir${hbase.fs.tmp.dir}hbase-default.xml hadoop.tmp.dir/tmp/hadoop-${user.name}core-default.xml yarn.timeline-service.generic-application-history.fs-history-store.compression-typenoneyarn-default.xml dfs.namenode.audit.loggersdefaulthdfs-default.xml fs.AbstractFileSystem.har.implorg.apache.hadoop.fs.HarFscore-default.xml yarn.nodemanager.localizer.cache.target-size-mb10240yarn-default.xml yarn.http.policyHTTP_ONLYyarn-default.xml hbase.regionserver.logroll.period3600000hbase-default.xml yarn.timeline-service.webapp.https.address${yarn.timeline-service.hostname}:8190yarn-default.xml dfs.client.short.circuit.replica.stale.threshold.ms1800000hdfs-default.xml mapreduce.jobtracker.persist.jobstatus.hours1mapred-default.xml tfile.fs.output.buffer.size262144core-default.xml hbase.hregion.memstore.block.multiplier4hbase-default.xml dfs.namenode.checkpoint.check.period60hdfs-default.xml dfs.datanode.dns.interfacedefaulthdfs-default.xml fs.ftp.host.port21core-default.xml mapreduce.task.io.sort.mb100mapred-default.xml hadoop.security.group.mapping.ldap.search.attr.group.namecncore-default.xml mapreduce.output.fileoutputformat.compress.typeRECORDmapred-default.xml dfs.namenode.avoid.read.stale.datanodefalsehdfs-default.xml hbase.storescanner.parallel.seek.enablefalsehbase-default.xml hbase.regionserver.storefile.refresh.period0hbase-default.xml mapreduce.reduce.skip.proc.count.autoincrtruemapred-default.xml hbase.dfs.client.read.shortcircuit.buffer.size131072hbase-default.xml file.bytes-per-checksum512core-default.xml mapreduce.job.userlog.retain.hours24mapred-default.xml dfs.datanode.http.address0.0.0.0:50075hdfs-default.xml dfs.image.compressfalsehdfs-default.xml ha.health-monitor.check-interval.ms1000core-default.xml dfs.permissions.enabledtruehdfs-default.xml hbase.thrift.htablepool.size.max1000hbase-default.xml yarn.resourcemanager.resource-tracker.client.thread-count50yarn-default.xml dfs.client.domain.socket.data.trafficfalsehdfs-default.xml dfs.image.compression.codecorg.apache.hadoop.io.compress.DefaultCodechdfs-default.xml dfs.datanode.address0.0.0.0:50010hdfs-default.xml dfs.block.access.token.enablefalsehdfs-default.xml mapreduce.reduce.input.buffer.percent0.0mapred-default.xml hbase.client.scanner.caching2147483647hbase-default.xml mapreduce.tasktracker.local.dir.minspacestart0mapred-default.xml dfs.blockreport.intervalMsec21600000hdfs-default.xml hbase.snapshot.restore.take.failsafe.snapshottruehbase-default.xml ha.health-monitor.rpc-timeout.ms45000core-default.xml dfs.client.failover.connection.retries0hdfs-default.xml dfs.namenode.kerberos.internal.spnego.principal${dfs.web.authentication.kerberos.principal}hdfs-default.xml hadoop.policy.filehbase-policy.xmlhbase-default.xml hbase.fs.tmp.dir/user/${user.name}/hbase-staginghbase-default.xml yarn.scheduler.maximum-allocation-mb8192yarn-default.xml mapreduce.task.files.preserve.failedtasksfalsemapred-default.xml hbase.status.publishedfalsehbase-default.xml yarn.nodemanager.delete.thread-count4yarn-default.xml dfs.https.enablefalsehdfs-default.xml mapreduce.output.fileoutputformat.compress.codecorg.apache.hadoop.io.compress.DefaultCodecmapred-default.xml map.sort.classorg.apache.hadoop.util.QuickSortmapred-default.xml mapreduce.job.classloader.system.classesjava.,javax.,org.apache.commons.logging.,org.apache.log4j., org.apache.hadoop.,core-default.xml,hdfs-default.xml, mapred-default.xml,yarn-default.xmlmapred-default.xml mapreduce.job.classloaderfalsemapred-default.xml mapreduce.jobtracker.tasktracker.maxblacklists4mapred-default.xml io.seqfile.compress.blocksize1000000core-default.xml dfs.blocksize134217728hdfs-default.xml hbase.client.scanner.max.result.size2097152hbase-default.xml mapreduce.task.profile.maps0-2mapred-default.xml mapreduce.jobtracker.staging.root.dir${hadoop.tmp.dir}/mapred/stagingmapred-default.xml yarn.nodemanager.localizer.cache.cleanup.interval-ms600000yarn-default.xml mapreduce.jobtracker.http.address0.0.0.0:50030mapred-default.xml hbase.regionserver.info.bindAddress0.0.0.0hbase-default.xml dfs.client.mmap.cache.timeout.ms3600000hdfs-default.xml yarn.timeline-service.generic-application-history.fs-history-store.uri${hadoop.tmp.dir}/yarn/timeline/generic-historyyarn-default.xml fs.client.resolve.remote.symlinkstruecore-default.xml hbase.master.logcleaner.pluginsorg.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleanerhbase-default.xml hbase.master.info.port.orig60010programatically hbase.data.umask.enablefalsehbase-default.xml hbase.coprocessor.user.enabledtruehbase-default.xml mapreduce.tasktracker.local.dir.minspacekill0mapred-default.xml nfs.mountd.port4242hdfs-default.xml yarn.nodemanager.disk-health-checker.min-healthy-disks0.25yarn-default.xml mapreduce.tasktracker.taskmemorymanager.monitoringinterval5000mapred-default.xml hbase.local.dir${hbase.tmp.dir}/local/hbase-default.xml mapreduce.job.end-notification.retry.interval1000mapred-default.xml mapreduce.jobhistory.loadedjobs.cache.size5mapred-default.xml dfs.client.datanode-restart.timeout30hdfs-default.xml yarn.nodemanager.local-dirs${hadoop.tmp.dir}/nm-local-diryarn-default.xml hbase.table.lock.enabletruehbase-default.xml hbase.storescanner.parallel.seek.threads10hbase-default.xml yarn.timeline-service.webapp.address${yarn.timeline-service.hostname}:8188yarn-default.xml hbase.online.schema.update.enabletruehbase-default.xml mapreduce.jobhistory.address0.0.0.0:10020mapred-default.xml mapreduce.jobtracker.persist.jobstatus.activetruemapred-default.xml file.blocksize67108864core-default.xml dfs.datanode.readahead.bytes4193404hdfs-default.xml hbase.zookeeper.property.dataDir${hbase.tmp.dir}/zookeeperhbase-default.xml dfs.namenode.http-address0.0.0.0:50070hdfs-default.xml hadoop.work.around.non.threadsafe.getpwuidfalsecore-default.xml yarn.resourcemanager.configuration.provider-classorg.apache.hadoop.yarn.LocalConfigurationProvideryarn-default.xml yarn.nodemanager.recovery.enabledfalseyarn-default.xml yarn.resourcemanager.hostname0.0.0.0yarn-default.xml hbase.regionserver.handler.abort.on.error.percent0.5hbase-default.xml fs.s3n.multipart.uploads.enabledfalsecore-default.xml hbase.security.exec.permission.checksfalsehbase-default.xml dfs.namenode.fs-limits.max-component-length255hdfs-default.xml hbase.regionserver.info.port.autofalsehbase-default.xml ha.failover-controller.cli-check.rpc-timeout.ms20000core-default.xml hbase.auth.key.update.interval86400000hbase-default.xml ftp.client-write-packet-size65536core-default.xml mapreduce.reduce.shuffle.parallelcopies5mapred-default.xml mapreduce.jobhistory.principaljhs/_HOST@REALM.TLDmapred-default.xml hadoop.http.authentication.simple.anonymous.allowedtruecore-default.xml yarn.log-aggregation.retain-seconds-1yarn-default.xml hbase.regionserver.thrift.framedfalsehbase-default.xml hbase.zookeeper.property.maxClientCnxns300hbase-default.xml mapreduce.client.genericoptionsparser.usedtrueprogramatically dfs.namenode.secondary.https-address0.0.0.0:50091hdfs-default.xml mapreduce.job.ubertask.maxreduces1mapred-default.xml yarn.nodemanager.health-checker.interval-ms600000yarn-default.xml dfs.namenode.fs-limits.max-xattr-size16384hdfs-default.xml hbase.server.compactchecker.interval.multiplier1000hbase-default.xml yarn.timeline-service.store-classorg.apache.hadoop.yarn.server.timeline.LeveldbTimelineStoreyarn-default.xml mapreduce.shuffle.transfer.buffer.size131072mapred-default.xml hbase.regionserver.wal.codecorg.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodechbase-site.xml yarn.resourcemanager.zk-num-retries1000yarn-default.xml mapreduce.jobtracker.jobhistory.task.numberprogresssplits12mapred-default.xml yarn.client.max-nodemanagers-proxies500yarn-default.xml yarn.nodemanager.webapp.address${yarn.nodemanager.hostname}:8042yarn-default.xml yarn.app.mapreduce.client-am.ipc.max-retries3mapred-default.xml ha.failover-controller.new-active.rpc-timeout.ms60000core-default.xml mapreduce.jobhistory.client.thread-count10mapred-default.xml fs.trash.interval0core-default.xml hbase.client.max.perregion.tasks1hbase-default.xml mapreduce.reduce.skip.maxgroups0mapred-default.xml yarn.nodemanager.health-checker.script.timeout-ms1200000yarn-default.xml dfs.datanode.du.reserved0hdfs-default.xml mapreduce.client.progressmonitor.pollinterval1000mapred-default.xml yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs86400yarn-default.xml yarn.nodemanager.hostname0.0.0.0yarn-default.xml yarn.resourcemanager.ha.enabledfalseyarn-default.xml yarn.scheduler.minimum-allocation-vcores1yarn-default.xml dfs.ha.log-roll.period120hdfs-default.xml yarn.app.mapreduce.am.container.log.limit.kb0mapred-default.xml hadoop.http.authentication.signature.secret.file${user.home}/hadoop-http-auth-signature-secretcore-default.xml mapreduce.jobhistory.move.interval-ms180000mapred-default.xml yarn.nodemanager.container-executor.classorg.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutoryarn-default.xml hadoop.security.authorizationfalsecore-default.xml dfs.datanode.https.address0.0.0.0:50475hdfs-default.xml yarn.nodemanager.localizer.address${yarn.nodemanager.hostname}:8040yarn-default.xml mapreduce.jobhistory.recovery.store.fs.uri${hadoop.tmp.dir}/mapred/history/recoverystoremapred-default.xml dfs.namenode.replication.min1hdfs-default.xml mapreduce.shuffle.connection-keep-alive.enablefalsemapred-default.xml hadoop.common.configuration.version0.23.0core-default.xml yarn.app.mapreduce.task.container.log.backups0mapred-default.xml hbase.coprocessor.master.classesorg.apache.phoenix.hbase.index.master.IndexMasterObserverhbase-site.xml mapreduce.ifile.readaheadtruemapred-default.xml mapreduce.job.max.split.locations10mapred-default.xml dfs.datanode.max.locked.memory0hdfs-default.xml mapreduce.jobhistory.joblist.cache.size20000mapred-default.xml mapreduce.job.end-notification.max.attempts5mapred-default.xml dfs.image.transfer.timeout60000hdfs-default.xml dfs.client.read.shortcircuit.skip.checksumfalsehdfs-default.xml nfs.rtmax1048576hdfs-default.xml dfs.namenode.edit.log.autoroll.check.interval.ms300000hdfs-default.xml mapreduce.reduce.shuffle.connect.timeout180000mapred-default.xml mapreduce.jobhistory.webapp.address0.0.0.0:19888mapred-default.xml dfs.datanode.failed.volumes.tolerated0hdfs-default.xml dfs.client.mmap.retry.timeout.ms300000hdfs-default.xml dfs.datanode.data.dir.perm700hdfs-default.xml hadoop.http.authentication.token.validity36000core-default.xml ipc.client.connect.max.retries.on.timeouts45core-default.xml yarn.app.mapreduce.am.job.committer.cancel-timeout60000mapred-default.xml dfs.ha.fencing.ssh.connect-timeout30000core-default.xml hbase.data.umask000hbase-default.xml mapreduce.reduce.log.levelINFOmapred-default.xml mapreduce.reduce.shuffle.merge.percent0.66mapred-default.xml ipc.client.fallback-to-simple-auth-allowedfalsecore-default.xml io.serializationsorg.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerializationcore-default.xml hbase.regionserver.hlog.writer.implorg.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriterhbase-default.xml fs.s3.block.size67108864core-default.xml yarn.nodemanager.linux-container-executor.nonsecure-mode.local-usernobodyyarn-default.xml hadoop.kerberos.kinit.commandkinitcore-default.xml yarn.resourcemanager.fs.state-store.uri${hadoop.tmp.dir}/yarn/system/rmstoreyarn-default.xml hbase.regionserver.region.split.policyorg.apache.hadoop.hbase.regionserver.IncreasingToUpperBoundRegionSplitPolicyhbase-default.xml hbase.cells.scanned.per.heartbeat.check10000hbase-default.xml yarn.admin.acl*yarn-default.xml dfs.namenode.delegation.token.max-lifetime604800000hdfs-default.xml mapreduce.reduce.merge.inmem.threshold1000mapred-default.xml net.topology.implorg.apache.hadoop.net.NetworkTopologycore-default.xml yarn.resourcemanager.ha.automatic-failover.enabledtrueyarn-default.xml dfs.datanode.use.datanode.hostnamefalsehdfs-default.xml dfs.heartbeat.interval3hdfs-default.xml yarn.resourcemanager.scheduler.classorg.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduleryarn-default.xml io.map.index.skip0core-default.xml yarn.resourcemanager.webapp.https.address${yarn.resourcemanager.hostname}:8090yarn-default.xml dfs.namenode.handler.count10hdfs-default.xml yarn.nodemanager.admin-envMALLOC_ARENA_MAX=$MALLOC_ARENA_MAXyarn-default.xml hbase.client.max.total.tasks100hbase-default.xml mapreduce.task.profile.map.params${mapreduce.task.profile.params}mapred-default.xml mapreduce.jobtracker.jobhistory.block.size3145728mapred-default.xml hbase.zookeeper.peerport2888hbase-default.xml hbase.table.max.rowsize1073741824hbase-default.xml yarn.nodemanager.aux-services.mapreduce_shuffle.classorg.apache.hadoop.mapred.ShuffleHandleryarn-default.xml mapreduce.cluster.acls.enabledfalsemapred-default.xml hbase.regionserver.info.port16030programatically hbase.coprocessor.enabledtruehbase-default.xml hbase.hregion.majorcompaction.jitter0.50hbase-default.xml fs.har.impl.disable.cachetruecore-default.xml mapreduce.tasktracker.map.tasks.maximum2mapred-default.xml ipc.client.connect.timeout20000core-default.xml yarn.timeline-service.generic-application-history.enabledfalseyarn-default.xml yarn.nodemanager.remote-app-log-dir-suffixlogsyarn-default.xml fs.df.interval60000core-default.xml hbase.regionserver.thrift.framed.max_frame_size_in_mb2hbase-default.xml hbase.http.filter.initializersorg.apache.hadoop.hbase.http.lib.StaticUserWebFilterhbase-default.xml hadoop.util.hash.typemurmurcore-default.xml mapreduce.jobhistory.minicluster.fixed.portsfalsemapred-default.xml mapreduce.jobtracker.jobhistory.lru.cache.size5mapred-default.xml dfs.client.failover.max.attempts15hdfs-default.xml dfs.client.use.datanode.hostnamefalsehdfs-default.xml ha.zookeeper.aclworld:anyone:rwcdacore-default.xml hbase.replication.rpc.codecorg.apache.hadoop.hbase.codec.KeyValueCodecWithTagshbase-default.xml mapreduce.jobtracker.maxtasks.perjob-1mapred-default.xml mapreduce.map.sort.spill.percent0.80mapred-default.xml file.stream-buffer-size4096core-default.xml hbase.meta.replicas.usefalseprogramatically yarn.resourcemanager.ha.automatic-failover.embeddedtrueyarn-default.xml hbase.regionserver.catalog.timeout600000hbase-default.xml hbase.security.authenticationsimplehbase-default.xml yarn.resourcemanager.nodemanager.minimum.versionNONEyarn-default.xml hadoop.fuse.connection.timeout300hdfs-default.xml hbase.client.keyvalue.maxsize10485760hbase-default.xml yarn.resourcemanager.history-writer.multi-threaded-dispatcher.pool-size10yarn-default.xml hbase.regionserver.thrift.compactfalsehbase-default.xml mapreduce.tasktracker.instrumentationorg.apache.hadoop.mapred.TaskTrackerMetricsInstmapred-default.xml io.seqfile.sorter.recordlimit1000000core-default.xml yarn.app.mapreduce.am.resource.mb1536mapred-default.xml mapreduce.framework.namelocalmapred-default.xml mapreduce.job.reduce.slowstart.completedmaps0.05mapred-default.xml yarn.resourcemanager.client.thread-count50yarn-default.xml mapreduce.cluster.temp.dir${hadoop.tmp.dir}/mapred/tempmapred-default.xml dfs.client.mmap.enabledtruehdfs-default.xml mapreduce.jobhistory.intermediate-done-dir${yarn.app.mapreduce.am.staging-dir}/history/done_intermediatemapred-default.xml hbase.defaults.for.version.skipfalsehbase-default.xml hbase.rest.support.proxyuserfalsehbase-default.xml Logs =========================================================== +++++++++++++++++++++++++++++++ /home/shared/logs/hbase-maintain-regionserver-dx-pipe-regionserver14-online.log +++++++++++++++++++++++++++++++ at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:33,532 WARN [B.defaultRpcServer.handler=45,queue=5,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3~\xA3\x01\x00\x00\x00520160526\x00\x0B]- java.io.IOException: Timed out waiting for lock for row: \xB3~\xA3\x01\x00\x00\x00520160526\x00\x0B]- at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:33,671 WARN [B.defaultRpcServer.handler=10,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 java.io.IOException: Timed out waiting for lock for row: \xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:33,874 WARN [B.defaultRpcServer.handler=67,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xA9\xEB\x00\x00\x00\x00H20160526\x00\x0B\x91g java.io.IOException: Timed out waiting for lock for row: \xB3\xA9\xEB\x00\x00\x00\x00H20160526\x00\x0B\x91g at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,141 WARN [B.defaultRpcServer.handler=69,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,141 WARN [B.defaultRpcServer.handler=2,queue=2,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,141 WARN [B.defaultRpcServer.handler=20,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,286 DEBUG [RpcServer.reader=8,bindAddress=dx-pipe-regionserver14-online,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 10.11.22.91:17255 because read count=-1. Number of active connections: 1 2016-05-27 14:42:34,335 WARN [B.defaultRpcServer.handler=78,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,647 WARN [B.defaultRpcServer.handler=81,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,663 WARN [B.defaultRpcServer.handler=91,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:34,995 WARN [B.defaultRpcServer.handler=61,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:35,616 WARN [B.defaultRpcServer.handler=50,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:42:40,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,Sz\xB7\x01\x00\x00\x00J20160429\x00\x0B\xBC\xB7,1462994414228.06f17e0fe577e3cca272af449c3dc455. after a delay of 22286 2016-05-27 14:42:40,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86. after a delay of 22938 2016-05-27 14:42:40,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841. after a delay of 18436 2016-05-27 14:42:40,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3. after a delay of 13680 2016-05-27 14:42:40,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130. after a delay of 18571 2016-05-27 14:42:49,330 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 10.11.22.91:17802; # active connections: 1 2016-05-27 14:42:50,257 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=63.54 MB, freeSize=3.00 GB, max=3.07 GB, blockCount=528, accesses=5216111, hits=5216111, hitRatio=100.00%, , cachingAccesses=5215848, cachingHits=5215848, cachingHitsRatio=100.00%, evictions=16529, evicted=391, evictedPerRun=0.023655394092202187 2016-05-27 14:42:50,287 INFO [BucketCacheStatsExecutor] bucket.BucketCache: failedBlockAdditions=69340, totalSize=30.00 GB, freeSize=21.41 GB, usedSize=8.59 GB, cacheSize=8.09 GB, accesses=4886962, hits=1264455, IOhitsPerSecond=0, IOTimePerHit=NaN, hitRatio=25.87%, cachingAccesses=1510568, cachingHits=1259395, cachingHitsRatio=83.37%, evictions=0, evicted=41195, evictedPerRun=Infinity 2016-05-27 14:42:50,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,Sz\xB7\x01\x00\x00\x00J20160429\x00\x0B\xBC\xB7,1462994414228.06f17e0fe577e3cca272af449c3dc455. after a delay of 12463 2016-05-27 14:42:50,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86. after a delay of 21163 2016-05-27 14:42:50,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841. after a delay of 8555 2016-05-27 14:42:50,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3. after a delay of 17784 2016-05-27 14:42:50,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130. after a delay of 11366 2016-05-27 14:42:50,846 INFO [dx-pipe-regionserver14-online:16020Replication Statistics #0] regionserver.Replication: Normal source for cluster 1: Total replicated edits: 0, currently replicating from: hdfs://f04/hbase/WALs/dx-pipe-regionserver14-online,16020,1464166068185/dx-pipe-regionserver14-online%2C16020%2C1464166068185.default.1464329181530 at position: 90 2016-05-27 14:42:59,331 DEBUG [RpcServer.reader=9,bindAddress=dx-pipe-regionserver14-online,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 10.11.22.91:17802 because read count=-1. Number of active connections: 1 2016-05-27 14:43:00,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,Sz\xB7\x01\x00\x00\x00J20160429\x00\x0B\xBC\xB7,1462994414228.06f17e0fe577e3cca272af449c3dc455. after a delay of 14888 2016-05-27 14:43:00,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86. after a delay of 22603 2016-05-27 14:43:00,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841. after a delay of 12412 2016-05-27 14:43:00,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3. after a delay of 20512 2016-05-27 14:43:00,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130. after a delay of 6919 2016-05-27 14:43:01,651 WARN [B.defaultRpcServer.handler=77,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:01,850 WARN [B.defaultRpcServer.handler=39,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2;\xBA\x03\x00\x00\x00720160526\x00\x0BSI java.io.IOException: Timed out waiting for lock for row: \xB2;\xBA\x03\x00\x00\x00720160526\x00\x0BSI at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,064 WARN [B.defaultRpcServer.handler=56,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3W\x8F\x02\x00\x00\x00720160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB3W\x8F\x02\x00\x00\x00720160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,064 WARN [B.defaultRpcServer.handler=5,queue=5,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2r\x86\x03\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB2r\x86\x03\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,089 WARN [B.defaultRpcServer.handler=0,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,090 WARN [B.defaultRpcServer.handler=8,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB40\xBC\x03\x00\x00\x00@20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB40\xBC\x03\x00\x00\x00@20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,091 WARN [B.defaultRpcServer.handler=17,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,102 WARN [B.defaultRpcServer.handler=6,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xCC\xAC\x03\x00\x00\x00720160526\x00\x0BSG java.io.IOException: Timed out waiting for lock for row: \xB2\xCC\xAC\x03\x00\x00\x00720160526\x00\x0BSG at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,102 WARN [B.defaultRpcServer.handler=47,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\x82]\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A java.io.IOException: Timed out waiting for lock for row: \xB3\x82]\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,102 WARN [B.defaultRpcServer.handler=19,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,102 WARN [B.defaultRpcServer.handler=84,queue=4,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4z;\x03\x00\x00\x00J20160526\x00\x0B\x99\x9B java.io.IOException: Timed out waiting for lock for row: \xB4z;\x03\x00\x00\x00J20160526\x00\x0B\x99\x9B at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,103 WARN [B.defaultRpcServer.handler=85,queue=5,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB2\xD8\xB1\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,198 WARN [B.defaultRpcServer.handler=43,queue=3,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3W\x8F\x02\x00\x00\x00720160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB3W\x8F\x02\x00\x00\x00720160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,198 WARN [B.defaultRpcServer.handler=12,queue=2,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xAE\xA6\x03\x00\x00\x00G20160526\x00\x0B\x91! java.io.IOException: Timed out waiting for lock for row: \xB2\xAE\xA6\x03\x00\x00\x00G20160526\x00\x0B\x91! at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,208 WARN [B.defaultRpcServer.handler=72,queue=2,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xCC\xAC\x03\x00\x00\x00720160526\x00\x0BSG java.io.IOException: Timed out waiting for lock for row: \xB2\xCC\xAC\x03\x00\x00\x00720160526\x00\x0BSG at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,212 WARN [B.defaultRpcServer.handler=89,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 java.io.IOException: Timed out waiting for lock for row: \xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,223 WARN [B.defaultRpcServer.handler=18,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xEE\x13\x02\x00\x00\x00\x1420160526\x00\x0BH\x05 java.io.IOException: Timed out waiting for lock for row: \xB3\xEE\x13\x02\x00\x00\x00\x1420160526\x00\x0BH\x05 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,232 WARN [B.defaultRpcServer.handler=32,queue=2,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2r\x86\x03\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB2r\x86\x03\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,236 WARN [B.defaultRpcServer.handler=38,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2D\x92\x03\x00\x00\x00220160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB2D\x92\x03\x00\x00\x00220160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,244 WARN [B.defaultRpcServer.handler=58,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,245 WARN [B.defaultRpcServer.handler=33,queue=3,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x19\xB4\x03\x00\x00\x00\x0D20160526\x00\x0B\xC31 java.io.IOException: Timed out waiting for lock for row: \xB4\x19\xB4\x03\x00\x00\x00\x0D20160526\x00\x0B\xC31 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,246 WARN [B.defaultRpcServer.handler=99,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xEE\x13\x02\x00\x00\x00\x1420160526\x00\x0BH\x05 java.io.IOException: Timed out waiting for lock for row: \xB3\xEE\x13\x02\x00\x00\x00\x1420160526\x00\x0BH\x05 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,261 WARN [B.defaultRpcServer.handler=79,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,275 WARN [B.defaultRpcServer.handler=66,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xAA\x9C\x00\x00\x00\x00-20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB3\xAA\x9C\x00\x00\x00\x00-20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,275 WARN [B.defaultRpcServer.handler=70,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xAA\x9C\x00\x00\x00\x00-20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB3\xAA\x9C\x00\x00\x00\x00-20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,427 WARN [B.defaultRpcServer.handler=80,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 java.io.IOException: Timed out waiting for lock for row: \xB4J\xB6\x03\x00\x00\x00620160526\x00\x0BN9 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,484 WARN [B.defaultRpcServer.handler=40,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x19\xB4\x03\x00\x00\x00\x0D20160526\x00\x0B\xC31 java.io.IOException: Timed out waiting for lock for row: \xB4\x19\xB4\x03\x00\x00\x00\x0D20160526\x00\x0B\xC31 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=57,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\x84>\x02\x00\x00\x00K20160526\x00\x0B\x96m java.io.IOException: Timed out waiting for lock for row: \xB3\x84>\x02\x00\x00\x00K20160526\x00\x0B\x96m at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=74,queue=4,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\x17-\x01\x00\x00\x00:20160526\x00\x0BY\xB5 java.io.IOException: Timed out waiting for lock for row: \xB3\x17-\x01\x00\x00\x00:20160526\x00\x0BY\xB5 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=41,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB35\xD3\x02\x00\x00\x00H20160526\x00\x0B\x91\xA3 java.io.IOException: Timed out waiting for lock for row: \xB35\xD3\x02\x00\x00\x00H20160526\x00\x0B\x91\xA3 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=51,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\x90U\x03\x00\x00\x00=20160526\x00\x0BZ\xC1 java.io.IOException: Timed out waiting for lock for row: \xB2\x90U\x03\x00\x00\x00=20160526\x00\x0BZ\xC1 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=24,queue=4,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xD2\x1F\x03\x00\x00\x00920160526\x00\x0BQ\x97 java.io.IOException: Timed out waiting for lock for row: \xB2\xD2\x1F\x03\x00\x00\x00920160526\x00\x0BQ\x97 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,835 WARN [B.defaultRpcServer.handler=71,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB40\xBC\x03\x00\x00\x00@20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB40\xBC\x03\x00\x00\x00@20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,836 WARN [B.defaultRpcServer.handler=31,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 java.io.IOException: Timed out waiting for lock for row: \xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,836 WARN [B.defaultRpcServer.handler=7,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\x90U\x03\x00\x00\x00=20160526\x00\x0BZ\xC1 java.io.IOException: Timed out waiting for lock for row: \xB2\x90U\x03\x00\x00\x00=20160526\x00\x0BZ\xC1 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,934 WARN [B.defaultRpcServer.handler=54,queue=4,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xA2\xCE\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A java.io.IOException: Timed out waiting for lock for row: \xB3\xA2\xCE\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,934 WARN [B.defaultRpcServer.handler=16,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB35\xD3\x02\x00\x00\x00H20160526\x00\x0B\x91\xA3 java.io.IOException: Timed out waiting for lock for row: \xB35\xD3\x02\x00\x00\x00H20160526\x00\x0B\x91\xA3 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:02,963 WARN [B.defaultRpcServer.handler=93,queue=3,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 java.io.IOException: Timed out waiting for lock for row: \xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,150 WARN [B.defaultRpcServer.handler=49,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2V\xB7\x03\x00\x00\x00+20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB2V\xB7\x03\x00\x00\x00+20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,211 WARN [B.defaultRpcServer.handler=30,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2F\x9D\x03\x00\x00\x00020160526\x00\x0B5\x09 java.io.IOException: Timed out waiting for lock for row: \xB2F\x9D\x03\x00\x00\x00020160526\x00\x0B5\x09 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,231 WARN [B.defaultRpcServer.handler=90,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 java.io.IOException: Timed out waiting for lock for row: \xB2\xB0\xB8\x03\x00\x00\x00F20160526\xFF\xFF\xFF\x92 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,452 WARN [B.defaultRpcServer.handler=96,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 java.io.IOException: Timed out waiting for lock for row: \xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,521 WARN [B.defaultRpcServer.handler=9,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xA2\xCE\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A java.io.IOException: Timed out waiting for lock for row: \xB3\xA2\xCE\x01\x00\x00\x00\x0C20160526\x00\x0B\x86A at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,522 WARN [B.defaultRpcServer.handler=46,queue=6,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB2\x9Di\x03\x00\x00\x00\x0C20160526\x00\x0B\x86A java.io.IOException: Timed out waiting for lock for row: \xB2\x9Di\x03\x00\x00\x00\x0C20160526\x00\x0B\x86A at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,522 WARN [B.defaultRpcServer.handler=60,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 java.io.IOException: Timed out waiting for lock for row: \xB3\xBB\xAC\x02\x00\x00\x00520160526\x00\x0B]3 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,523 WARN [B.defaultRpcServer.handler=95,queue=5,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3[\x07\x03\x00\x00\x00+20160526\x00\x0B>+ java.io.IOException: Timed out waiting for lock for row: \xB3[\x07\x03\x00\x00\x00+20160526\x00\x0B>+ at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,532 WARN [B.defaultRpcServer.handler=45,queue=5,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3~\xA3\x01\x00\x00\x00520160526\x00\x0B]- java.io.IOException: Timed out waiting for lock for row: \xB3~\xA3\x01\x00\x00\x00520160526\x00\x0B]- at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,672 WARN [B.defaultRpcServer.handler=10,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 java.io.IOException: Timed out waiting for lock for row: \xB4\x17\xB5\x03\x00\x00\x00H20160526\x00\x0B\x91\x93 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:03,874 WARN [B.defaultRpcServer.handler=67,queue=7,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3\xA9\xEB\x00\x00\x00\x00H20160526\x00\x0B\x91g java.io.IOException: Timed out waiting for lock for row: \xB3\xA9\xEB\x00\x00\x00\x00H20160526\x00\x0B\x91g at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,141 WARN [B.defaultRpcServer.handler=69,queue=9,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,142 WARN [B.defaultRpcServer.handler=20,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,142 WARN [B.defaultRpcServer.handler=2,queue=2,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,335 WARN [B.defaultRpcServer.handler=78,queue=8,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,647 WARN [B.defaultRpcServer.handler=81,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,663 WARN [B.defaultRpcServer.handler=91,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F java.io.IOException: Timed out waiting for lock for row: \xB4(y\x03\x00\x00\x00\x0C20160526\x00\x0B\x86\x8F at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:04,995 WARN [B.defaultRpcServer.handler=61,queue=1,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 java.io.IOException: Timed out waiting for lock for row: \xB3{\xF2\x01\x00\x00\x00\x0F20160526\x00\x00\x04\x19 at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:05,616 WARN [B.defaultRpcServer.handler=50,queue=0,port=16020] regionserver.HRegion: Failed getting lock in batch put, row=\xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED java.io.IOException: Timed out waiting for lock for row: \xB37l\x02\x00\x00\x00\x0F20160526\x00\x0B\xC2\xED at org.apache.hadoop.hbase.regionserver.HRegion.getRowLockInternal(HRegion.java:5007) at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2936) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2793) at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2735) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:692) at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:654) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2029) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32213) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2112) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at java.lang.Thread.run(Thread.java:745) 2016-05-27 14:43:10,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,Sz\xB7\x01\x00\x00\x00J20160429\x00\x0B\xBC\xB7,1462994414228.06f17e0fe577e3cca272af449c3dc455. after a delay of 17128 2016-05-27 14:43:10,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86. after a delay of 20134 2016-05-27 14:43:10,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841. after a delay of 17359 2016-05-27 14:43:10,734 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3. after a delay of 14825 2016-05-27 14:43:10,735 INFO [dx-pipe-regionserver14-online,16020,1464166068185_ChoreService_1] regionserver.HRegionServer: dx-pipe-regionserver14-online,16020,1464166068185-MemstoreFlusherChore requesting flush for region ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130. after a delay of 9243 2016-05-27 14:43:14,435 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 10.11.22.91:18333; # active connections: 1 RS Queue: =========================================================== Compaction/Split Queue summary: compaction_queue=(2730:102), split_queue=0, merge_queue=0 Compaction/Split Queue dump: LargeCompation Queue: Store = 0, pri = -154 Store = info, pri = -75 Store = 0, pri = -154 Store = info, pri = -71 Store = info, pri = -75 Store = info, pri = -46 Store = info, pri = -42 Store = info, pri = -69 Store = info, pri = -70 Store = info, pri = -74 Store = info, pri = -44 Store = info, pri = -46 Store = info, pri = -40 Store = info, pri = -36 Store = info, pri = -41 Store = url, pri = -46 Store = info, pri = -69 Store = url, pri = -52 Store = info, pri = -69 Store = info, pri = -73 Store = info, pri = -41 Store = info, pri = -43 Store = info, pri = -42 Store = info, pri = -40 Store = info, pri = -45 Store = info, pri = -36 Store = info, pri = -38 Store = info, pri = -31 Store = info, pri = -13 Store = info, pri = -37 Store = info, pri = -39 Store = info, pri = -43 Store = url, pri = -46 Store = url, pri = -46 Store = info, pri = -69 Store = url, pri = -51 Store = url, pri = -52 Store = info, pri = -69 Store = info, pri = -69 Store = info, pri = -47 Store = info, pri = -72 Store = info, pri = -39 Store = info, pri = -41 Store = info, pri = -26 Store = info, pri = -42 Store = info, pri = -41 Store = info, pri = -38 Store = info, pri = -31 Store = info, pri = -35 Store = info, pri = -41 Store = info, pri = -45 Store = info, pri = -9 Store = info, pri = -17 Store = info, pri = -28 Store = info, pri = -38 Store = info, pri = -28 Store = info, pri = -20 Store = info, pri = -13 Store = info, pri = -4 Request = regionName=frog_stastic,l`~\x04_211_1451724069182,1463359765117.44e76e76b95923d326ed5a1234d2423d., storeName=info, fileCount=8, fileSize=5.4 G, priority=1, time=25985352147192397 Store = info, pri = -36 Store = info, pri = -25 Store = info, pri = -39 Store = info, pri = -27 Store = info, pri = -41 Store = info, pri = -44 Store = info, pri = -45 Store = info, pri = -40 Store = url, pri = -46 Store = url, pri = -46 Store = info, pri = -69 Store = info, pri = -41 Store = url, pri = -50 Store = url, pri = -51 Store = cf, pri = -48 Store = cf, pri = -48 Store = url, pri = -52 Store = info, pri = -46 Store = info, pri = -69 Store = info, pri = -39 Store = info, pri = -44 Store = info, pri = -48 Store = url, pri = -52 Store = info, pri = -13 Store = info, pri = -29 Store = info, pri = -34 Store = info, pri = -4 Store = info, pri = -22 Store = info, pri = -23 Store = info, pri = -2 Store = info, pri = -40 Store = info, pri = -24 Store = info, pri = -38 Store = info, pri = -36 Store = info, pri = -31 Store = info, pri = -24 Store = info, pri = -30 Store = info, pri = -24 Store = info, pri = -5 Store = info, pri = -41 Store = info, pri = -33 Store = info, pri = -43 Store = info, pri = -30 Store = info, pri = -8 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -24 Store = info, pri = -38 Store = info, pri = -24 Store = info, pri = -27 Store = info, pri = -20 Store = info, pri = -19 Store = info, pri = -13 Store = info, pri = -7 Store = info, pri = -3 Store = info, pri = 0 Request = regionName=frog_stastic,o/R\x02_{322}_1460374101531,1463166799335.ac546b5caa353bd2624813ac2945c5ab., storeName=info, fileCount=8, fileSize=5.9 G (5.3 G, 231.2 M, 125.2 M, 94.1 M, 38.7 M, 81.2 M, 23.4 M, 7.1 M), priority=1, time=25985352198860136 Request = regionName=frog_stastic,~\x9CP\x08_{211}_1455902168175,1463570864553.d42432caca83ce6fae3a2dc24c1a00ff., storeName=info, fileCount=8, fileSize=5.1 G (4.6 G, 209.7 M, 98.3 M, 45.5 M, 23.1 M, 39.1 M, 57.7 M, 41.1 M), priority=1, time=25985352444131190 Store = info, pri = -21 Store = info, pri = -27 Request = regionName=frog_stastic,\xB2k\x11\x07_{211}_1454313273791,1463527617353.19a57aaf5f45bb4d74fe83a71cf2966b., storeName=info, fileCount=5, fileSize=5.4 G (4.9 G, 356.6 M, 122.8 M, 51.2 M, 335.6 K), priority=1, time=25985353321823548 Request = regionName=frog_stastic,\xC0K\x04\x08_{211}_1455327960876,1458862320780.b710d6ba7aef8054fe90dae5be8382f8., storeName=info, fileCount=9, fileSize=11.0 G (9.4 G, 682.9 M, 224.1 M, 730.1 M, 9.2 M, 8.9 M, 8.2 M, 8.2 M, 3.3 M), priority=1, time=25985353561024471 Store = info, pri = -10 Store = info, pri = -21 Store = info, pri = -27 Store = info, pri = -20 Store = info, pri = -36 Store = cf, pri = -38 Store = info, pri = -44 Store = info, pri = -36 Store = info, pri = -20 Store = info, pri = -30 Store = cf, pri = -38 Store = info, pri = -30 Store = info, pri = -44 Store = cf, pri = -38 Store = info, pri = -20 Store = info, pri = -44 Store = info, pri = -30 Store = url, pri = -46 Store = info, pri = -3 Store = info, pri = -41 Store = url, pri = -50 Store = cf, pri = -47 Store = info, pri = -38 Store = cf, pri = -47 Store = info, pri = -38 Store = info, pri = -38 Store = info, pri = -44 Store = info, pri = -26 Store = info, pri = -28 Store = info, pri = -45 Store = info, pri = -19 Store = info, pri = -36 Store = info, pri = -38 Store = info, pri = -47 Store = info, pri = -27 Store = info, pri = -39 Store = info, pri = -41 Store = info, pri = -43 Store = info, pri = -40 Store = info, pri = -35 Store = info, pri = -49 Store = cf, pri = -48 Store = info, pri = -11 Store = info, pri = -13 Store = info, pri = -23 Store = info, pri = -29 Store = info, pri = -7 Store = info, pri = -30 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -9 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = -23 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = -40 Store = info, pri = 2 Store = info, pri = -23 Store = info, pri = -27 Store = info, pri = -32 Store = info, pri = -36 Store = info, pri = -31 Store = info, pri = -26 Store = info, pri = -30 Store = info, pri = -13 Store = info, pri = -17 Store = info, pri = -9 Store = info, pri = -24 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -29 Store = info, pri = -8 Store = info, pri = -12 Store = info, pri = -43 Store = info, pri = -43 Store = info, pri = -29 Store = info, pri = -21 Store = info, pri = -8 Store = info, pri = -4 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -27 Store = info, pri = -38 Store = info, pri = -9 Store = info, pri = -20 Store = info, pri = -27 Store = info, pri = -26 Store = info, pri = -20 Store = info, pri = -20 Store = info, pri = -17 Store = info, pri = -17 Store = info, pri = -5 Store = info, pri = -9 Store = info, pri = -7 Store = info, pri = -5 Store = info, pri = -3 Store = info, pri = -1 Store = info, pri = 0 Request = regionName=frog_stastic,e\xA2\x03\x00_211_1451911796668,1462058118326.ce13b2ae7e6aa0ce80f21ed15705449b., storeName=info, fileCount=9, fileSize=6.0 G, priority=1, time=25985352034318123 Request = regionName=frog_stastic,p$/\x08_{211}_1455605915609,1462922590523.fe5616bb0a65cb2008d59d4b77b80381., storeName=info, fileCount=4, fileSize=5.6 G (5.0 G, 426.5 M, 121.8 M, 45.3 M), priority=1, time=25985352207855399 Request = regionName=frog_stastic,v\x93\xC5\x09_{211}_1460862611887,1464155385144.72a7a9fff5e361e8065bb0d4c84ec5a9., storeName=info, fileCount=14, fileSize=10.2 G (9.2 G, 831.8 M, 102.6 M, 58.6 M, 723.7 K, 9.9 M, 71.9 K, 1.4 M, 8.3 M, 9.1 M, 8.1 M, 17.5 M, 16.2 M, 1.7 M), priority=1, time=25985352314970998 Request = regionName=frog_stastic,\x7FfS\x02_{111}_1454932486362,1462835988132.79b30ac2b17f30dd7f9a0973ec85434f., storeName=info, fileCount=8, fileSize=6.1 G (5.7 G, 216.4 M, 29.1 M, 65.7 M, 55.6 M, 56.8 M, 11.5 M, 4.3 M), priority=1, time=25985352463120035 Request = regionName=frog_stastic,\x86\xB4U\x03_{111}_1457844100133,1464147934990.baf23bb52a30a17feb7e4ea763b28edd., storeName=info, fileCount=22, fileSize=10.7 G (9.6 G, 432.9 M, 96.3 M, 45.0 M, 98.8 M, 82.3 M, 252.4 M, 21.6 M, 7.0 M, 42.6 K, 6.1 M, 10.0 M, 11.6 M, 10.4 M, 9.9 M, 14.0 M, 360.1 K, 14.1 M, 17.0 M, 17.6 M, 16.2 M, 1.0 M), priority=1, time=25985352596515215 Request = regionName=frog_stastic,\x92A\xE9\x08_{211}_1460987290764,1463649568688.1c9d79c0a647c130b73b3253ce7b49ae., storeName=info, fileCount=9, fileSize=5.1 G, priority=1, time=25985352784758344 Store = info, pri = -4 Store = info, pri = -8 Store = info, pri = -1 Request = regionName=frog_stastic,\xB4(]\x05_{211}_1458969678196,1463441912399.d0630a913f14a77a0e090efb6b4cafe2., storeName=info, fileCount=9, fileSize=5.9 G, priority=1, time=25985353346697523 Request = regionName=frog_stastic,\xBA\xD5\xCB\x05_{211}_146268429,1464045996531.47aa0fe9d6635a1c233e039c892189d3., storeName=info, fileCount=4, fileSize=5.6 G, priority=1, time=25985353471101177 Request = regionName=frog_stastic,\xC0\xBE5\x08_{211}_1455681204525,1462499337552.cc15d8400867e59ec27c953a3e5d0ab7., storeName=info, fileCount=4, fileSize=5.5 G (5.1 G, 384.0 M, 78.2 M, 3.8 M), priority=1, time=25985353572592166 Request = regionName=frog_stastic,\xC8\xA5y\x04_{211}_1456058023326,1462924797079.6a87454932f4bd81a5d649432d1a48a6., storeName=info, fileCount=3, fileSize=5.4 G (4.8 G, 450.5 M, 127.2 M), priority=1, time=25985353795742523 Request = regionName=frog_stastic,\xCF\xD5V\x04_{201}_1457276184,1462409532674.3e7a2f066642a31bde9ae0b86c7c6d31., storeName=info, fileCount=8, fileSize=6.1 G (5.4 G, 404.4 M, 59.3 M, 11.3 M, 26.6 M, 57.5 M, 71.3 M, 42.8 M), priority=1, time=25985353906237844 Store = info, pri = -9 Request = regionName=frog_stastic,\xE0\xBA\xFD\x09_{211}_1461765279461,1462761001445.38497c82015f83a0cfa091e7b86e825e., storeName=info, fileCount=9, fileSize=5.6 G, priority=1, time=25985354196603400 Store = info, pri = -18 Request = regionName=frog_stastic,\xF0\x1D\xC1\x08_{211}_1457166258292,1463362980050.1eb647fbd39f829276c9cffe50b35854., storeName=info, fileCount=5, fileSize=5.4 G (5.0 G, 223.8 M, 112.8 M, 49.8 M, 296.1 K), priority=1, time=25985354442254079 Store = info, pri = -26 Store = info, pri = -13 Store = info, pri = -19 Store = info, pri = -30 Store = info, pri = -32 Store = info, pri = -28 Store = info, pri = -36 Store = info, pri = -6 Store = cf, pri = -38 Store = cf, pri = -26 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = -5 Store = info, pri = -36 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = 2 Store = info, pri = -44 Store = info, pri = -36 Store = info, pri = -4 Store = info, pri = -14 Store = info, pri = -8 Store = info, pri = -6 Store = info, pri = -37 Store = cf, pri = -26 Store = info, pri = -4 Store = info, pri = -44 Store = cf, pri = -26 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -19 Store = info, pri = -40 Store = url, pri = -48 Store = url, pri = -49 Store = cf, pri = -44 Store = cf, pri = -46 Store = info, pri = -30 Store = info, pri = -38 Store = info, pri = -40 Store = info, pri = -44 Store = info, pri = -31 Store = info, pri = -36 Store = info, pri = -36 Store = info, pri = -33 Store = info, pri = -36 Store = info, pri = -42 Store = info, pri = -17 Store = info, pri = -26 Store = info, pri = -9 Store = info, pri = -20 Store = info, pri = -36 Store = info, pri = -37 Store = info, pri = -1 Store = info, pri = -17 Store = info, pri = -26 Store = info, pri = -32 Store = info, pri = -22 Store = info, pri = -27 Store = info, pri = -33 Store = info, pri = -23 Store = info, pri = -7 Store = info, pri = -23 Store = info, pri = -38 Store = info, pri = -20 Store = info, pri = -31 Store = info, pri = -34 Store = info, pri = -30 Store = info, pri = -10 Store = info, pri = -17 Store = info, pri = -35 Store = info, pri = 2 Store = info, pri = -25 Store = info, pri = 2 Store = info, pri = -49 Store = info, pri = -40 Store = info, pri = -7 Request = regionName=frog_stastic,2\xCDU\x06_{211}_1463151121583,1463873244980.41352a4ae915a9b8cff7f7511abdb6e5., storeName=info, fileCount=5, fileSize=5.7 G (5.3 G, 258.1 M, 117.4 M, 35.4 M, 1.4 M), priority=1, time=26069589114310848 Store = info, pri = -9 Request = regionName=frog_stastic,l';\x05_{201}_1461847766405,1463652751758.db36d5ae130225c59cbbd322a68ea04b., storeName=info, fileCount=50, fileSize=10.4 G (9.2 G, 431.1 M, 221.4 M, 11.0 M, 9.9 M, 76.6 K, 3.7 M, 9.7 M, 10.8 M, 11.2 M, 13.2 M, 13.1 M, 153.9 K, 11.5 K, 153.4 K, 15.4 M, 18.6 M, 5.3 M, 15.7 M, 18.6 M, 20.8 M, 17.1 M, 262.4 K, 13.9 M, 14.4 M, 18.2 M, 18.7 M, 19.6 M, 15.5 M, 3.2 M, 14.8 M, 18.7 M, 16.4 M, 7.4 M, 9.4 M, 9.8 M, 11.1 M, 6.0 M, 10.0 M, 6.3 M, 12.8 M, 11.3 M, 11.7 M, 10.9 M, 10.8 M, 774.7 K, 14.3 M, 17.1 M, 13.9 M, 10.9 M), priority=1, time=26069591135813253 Store = info, pri = -4 Request = regionName=frog_stastic,\xCC5\xEF\x07_{211}_1462667535933,1463271626690.85c6abf17dbabbaf0dbe47d44285d8cb., storeName=info, fileCount=9, fileSize=5.6 G (4.9 G, 375.5 M, 199.7 M, 54.7 M, 42.5 M, 25.9 M, 27.6 M, 68.1 M, 4.2 M), priority=1, time=26069594025095446 Store = info, pri = -16 Store = info, pri = -7 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = -8 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -10 Store = info, pri = -22 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -28 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = -7 Store = info, pri = -2 Store = info, pri = -24 Store = info, pri = -17 Store = info, pri = -21 Store = info, pri = 2 Store = info, pri = -36 Store = info, pri = -28 Store = info, pri = -27 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = -21 Store = info, pri = -26 Store = info, pri = -7 Store = info, pri = -13 Store = info, pri = -9 Store = info, pri = -17 Store = info, pri = -5 Store = info, pri = -4 Store = info, pri = -1 Store = info, pri = -11 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -24 Store = info, pri = -25 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = -3 Store = info, pri = -6 Store = info, pri = -14 Store = info, pri = -43 Store = info, pri = -41 Store = info, pri = -33 Store = info, pri = -25 Store = info, pri = -24 Store = info, pri = -18 Store = info, pri = -14 Store = info, pri = -8 Store = info, pri = -6 Store = info, pri = -4 Store = info, pri = -4 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -26 Store = info, pri = 2 Store = info, pri = -31 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -16 Store = info, pri = -20 Request = regionName=frog_stastic,\x00\x13\x0A\x08_{211}_1456837310476,1460413051724.c07aeedc1dd2625e4ef68865b66276bd., storeName=info, fileCount=8, fileSize=9.4 G (7.9 G, 406.0 M, 124.6 M, 88.4 M, 314.3 M, 518.8 M, 25.9 M, 40.6 M), priority=1, time=25985348225642245 Request = regionName=frog_stastic,\x06\x0A\xA3\x06_211_145179573075,1464220259659.aad81ad30b75fd63afe12b428b5ceb85., storeName=info, fileCount=11, fileSize=10.2 G, priority=1, time=25985349999014108 Request = regionName=frog_stastic,\x08\xB5\xCF\x08_{211}_1462159257382,1463095490816.72aafbd0e7648baecb2b8ce865f40fed., storeName=info, fileCount=8, fileSize=5.6 G (4.8 G, 392.4 M, 112.8 M, 66.9 M, 78.8 M, 70.1 M, 118.2 M, 40.2 M), priority=1, time=25985350155305720 Store = info, pri = -26 Request = regionName=frog_stastic,\x13"I\x02_{211}_1455949128160,1462501098079.fa2e319f18cad517d180513849e23e6f., storeName=info, fileCount=9, fileSize=5.7 G (5.2 G, 231.1 M, 24.3 M, 20.3 M, 26.2 M, 49.3 M, 78.5 M, 29.3 M, 6.0 M), priority=1, time=25985350478833709 Request = regionName=frog_stastic,\x14`\x83\x03_{111}_1462201582,1463961324008.9562e8e87cc2faf9e1e2261de484fd88., storeName=info, fileCount=4, fileSize=5.5 G (5.3 G, 162.4 M, 87.9 M, 3.6 M), priority=1, time=25985350513421340 Request = regionName=frog_stastic,\x18\x05\xCE\x07_{211}_1454583648950,1460274532948.22df7488122b38f615adf4f101719188., storeName=info, fileCount=9, fileSize=9.6 G (8.3 G, 770.3 M, 145.3 M, 126.8 M, 65.8 M, 104.3 M, 25.0 M, 8.2 M, 3.4 M), priority=1, time=25985350592433679 Store = info, pri = -20 Request = regionName=frog_stastic, \x8FV\x06_{211}_1453998065210,1463649274440.17ea1212df15181b84cdbed26cee99e1., storeName=info, fileCount=50, fileSize=10.9 G, priority=1, time=25985350819503685 Store = info, pri = -13 Store = info, pri = 0 Store = info, pri = -13 Request = regionName=frog_stastic,.\xCC\xCD\x04_{211}_1456570438890,1464175433969.7c5ce7a4cc253549aec39470dbd46dfd., storeName=info, fileCount=14, fileSize=10.9 G (9.3 G, 529.1 M, 437.0 M, 201.6 M, 94.6 M, 63.7 M, 94.0 M, 102.3 M, 34.6 M, 8.2 M, 9.1 M, 17.4 M, 15.8 M, 10.4 M), priority=1, time=25985351070692425 Request = regionName=frog_stastic,2\x98\xD3\x06_{211}_1460640275025,1463441518620.73969958d969f7594119f7c72d72abe6., storeName=info, fileCount=4, fileSize=5.6 G (5.0 G, 567.5 M, 63.8 M, 6.1 M), priority=1, time=25985351135865475 Request = regionName=frog_stastic,6\xBC\xB7\x08_{211}_1457170417,1463008948910.89679328e247c0156e0eb58cfc57b7cf., storeName=info, fileCount=3, fileSize=5.9 G (5.9 G, 65.3 M, 1.1 M), priority=1, time=25985351205576330 Store = info, pri = -8 Request = regionName=frog_stastic,>\xD9\xB2\x07_{211}_1458458772288,1463095406099.487e66cc09fd443e74e4f9686de2b284., storeName=info, fileCount=7, fileSize=5.2 G, priority=1, time=25985351343585153 Request = regionName=frog_stastic,D/\x5C\x09_{211}_1461658033890,1462458822310.9af75f90971a6cf0bac19584e7777753., storeName=info, fileCount=3, fileSize=5.6 G (5.5 G, 75.7 M, 1008.2 K), priority=1, time=25985351427310097 Request = regionName=frog_stastic,F\x92\xF5\x04_{211}_1455250803760,1463095225581.44d05b6203c20411a4748cf1883ec994., storeName=info, fileCount=8, fileSize=5.4 G, priority=1, time=25985351471095498 Store = info, pri = -4 Request = regionName=frog_stastic,O\x03\x1B\x01_311_1453560740633,1462461211470.d9fbc764142dcd2867f06b88aaf5d061., storeName=info, fileCount=9, fileSize=6.3 G (5.7 G, 163.6 M, 38.9 M, 92.2 M, 70.2 M, 87.3 M, 98.2 M, 78.0 M, 6.2 M), priority=1, time=25985351628348989 Request = regionName=frog_stastic,Rzi\x07_211_145378554,1463613662108.b677ff88ac25fba25f12bbf09f2656df., storeName=info, fileCount=55, fileSize=11.5 G, priority=1, time=25985351689604962 Request = regionName=frog_stastic,W\x09.\x02_{211}_1454043241423,1461805697638.0816e18126c3e6625583c0509af0a513., storeName=info, fileCount=7, fileSize=6.6 G (6.1 G, 412.7 M, 22.2 M, 8.8 M, 11.2 M, 9.1 M, 5.2 M), priority=1, time=25985351771679822 Store = info, pri = -1 Store = info, pri = 0 Store = info, pri = 0 Request = regionName=frog_stastic,fw\x99\x07_{211}_1454216009276,1463445201391.09e9c30b5331711a278eff33f22e6906., storeName=info, fileCount=3, fileSize=5.6 G (5.6 G, 91.0 M, 811.1 K), priority=1, time=25985352046823918 Request = regionName=frog_stastic,hV\x9D\x07_211_1453626694758,1462839478328.c2e32d6585eb7fa47aaf07428939b6c1., storeName=info, fileCount=8, fileSize=5.8 G, priority=1, time=25985352077395694 Request = regionName=frog_stastic,r-\x8F\x06_{211}_1456639445489,1463649465973.62abd822113efa817f24ddfccf136adc., storeName=info, fileCount=3, fileSize=5.2 G (4.8 G, 382.1 M, 51.4 M), priority=1, time=25985352242205758 Request = regionName=frog_stastic,ra\xA1\x06_211_1451626415665,1463360457043.b1aa2f70364b8d983c78613c4d71aa6a., storeName=info, fileCount=5, fileSize=5.6 G, priority=1, time=25985352248118437 Request = regionName=frog_stastic,zQ[\x06_{211}_14538883232,1464218910824.7503b6d7c1324e21bb5c2662c42bfc22., storeName=info, fileCount=14, fileSize=10.8 G (9.2 G, 806.5 M, 218.3 M, 114.5 M, 89.0 M, 255.4 M, 53.8 M, 40.2 M, 9.4 M, 56.3 K, 7.1 M, 17.5 M, 17.8 M, 9.5 M), priority=1, time=25985352375848138 Request = regionName=frog_stastic,z\x97\xDE\x05_{211}_14576973287,1463962276811.31fbf5825c70389920a69d431e1e982d., storeName=info, fileCount=3, fileSize=5.4 G (5.2 G, 112.4 M, 61.0 M), priority=1, time=25985352382567850 Request = regionName=frog_stastic,\x80\xBD\xF8\x06_{211}_1460269029364,1463008947773.277e51b653cb5b2e99db7cee00b0e464., storeName=info, fileCount=5, fileSize=5.5 G (5.0 G, 444.3 M, 103.0 M, 34.1 M, 7.1 M), priority=1, time=25985352488925847 Request = regionName=frog_stastic,\x82\xB1~\x07_{211}_1454213559019,1463357356570.86474137d254549ae5c729a7752681df., storeName=info, fileCount=5, fileSize=5.4 G (5.0 G, 243.9 M, 117.3 M, 8.1 M, 4.3 M), priority=1, time=25985352523590589 Request = regionName=frog_stastic,\x8C~\xE1\x06_201_1451482494379,1462458437322.6bd7bca9ff6a304b89dc8f2092f0b37c., storeName=info, fileCount=8, fileSize=5.9 G (5.1 G, 673.4 M, 69.6 M, 38.1 M, 40.0 M, 24.6 M, 8.3 M, 19.0 M), priority=1, time=25985352692408212 Request = regionName=frog_stastic,\x8D5\x1E\x04_{211}_1460798034179,1461805820753.e86a61871ede4d5d8c3acfc8624c87c6., storeName=info, fileCount=9, fileSize=6.2 G, priority=1, time=25985352706309002 Request = regionName=frog_stastic,\x92\x92\x0C\x08_{211}_1420085905974,1463098916452.d1029a5f68875e64ca7e15f76d46564f., storeName=info, fileCount=4, fileSize=5.4 G (5.1 G, 200.3 M, 78.1 M, 2.4 M), priority=1, time=25985352793187834 Request = regionName=frog_stastic,\x96Y\xCF\x07_{211}_1454235225190,1462931655268.d3ec423376a006ba32bbf69991623347., storeName=info, fileCount=5, fileSize=5.7 G (4.8 G, 384.9 M, 218.5 M, 357.1 M, 6.1 M), priority=1, time=25985352851231347 Request = regionName=frog_stastic,\x99\xBD\xB3\x03_{211}_1461591674656,1464048666530.76cf28ecaf16696d72b378cd1f4f23ce., storeName=info, fileCount=3, fileSize=5.7 G, priority=1, time=25985352908956385 Store = info, pri = -1 Request = regionName=frog_stastic,\xA0 8\x08_{211}_145586158722,1464148356671.6ced4e1b07cddd28a00542df1e0f3aa5., storeName=info, fileCount=3, fileSize=5.5 G (5.5 G, 80.7 M, 7.0 M), priority=1, time=25985353021215120 Store = info, pri = -5 Request = regionName=frog_stastic,\xA6\x1C\xA0\x07_{211}_1454247800799,1463270612468.822f681f0f7b550a7fbcac854fa8e9a6., storeName=info, fileCount=8, fileSize=5.4 G (4.6 G, 417.8 M, 173.4 M, 68.4 M, 48.0 M, 37.5 M, 16.3 M, 23.4 M), priority=1, time=25985353123345348 Request = regionName=frog_stastic,\xAC\xDF\xDF\x07_{211}_14607977956,1464155651888.7d690648c70d7745eda973f8aedf747e., storeName=info, fileCount=15, fileSize=11.0 G, priority=1, time=25985353236737826 Request = regionName=frog_stastic,\xB4\x89\xD5\x04_211_1453639850971,1463356213645.2332274012d58cec41a98ac4b3f61f9a., storeName=info, fileCount=9, fileSize=5.7 G (5.0 G, 373.8 M, 68.4 M, 26.9 M, 28.5 M, 57.9 M, 91.6 M, 76.3 M, 7.0 M), priority=1, time=25985353355161127 Request = regionName=frog_stastic,\xB6%5\x06_{211}_14594644953,1463702522501.c6ca69ec6743c4dcc00758a77ffb6c4b., storeName=info, fileCount=40, fileSize=10.3 G, priority=1, time=25985353382037400 Request = regionName=frog_stastic,\xBA\xF6\xD4\x07_{211}_1454312190014,1461548607728.26a07c3ae90991c16a902a0cd0699a61., storeName=info, fileCount=9, fileSize=7.8 G, priority=1, time=25985353475213462 Request = regionName=frog_stastic,\xBD \xCB\x02_{211}_1453596862322,1460962480333.9bd122da2e46f11679618f71bc70d4cf., storeName=info, fileCount=8, fileSize=6.9 G (6.2 G, 231.5 M, 122.4 M, 94.3 M, 49.9 M, 89.3 M, 42.0 M, 73.9 M), priority=1, time=25985353511330772 Request = regionName=frog_stastic,\xC3\x02\xB3\x02_211_1451805977924,1460961034189.db6005a56eb5577b7e5b63fe08b5b7f4., storeName=info, fileCount=2, fileSize=6.4 G (6.4 G, 52.6 M), priority=1, time=25985353613226689 Request = regionName=frog_stastic,\xC5)\xE8\x02_{211}_1454034923785,1461495057217.ea0c0cdacc4f08f3e243e9e21b415a21., storeName=info, fileCount=8, fileSize=6.3 G (5.7 G, 223.0 M, 95.8 M, 46.3 M, 46.1 M, 159.1 M, 83.3 M, 3.9 M), priority=1, time=25985353665352546 Request = regionName=frog_stastic,\xCAzM\x07_{211}_14542544519,1463358071441.88eb274077effd68ed4f6cd12b8b17f0., storeName=info, fileCount=9, fileSize=5.3 G, priority=1, time=25985353828916742 Request = regionName=frog_stastic,\xCC\xC1\x95\x08_{211}_1462683705599,1464148390780.5498859423bfea0afe6bfc1a27b97a96., storeName=info, fileCount=3, fileSize=5.2 G (5.1 G, 72.6 M, 3.4 M), priority=1, time=25985353865952207 Request = regionName=frog_stastic,\xD3\x0DK\x04_{211}_145446905,1462460738157.2f00b101eb91baf733195797f0da378f., storeName=info, fileCount=4, fileSize=6.2 G, priority=1, time=25985353960973918 Request = regionName=frog_stastic,\xD8\x7F\xA7\x07_211_1453703426340,1463651130568.e9e65079ac7e35c3cfc7e32042e63675., storeName=info, fileCount=51, fileSize=10.7 G, priority=1, time=25985354047707619 Request = regionName=frog_stastic,\xD8\xF2S\x06_{211}_1458836315027,1464226110243.d3a278d0ac4ce42f04c4bc007e892b90., storeName=info, fileCount=8, fileSize=10.7 G (9.2 G, 434.7 M, 210.2 M, 93.1 M, 321.0 M, 338.8 M, 138.4 M, 72.0 M), priority=1, time=25985354060037034 Store = info, pri = -2 Request = regionName=frog_stastic,\xE0\xD5\x17\x08_{211}_1455371527915,1463008984349.f4d6a64c68cde2ab2adbdb23b2689d2f., storeName=info, fileCount=8, fileSize=5.6 G (4.6 G, 213.3 M, 116.5 M, 95.1 M, 295.8 M, 110.4 M, 36.4 M, 117.0 M), priority=1, time=25985354199588482 Request = regionName=frog_stastic,\xE2M"\x09_{211}_1458453583316,1462497144759.b6a91acbc3d3e03f88d796d08c8b5c4a., storeName=info, fileCount=8, fileSize=5.6 G (4.8 G, 402.3 M, 211.5 M, 19.5 M, 16.7 M, 21.3 M, 66.3 M, 20.8 M), priority=1, time=25985354225157138 Store = info, pri = -1 Store = info, pri = -18 Request = regionName=frog_stastic,\xF2\x10d\x08_{211}_1457968854002,1463182056540.6b96eedc154ca722aab1354982f8d3ad., storeName=info, fileCount=8, fileSize=5.6 G (4.7 G, 445.2 M, 119.5 M, 80.0 M, 21.1 M, 25.9 M, 56.9 M, 86.9 M), priority=1, time=25985354476031415 Request = regionName=frog_stastic,\xF5v\xD5\x03_{211}_1456230387675,1462413096075.e468617a9cde2811044eb5d0aaca0e5f., storeName=info, fileCount=8, fileSize=5.9 G (5.3 G, 224.2 M, 79.0 M, 78.8 M, 42.2 M, 58.5 M, 41.3 M, 109.3 M), priority=1, time=25985354529057390 Request = regionName=frog_stastic,\xF9\xDD\x1B\x04_{211}_1454657736615,1460565801084.efcc88db7963dcf2b9522ecd2fa04bfb., storeName=info, fileCount=9, fileSize=6.6 G, priority=1, time=25985354596275614 Store = info, pri = -20 Request = regionName=frog_stastic,\xFEg\xFB\x06_{211}_1453519712355,1463009721351.04ba54d25cb208642bc8805760774584., storeName=info, fileCount=8, fileSize=5.5 G (4.5 G, 393.8 M, 105.5 M, 127.3 M, 105.2 M, 106.7 M, 35.5 M, 125.9 M), priority=1, time=25985354669024228 Store = info, pri = -13 Store = info, pri = -4 Store = info, pri = -14 Store = info, pri = -8 Store = info, pri = -27 Store = info, pri = -14 Store = info, pri = -31 Store = info, pri = 2 Store = info, pri = -28 Store = info, pri = -29 Store = info, pri = -14 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -30 Store = info, pri = -14 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = -26 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -14 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = cf, pri = -26 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = -30 Store = info, pri = -36 Store = info, pri = -2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = -22 Store = cf, pri = -38 Store = info, pri = -20 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -40 Store = info, pri = -42 Store = url, pri = -48 Store = url, pri = -49 Store = cf, pri = -41 Store = cf, pri = -42 Store = cf, pri = -44 Store = cf, pri = -46 Store = cf, pri = -28 Store = cf, pri = -29 Store = info, pri = -24 Store = info, pri = 2 Store = info, pri = -24 Store = info, pri = -38 Store = info, pri = -40 Store = info, pri = -36 Store = info, pri = -38 Store = cf, pri = -29 Store = info, pri = -28 Store = info, pri = -36 Store = cf, pri = -30 Store = info, pri = -32 Store = info, pri = -31 Store = info, pri = -21 Store = info, pri = -28 Store = info, pri = -22 Store = info, pri = -31 Store = info, pri = -1 Store = cf, pri = -30 Store = info, pri = -4 Store = info, pri = -13 Store = info, pri = -13 Store = info, pri = -13 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = -7 Store = info, pri = -20 Store = info, pri = -20 Store = info, pri = -31 Store = info, pri = -20 Store = info, pri = -21 Store = info, pri = -1 Store = info, pri = -1 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = -7 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = -13 Store = info, pri = -8 Store = info, pri = -13 Store = info, pri = -13 Store = info, pri = -7 Store = info, pri = -9 Store = info, pri = -26 Store = info, pri = -20 Store = info, pri = -1 Store = info, pri = -6 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = -9 Store = info, pri = -22 Store = info, pri = -12 Store = info, pri = -4 Store = info, pri = -9 Store = info, pri = -20 Store = info, pri = -33 Store = info, pri = -24 Store = info, pri = -20 Store = info, pri = -17 Store = info, pri = -1 Store = info, pri = -4 Store = info, pri = -9 Store = info, pri = -17 Store = info, pri = -19 Store = info, pri = -25 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = -13 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -13 Store = info, pri = -4 Store = cf, pri = -30 Request = regionName=frog_stastic,\x03M\x1B\x02_{211}_1453534052437,1464241129362.40283c2567ceb61a6cb605b623b85953., storeName=info, fileCount=13, fileSize=11.3 G (10.1 G, 797.7 M, 90.3 M, 95.1 M, 81.3 M, 27.9 M, 40.5 M, 81.0 M, 7.9 M, 6.2 M, 7.3 M, 13.5 M, 9.5 M), priority=1, time=26069585843116023 Request = regionName=frog_stastic,\x1B\xBC\xE8\x02_{211}_1454911484376,1461628186131.881846d3248b6549d937eaa4c047c844., storeName=info, fileCount=8, fileSize=6.3 G (5.6 G, 379.3 M, 108.4 M, 25.0 M, 34.1 M, 17.6 M, 53.2 M, 66.2 M), priority=1, time=26069587755503205 Request = regionName=frog_stastic,3\x99\x06\x00_{211}_1458220367516,1463527225557.03de098e871dd4ca49ac94f927e33af3., storeName=info, fileCount=8, fileSize=5.6 G (5.2 G, 236.6 M, 39.0 M, 37.9 M, 30.5 M, 25.1 M, 23.1 M, 55.0 M), priority=1, time=26069589141315920 Request = regionName=frog_stastic,;~\xA0\x03_{211}_1454407172433,1462145776899.891af00ebc3fef0506629ab5b4d93fce., storeName=info, fileCount=8, fileSize=6.0 G (5.3 G, 230.0 M, 85.1 M, 55.6 M, 138.0 M, 70.4 M, 144.1 M, 44.4 M), priority=1, time=26069589508221112 Request = regionName=frog_stastic,D\xF6\xBF\x07_{211}_1454036097685,1460562923484.2723c4c3201b8b3b9a172544b8091003., storeName=info, fileCount=9, fileSize=8.1 G (7.0 G, 417.7 M, 93.8 M, 223.9 M, 242.8 M, 124.8 M, 23.2 M, 34.6 M, 2.6 M), priority=1, time=26069589859764122 Request = regionName=frog_stastic,\x5Ca\x00\x08_{211}_14557047082,1462925726965.6c2fdea98f8b0d8dece836d2a70a264f., storeName=info, fileCount=9, fileSize=5.5 G (5.1 G, 213.4 M, 103.4 M, 15.1 M, 19.0 M, 24.9 M, 22.0 M, 35.2 M, 380.8 K), priority=1, time=26069590625831059 Request = regionName=frog_stastic,r\xBA\x9A\x06_{211}_1454301940795,1463009083280.23671e644b4a192dd909570311332d58., storeName=info, fileCount=8, fileSize=5.5 G (4.6 G, 386.5 M, 234.5 M, 76.2 M, 43.6 M, 61.8 M, 101.4 M, 58.5 M), priority=1, time=26069591355722952 Request = regionName=frog_stastic,\x80\xE4\xD9\x08_{211}_1458042722914,1464218832123.3a63b6bb9c744fda844789061b02560c., storeName=info, fileCount=20, fileSize=10.1 G (9.0 G, 676.6 M, 221.8 M, 116.7 M, 2.2 M, 5.4 M, 15.5 K, 4.5 M, 3.8 M, 4.0 M, 4.0 M, 7.9 M, 8.2 M, 7.4 M, 6.9 M, 1.6 M, 14.3 M, 16.2 M, 13.5 M, 12.2 M), priority=1, time=26069591792579611 Request = regionName=frog_stastic,\x9D*\xCF\x00_{321}_1454335423515,1462241443665.406edd0a1f23b604ddda95692a9352fd., storeName=info, fileCount=8, fileSize=6.1 G (5.5 G, 120.0 M, 92.1 M, 38.4 M, 33.6 M, 71.8 M, 102.9 M, 116.0 M), priority=1, time=26069592681419184 Request = regionName=frog_stastic,\xB6]\x92\x05_{201}_1455189107493,1462839673832.dd80258e452cf735fb51cb85034dc74a., storeName=info, fileCount=4, fileSize=5.6 G (5.2 G, 365.3 M, 50.1 M, 5.7 M), priority=1, time=26069593448238124 Request = regionName=frog_stastic,\xCE\xF3-\x06_211_1451909995689,1460622892151.d305864a16a1069fe7152962a96c4277., storeName=info, fileCount=5, fileSize=9.4 G (8.7 G, 458.0 M, 147.9 M, 92.4 M, 4.5 M), priority=1, time=26069594104775616 Request = regionName=frog_stastic,\xDA\xB8\xA7\x07_{211}_1453903683420,1463527407489.fac4d91e4d4d5e6c50c40e0862a96186., storeName=info, fileCount=8, fileSize=5.2 G (4.6 G, 221.7 M, 173.8 M, 42.3 M, 116.9 M, 35.8 M, 6.7 M, 816.1 K), priority=1, time=26069594412112643 Store = info, pri = -7 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = -7 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = -23 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = -1 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -11 Store = info, pri = -12 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -13 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -27 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = -20 Store = info, pri = -20 Store = info, pri = -8 Store = info, pri = -19 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = -13 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -7 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -4 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = -22 Store = info, pri = 2 Store = info, pri = -40 Store = info, pri = -31 Store = info, pri = -31 Store = info, pri = 2 Store = info, pri = -24 Store = info, pri = -24 Store = info, pri = -24 Store = info, pri = 2 Store = info, pri = -17 Store = info, pri = -12 Store = info, pri = -12 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -5 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -4 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = f, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 5 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = -13 Store = info, pri = 2 Request = regionName=frog_stastic,\x00$M\x0A_{211}_1463128085,1464155379940.ce51565e1d458f2fb1834ad6c5b8a27f., storeName=info, fileCount=14, fileSize=10.6 G, priority=1, time=25985348349131725 Request = regionName=frog_stastic,\x06\x10\xC5\x05_{211}_1453621467622,1464220259659.756efbdf0495bdd503b933d30a77cfed., storeName=info, fileCount=10, fileSize=10.2 G (9.2 G, 690.5 M, 247.5 M, 67.8 M, 8.5 M, 9.1 M, 57.9 K, 8.5 M, 8.7 M, 6.0 M), priority=1, time=25985350003894166 Request = regionName=frog_stastic,\x08\x83\x03\x07_{211}_1457528734284,1462756186503.08cba4ddbdd7a43adc6c718c3d32461d., storeName=info, fileCount=8, fileSize=5.4 G (4.6 G, 373.2 M, 71.6 M, 28.8 M, 45.3 M, 62.7 M, 75.9 M, 112.3 M), priority=1, time=25985350139874066 Request = regionName=frog_stastic,\x0A[\x88\x08_{211}_1456998381558,1464152830409.918b71448c52a72dd0f536f599f0aa33., storeName=info, fileCount=18, fileSize=10.7 G (9.2 G, 801.6 M, 124.1 M, 86.0 M, 91.0 M, 81.4 M, 52.9 M, 108.4 M, 78.4 M, 8.3 M, 6.0 M, 9.9 M, 5.0 M, 15.1 M, 16.2 M, 16.4 M, 15.8 M, 1.8 M), priority=1, time=25985350208231428 Request = regionName=frog_stastic,\x0CR\x00\x06_{211}_1459427233,1462240780717.05319a2305623d264406222df31eef54., storeName=info, fileCount=9, fileSize=5.9 G, priority=1, time=25985350279884980 Request = regionName=frog_stastic,\x0F*k\x02_{111}_1456756984897,1464218845975.591fa1c05ad25aea755705d09c6a5bd4., storeName=info, fileCount=13, fileSize=10.3 G (9.6 G, 221.0 M, 81.5 M, 77.5 M, 315.8 M, 7.0 M, 11.0 M, 11.3 K, 7.9 M, 2.1 M, 530.6 K, 21.1 M, 953.2 K), priority=1, time=25985350359083594 Request = regionName=frog_stastic,\x12\xE3j\x06_{211}_1452507490622,1462410384217.76437dfcd10d6ceed7c7624b67069884., storeName=info, fileCount=9, fileSize=5.9 G (4.9 G, 232.4 M, 129.6 M, 137.7 M, 536.7 M, 26.0 M, 8.8 M, 7.9 M, 3.1 M), priority=1, time=25985350472370962 Request = regionName=frog_stastic,\x13\xCA\xAC\x00_{111}_1454073434926,1462318162969.c8b547738dc2c7548c7fd58c805475e6., storeName=info, fileCount=9, fileSize=6.3 G (5.4 G, 364.9 M, 118.8 M, 34.8 M, 57.5 M, 176.9 M, 100.9 M, 28.5 M, 1.5 M), priority=1, time=25985350492197564 Request = regionName=frog_stastic,\x14!\x80\x09_{211}_1462168736,1464147974603.e6ce38d83e118dfb6f73a84be7cd5999., storeName=info, fileCount=2, fileSize=4.8 G, priority=1, time=25985350499479324 Request = regionName=frog_stastic,\x14f\xE5\x07_{211}_1454559043093,1462925480744.3dbf3fe7451ee6fbfc2ba061fc5870df., storeName=info, fileCount=7, fileSize=5.7 G (5.1 G, 292.1 M, 117.9 M, 61.8 M, 28.7 M, 97.3 M, 5.9 M), priority=1, time=25985350514045349 Request = regionName=frog_stastic,\x16\x16@\x01_{211}_145372829646,1463013782200.5d1eb2116d80cb9c9a3156d5ed3c1f53., storeName=info, fileCount=4, fileSize=5.1 G, priority=1, time=25985350549469355 Request = regionName=frog_stastic,\x18H\xD2\x06_{211}_1461163038593,1463787747672.442cdaf5c78afa625378032b12ef9377., storeName=info, fileCount=39, fileSize=10.8 G (9.2 G, 772.3 M, 199.5 M, 104.9 M, 55.1 M, 18.6 M, 10.2 M, 9.0 M, 11.0 M, 30.7 K, 10.9 M, 3.7 M, 15.1 M, 19.4 M, 20.6 M, 15.7 M, 5.1 M, 12.0 M, 15.3 M, 18.7 M, 19.4 M, 19.7 M, 12.0 M, 13.0 M, 15.0 M, 18.0 M, 15.9 M, 6.6 M, 9.3 M, 10.1 M, 12.0 M, 10.5 M, 11.9 M, 7.7 M, 14.1 M, 16.8 M, 16.8 M, 16.2 M, 2.8 M), priority=1, time=25985350600354671 Request = regionName=frog_stastic,\x18o\xB8\x08_{211}_1462491655415,1463531018735.37b031534569c146bc01c2ed9b0018ce., storeName=info, fileCount=4, fileSize=5.4 G, priority=1, time=25985350604328323 Request = regionName=frog_stastic,\x1A\xA40\x09_{211}_1460260789644,1463875577430.c6ec05c35c067760770c52dc65274111., storeName=info, fileCount=4, fileSize=5.7 G (5.4 G, 230.3 M, 72.0 M, 4.1 M), priority=1, time=25985350652653533 Request = regionName=frog_stastic,\x1C\x16\xC9\x06_{211}_1455245196,1463442066291.dd9329ecd1cc886c7f5c5313cafde507., storeName=info, fileCount=4, fileSize=5.3 G, priority=1, time=25985350673865644 Request = regionName=frog_stastic,"$#\x0A_{211}_1462171534872,1463009817118.bd631d9c9ab7d5588229bf4ffd43dcf9., storeName=info, fileCount=7, fileSize=5.5 G (5.0 G, 421.5 M, 104.1 M, 8.3 M, 9.1 M, 8.7 M, 32.0 M), priority=1, time=25985350841167980 Request = regionName=frog_stastic,"\x9FF\x08_{211}_1456328969051,1463095780945.516152c6c8c27c9869fe7397bee029bc., storeName=info, fileCount=9, fileSize=5.7 G (4.8 G, 229.6 M, 96.6 M, 28.1 M, 105.9 M, 195.2 M, 234.4 M, 24.7 M, 1.3 M), priority=1, time=25985350854792816 Request = regionName=frog_stastic,&Lw\x08_{211}_1456258148381,1463009731056.e1a0a9ca8d90d1d14288588915e035ee., storeName=info, fileCount=4, fileSize=5.6 G, priority=1, time=25985350918090587 Request = regionName=frog_stastic,&\xA7\xD4\x07_{211}_1456390522275,1463009034468.30e5be5e40621a41e288215704807ed1., storeName=info, fileCount=4, fileSize=5.9 G (5.4 G, 388.9 M, 125.3 M, 3.7 M), priority=1, time=25985350927686799 Request = regionName=frog_stastic,)\x8C\xFF\x02_{311}_1454506893364,1462154818727.5e50204f0e93a3e44b925cf7e4f3e88a., storeName=info, fileCount=9, fileSize=5.8 G (5.4 G, 205.1 M, 78.7 M, 45.0 M, 29.8 M, 35.3 M, 9.4 M, 11.4 M, 6.1 M), priority=1, time=25985350972760052 Store = info, pri = 0 Request = regionName=frog_stastic,,\xAF\xA9\x06_201_1451793603930,1463013290308.53f70b7fd8aaa7351bb8efb8f1ce168e., storeName=info, fileCount=8, fileSize=5.4 G (4.6 G, 448.7 M, 121.2 M, 28.7 M, 30.0 M, 47.4 M, 85.2 M, 81.2 M), priority=1, time=25985351030175436 Request = regionName=frog_stastic,.\xA7\x8A\x08_{211}_1459670280199,1464154173418.995c5b88f203598dc0c203238a072a08., storeName=info, fileCount=13, fileSize=10.3 G (9.7 G, 393.1 M, 108.1 M, 68.3 M, 82.8 K, 14.0 M, 8.5 M, 7.4 M, 9.0 M, 9.2 M, 8.2 M, 16.3 M, 1.8 M), priority=1, time=25985351067472163 Request = regionName=frog_stastic,0{\xCD\x05_201_14535189895,1463185147912.9d5dfd9e12a600898c3c842faf4debd6., storeName=info, fileCount=3, fileSize=5.6 G (5.4 G, 122.4 M, 7.1 M), priority=1, time=25985351098990409 Request = regionName=frog_stastic,2E4\x08_{211}_1455755529371,1463703406058.e0d68f6fd30a6fea781fe23c22008b0f., storeName=info, fileCount=3, fileSize=5.4 G (5.1 G, 392.7 M, 2.3 M), priority=1, time=25985351127768413 Request = regionName=frog_stastic,2\xC6\xA3\x07_{211}_145415561,1463873244980.9247a438c34bea9a3906db8b14ce7927., storeName=info, fileCount=4, fileSize=5.6 G (5.3 G, 272.7 M, 78.5 M, 1022.2 K), priority=1, time=25985351142145540 Request = regionName=frog_stastic,4"\xB2\x05_{211}_1454280691321,1459799453302.a8f60591bddde77318e0d3937ba1a7d7., storeName=info, fileCount=9, fileSize=10.2 G (9.0 G, 737.9 M, 269.9 M, 113.0 M, 58.0 M, 26.1 M, 8.9 M, 8.0 M, 6.3 M), priority=1, time=25985351159303352 Request = regionName=frog_stastic,6\xF8M\x07_{211}_1453685949985,1463962548793.97c76a1928baecbcea7b4ea11958ccd0., storeName=info, fileCount=27, fileSize=9.8 G (9.0 G, 384.4 M, 217.0 M, 33.0 M, 11.8 M, 11.7 M, 35.4 K, 11.9 M, 11.7 M, 9.7 M, 8.1 M, 15.5 M, 20.3 M, 16.6 M, 7.0 M, 8.2 M, 9.0 M, 11.5 M, 12.0 M, 4.2 M, 9.9 M, 10.1 M, 184.4 K, 16.2 M, 17.7 M, 18.4 M, 11.7 M), priority=1, time=25985351210888033 Request = regionName=frog_stastic,8\x09+\x03_{111}_1453959563226,1463786246085.6db0c70812b228c7ac80deca8a39b977., storeName=info, fileCount=41, fileSize=10.7 G, priority=1, time=25985351220927242 Request = regionName=frog_stastic,8[\xBA\x04_{211}_1461402598672,1463359179688.ae736621c72da12dde255eaaaffc371a., storeName=info, fileCount=8, fileSize=5.6 G (5.0 G, 415.4 M, 86.2 M, 55.5 M, 51.7 M, 50.2 M, 8.9 M, 7.4 M), priority=1, time=25985351229278932 Request = regionName=frog_stastic,9\xEA\xD5\x03_211_1453730515065,1461063924344.9726bcbcfca1f9b298067a5779b4c94f., storeName=info, fileCount=9, fileSize=6.6 G (5.6 G, 434.7 M, 72.7 M, 98.3 M, 91.5 M, 87.2 M, 110.8 M, 84.0 M, 1.2 M), priority=1, time=25985351254356419 Request = regionName=frog_stastic,?X\xA4\x02_211_1451795417,1462241587290.e22da3a1d2bd8bf47e78d2005c28acf6., storeName=info, fileCount=9, fileSize=5.7 G (5.0 G, 394.5 M, 19.5 M, 45.8 M, 29.9 M, 31.5 M, 63.1 M, 83.5 M, 5.5 M), priority=1, time=25985351350603198 Request = regionName=frog_stastic,B\xB5\x0F\x08_{211}_1456396895507,1463271865003.9c9dc30d7a8bc69e9926fce637ff94b1., storeName=info, fileCount=9, fileSize=5.8 G, priority=1, time=25985351404681133 Request = regionName=frog_stastic,D]2\x01_{211}_1455197867173,1463649322185.7a5ef439e3c1983cd769fa650568db35., storeName=info, fileCount=4, fileSize=5.7 G (5.3 G, 406.4 M, 67.4 M, 3.3 M), priority=1, time=25985351431717672 Request = regionName=frog_stastic,D\x99T\x06_{211}_1459677986176,1463700584064.ce108b8e59e2f29bba71379e09480f3f., storeName=info, fileCount=4, fileSize=5.5 G (5.1 G, 370.2 M, 86.8 M, 7.1 M), priority=1, time=25985351437703232 Request = regionName=frog_stastic,HG\xFF\x06_211_1451789552794,1462491355156.cfe4b3112c44d0ef486f54879437221b., storeName=info, fileCount=8, fileSize=5.6 G, priority=1, time=25985351496262009 Request = regionName=frog_stastic,H\xAA\x84\x08_{211}_1458050663817,1463009051142.3cc2a713790b81a36ae697e6cfbde0a4., storeName=info, fileCount=5, fileSize=5.9 G (5.3 G, 432.5 M, 111.6 M, 57.2 M, 4.7 M), priority=1, time=25985351505822901 Request = regionName=frog_stastic,H\xD3\x96\x06_{211}_1458716468213,1463009218589.dd2c2eddd78dcebf411a59ad4df6a7b4., storeName=info, fileCount=8, fileSize=5.8 G (4.9 G, 193.7 M, 95.0 M, 65.7 M, 251.9 M, 296.0 M, 25.3 M, 22.9 M), priority=1, time=25985351511739872 Request = regionName=frog_stastic,J\xDF#\x08_{211}_1455510261676,1462757127797.595aaa01e2eb8f8d9d6cfba071e13b74., storeName=info, fileCount=9, fileSize=6.1 G, priority=1, time=25985351547543724 Request = regionName=frog_stastic,P!8\x08_{211}_1457360851559,1463527626908.17230207283b3b8edf1a0445adacc012., storeName=info, fileCount=4, fileSize=5.7 G (5.2 G, 471.3 M, 57.2 M, 5.9 M), priority=1, time=25985351642686936 Request = regionName=frog_stastic,PC\xD9\x07_{211}_1454576663,1463362368253.2544de67f978b18018e614d8d8918503., storeName=info, fileCount=5, fileSize=5.8 G (5.1 G, 369.5 M, 233.8 M, 68.0 M, 1.5 M), priority=1, time=25985351645826050 Request = regionName=frog_stastic,T\x9E!\x03_{111}_1453867763111,1463878412991.1dc5e5a2ccc3b3ec70c479ab6dd74b83., storeName=info, fileCount=31, fileSize=10.4 G (9.1 G, 397.6 M, 123.2 M, 90.0 M, 127.5 M, 112.9 M, 117.4 M, 32.3 M, 11.1 M, 15.4 M, 8.8 M, 14.9 M, 18.3 M, 18.5 M, 19.7 M, 19.2 M, 10.2 M, 12.8 M, 19.3 M, 17.0 M, 7.9 M, 10.1 M, 9.9 M, 12.5 M, 7.9 M, 10.0 M, 9.3 M, 14.1 M, 17.0 M, 18.3 M, 12.4 M), priority=1, time=25985351725949202 Request = regionName=frog_stastic,T\xDC<\x07_{211}_1456402166228,1462491562466.f088018ff74f4b02affdf5ced06614f1., storeName=info, fileCount=9, fileSize=5.7 G, priority=1, time=25985351732911090 Request = regionName=frog_stastic,X\x95O\x03_{111}_1456667674166,1462922603886.c3ea9fb4e44496b91b2acc55cf0cd6ef., storeName=info, fileCount=9, fileSize=5.6 G, priority=1, time=25985351792859305 Request = regionName=frog_stastic,X\xA2-\x07_{211}_1455589643,1463875589607.c0d8437b39d786d84951d481704ad1c4., storeName=info, fileCount=34, fileSize=10.7 G (9.3 G, 760.6 M, 229.8 M, 50.0 M, 11.2 M, 11.1 M, 52.4 K, 11.3 M, 9.4 M, 4.9 M, 8.9 M, 14.6 M, 17.6 M, 19.5 M, 20.0 M, 14.9 M, 241.6 K, 13.7 M, 16.3 M, 18.1 M, 16.5 M, 7.2 M, 10.1 M, 10.0 M, 11.9 M, 10.2 M, 10.2 M, 13.8 M, 438.3 K, 16.2 M, 16.8 M, 17.4 M, 16.0 M, 4.3 M), priority=1, time=25985351794194809 Store = info, pri = 0 Request = regionName=frog_stastic,\x5C3\x95\x07_{211}_1454050152445,1463872797139.586022b3ba17312a12a210e0cb3afb65., storeName=info, fileCount=34, fileSize=10.7 G, priority=1, time=25985351870288010 Request = regionName=frog_stastic,\x5C\xDB\xF6\x07_{211}_1456401934953,1462927784797.3cef943cdfcc79b9179fb980f5ea88f0., storeName=info, fileCount=9, fileSize=5.4 G (4.5 G, 225.6 M, 121.9 M, 343.4 M, 27.7 M, 50.0 M, 107.0 M, 58.0 M, 7.5 M), priority=1, time=25985351888397500 Request = regionName=frog_stastic,`\x12\xEC\x06_211_1451715578311,1464226103685.e3d87d0efa73494a1d49702f451251e4., storeName=info, fileCount=8, fileSize=10.3 G (9.1 G, 409.5 M, 209.1 M, 170.7 M, 106.0 M, 127.3 M, 89.8 M, 101.2 M), priority=1, time=25985351938791684 Request = regionName=frog_stastic,`*\xC4\x07_{211}_14542258308,1463527340709.bd2b84898df7b9c7c616759b70cc3f02., storeName=info, fileCount=9, fileSize=5.4 G (4.9 G, 219.8 M, 54.9 M, 22.0 M, 32.8 M, 58.6 M, 98.7 M, 67.3 M, 809.3 K), priority=1, time=25985351941263715 Store = info, pri = 0 Store = info, pri = 2 Request = regionName=frog_stastic,h!\x14\x08_{201}_1455348754603,1463617249911.090b258a73097abcc37067c9ce395d7c., storeName=info, fileCount=3, fileSize=5.9 G (5.3 G, 489.3 M, 69.3 M), priority=1, time=25985352071960892 Request = regionName=frog_stastic,h\xE0\x90\x08_{211}_1458440630819,1464147919100.de5382c2ca1ce660a7acecc23ca2d7eb., storeName=info, fileCount=18, fileSize=9.7 G (8.8 G, 794.0 M, 9.3 M, 3.6 M, 7.2 M, 4.8 M, 5.1 M, 5.1 M, 5.7 M, 6.1 M, 4.6 M, 9.9 M, 3.6 M, 7.6 M, 14.0 M, 17.0 M, 18.4 M, 9.9 M), priority=1, time=25985352094630913 Request = regionName=frog_stastic,j10\x06_{201}_1460525832584,1463530385204.0a1fecf9fd78120fec9789f565fbd54d., storeName=info, fileCount=4, fileSize=5.5 G, priority=1, time=25985352110355336 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,s|6\x02_301_1453611476749,1463008904494.a62d30c8d265cb40a87dd371cffc9d84., storeName=info, fileCount=7, fileSize=5.4 G, priority=1, time=25985352268771106 Request = regionName=frog_stastic,t\x9CQ\x09_{211}_1462787824669,1463527398814.e8f08e78dcd67284c09f20d8c6a44cfc., storeName=info, fileCount=4, fileSize=5.1 G (4.6 G, 461.3 M, 50.0 M, 1.8 M), priority=1, time=25985352290137292 Store = info, pri = 2 Request = regionName=frog_stastic,zW\xA4\x08_{211}_14628794986,1464218910824.5c993125b1aa30289ec766ea56aad880., storeName=info, fileCount=15, fileSize=10.8 G (9.2 G, 806.5 M, 218.3 M, 114.5 M, 89.0 M, 255.4 M, 53.8 M, 40.2 M, 9.4 M, 56.3 K, 7.0 M, 16.3 M, 16.9 M, 16.3 M, 5.3 M), priority=1, time=25985352376316225 Request = regionName=frog_stastic,z\xB1\xC1\x04_{211}_14600261772,1464047546954.215dceaf87437f697caafa2fe25aad2c., storeName=info, fileCount=22, fileSize=10.9 G (9.4 G, 767.0 M, 67.5 M, 181.1 M, 117.2 M, 117.7 M, 119.2 M, 25.9 M, 10.1 M, 73.4 K, 9.2 M, 8.6 M, 6.9 M, 9.7 M, 11.4 M, 10.1 M, 11.3 M, 6.0 M, 14.3 M, 17.1 M, 18.4 M, 8.5 M), priority=1, time=25985352385528545 Request = regionName=frog_stastic,{\x81\xEC\x02_{211}_1454808930722,1463444321809.d4ba105325fdfc354181e5b2e7e4b28c., storeName=info, fileCount=56, fileSize=11.4 G (10.7 G, 151.1 M, 38.8 M, 11.8 M, 15.0 M, 42.4 K, 10.6 M, 10.6 M, 692.8 K, 10.9 M, 7.1 M, 665.0 K, 20.4 M, 10.2 M, 14.7 M, 1.2 M, 19.9 M, 9.6 M, 17.1 M, 2.3 M, 19.2 M, 11.9 M, 85.6 K, 24.0 K, 113.8 K, 16.4 M, 3.1 M, 15.5 M, 16.5 M, 1.9 M, 20.0 M, 14.9 M, 15.7 M, 8.2 M, 2.0 M, 195.3 K, 16.9 M, 17.9 M, 12.7 M, 14.7 M, 4.8 M, 2.8 M, 20.2 M, 5.9 M, 31.1 K, 9.6 M, 8.0 M, 1.1 M, 1.4 M, 26.8 M, 3.2 M, 14.4 M, 3.3 M, 257.8 K, 22.6 M, 4.3 M), priority=1, time=25985352395744405 Store = info, pri = 2 Request = regionName=frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3., storeName=info, fileCount=9, fileSize=6.2 G (5.6 G, 109.9 M, 116.6 M, 63.8 M, 86.3 M, 76.6 M, 110.2 M, 95.5 M, 3.9 M), priority=1, time=25985352499713196 Request = regionName=frog_stastic,\x84\x84\xB9\x04_211_1446604814150,1463527414472.78f3540bb7f198734255e75136df9a20., storeName=info, fileCount=9, fileSize=5.8 G (5.2 G, 414.0 M, 108.9 M, 22.0 M, 17.6 M, 25.4 M, 9.3 M, 8.1 M, 1.7 M), priority=1, time=25985352555428831 Request = regionName=frog_stastic,\x84\xF2\xB2\x08_{221}_1462455176200,1463272207535.d3d561da629a6bf4a37a75000d7d8260., storeName=info, fileCount=4, fileSize=5.1 G (4.7 G, 376.4 M, 50.3 M, 3.3 M), priority=1, time=25985352566796127 Store = info, pri = 2 Request = regionName=frog_stastic,\x8C\x8C\xA5\x07_211_1420086274663,1462321084414.fb98b1f0756e767cb11d30fc4953208f., storeName=info, fileCount=9, fileSize=6.0 G (5.2 G, 219.7 M, 92.6 M, 78.0 M, 139.1 M, 115.2 M, 94.8 M, 91.0 M, 5.6 M), priority=1, time=25985352693439310 Request = regionName=frog_stastic,\x8E\x91y\x08_{211}_1457523192948,1462760625912.6a224acd28641e486fa904c4d844dd88., storeName=info, fileCount=5, fileSize=5.6 G, priority=1, time=25985352725957856 Request = regionName=frog_stastic,\x8E\x9E\xDB\x07_{211}_1454940469634,1463009135879.35e9021e885b714f1dd6b7405a663812., storeName=info, fileCount=9, fileSize=5.7 G (4.8 G, 228.4 M, 106.3 M, 161.9 M, 109.9 M, 81.8 M, 166.9 M, 90.6 M, 3.7 M), priority=1, time=25985352727144908 Store = info, pri = 2 Request = regionName=frog_stastic,\x92\xEB\x99\x06_{211}_1454214413,1460264417603.79431f5ca09347a8f90d3176ad8226fc., storeName=info, fileCount=9, fileSize=8.7 G (7.1 G, 728.8 M, 234.9 M, 75.6 M, 232.7 M, 300.3 M, 25.7 M, 8.1 M, 5.1 M), priority=1, time=25985352802187551 Request = regionName=frog_stastic,\x97@\xB9\x01_{211}_1455445848799,1462231884507.580b9ddb906f77dff5cf685096190e0f., storeName=info, fileCount=3, fileSize=6.0 G (6.0 G, 38.2 M, 6.5 M), priority=1, time=25985352869281183 Request = regionName=frog_stastic,\x982,\x06_{211}_1460547827629,1463704052620.137e2a92e89980cfc01614b1b9044563., storeName=info, fileCount=40, fileSize=10.7 G (9.8 G, 395.3 M, 58.7 M, 10.1 M, 29.0 K, 4.4 M, 85.8 K, 9.5 K, 143.0 K, 9.6 M, 11.2 M, 14.2 M, 2.1 M, 14.4 M, 19.9 M, 20.2 M, 9.9 M, 11.8 M, 12.7 M, 15.3 M, 16.2 M, 16.6 M, 16.7 M, 12.6 M, 4.6 M, 11.9 M, 13.2 M, 16.0 M, 15.6 M, 4.9 M, 9.5 M, 9.3 M, 10.9 M, 10.8 M, 10.9 M, 8.9 M, 15.6 M, 17.2 M, 18.1 M, 11.0 M), priority=1, time=25985352880585752 Request = regionName=frog_stastic,\x9A\x84\xC3\x07_{211}_14621549021,1462755047569.414cf4839f30942c75024211c1f97aad., storeName=info, fileCount=4, fileSize=5.4 G (4.7 G, 394.6 M, 254.8 M, 52.6 M), priority=1, time=25985352925279127 Request = regionName=frog_stastic,\x9C\xE6\xB9\x07_{211}_1454227237141,1463360034466.e34ab752d5286a19bfbd23d11a3d4dfd., storeName=info, fileCount=4, fileSize=5.2 G (4.9 G, 229.1 M, 116.8 M, 2.1 M), priority=1, time=25985352975884857 Request = regionName=frog_stastic,\x9Dh\xE5\x03_{211}_1453971363104,1461974102101.4d36895de7642a37caf26b73bd4f9437., storeName=info, fileCount=9, fileSize=6.0 G (5.6 G, 413.7 M, 1.5 M, 10.9 M, 9.5 M, 9.3 M, 11.7 M, 8.7 M, 1.8 M), priority=1, time=25985352981050133 Store = info, pri = -1 Request = regionName=frog_stastic,\xA09\x08\x0A_{211}_1461844657258,1463617566376.4ba2d83483520e9523d7a5e90bf929ce., storeName=info, fileCount=3, fileSize=5.5 G, priority=1, time=25985353023871625 Request = regionName=frog_stastic,\xA0lv\x07_{211}_1456318025334,1463876200294.d912ab4e621972d8983f0df4e83d2914., storeName=info, fileCount=35, fileSize=10.5 G (8.7 G, 674.9 M, 217.5 M, 113.1 M, 130.1 M, 111.3 M, 240.6 M, 50.4 M, 10.9 M, 13.8 K, 8.0 M, 13.3 M, 18.2 M, 18.8 M, 18.5 M, 16.0 M, 15.4 M, 116.8 K, 12.9 M, 15.2 M, 15.8 M, 14.7 M, 328.9 K, 9.6 M, 11.6 M, 12.9 M, 6.8 M, 11.2 M, 6.3 K, 7.1 M, 14.4 M, 16.5 M, 16.5 M, 13.5 M, 3.5 M), priority=1, time=25985353030361641 Request = regionName=frog_stastic,\xA1\xE4\x88\x02_{211}_1455699837191,1460819972478.0bd9a8a7dec50f06ef77b0b944efd82b., storeName=info, fileCount=8, fileSize=6.9 G (6.2 G, 435.5 M, 149.8 M, 55.0 M, 32.5 M, 15.5 M, 18.5 M, 43.2 M), priority=1, time=25985353049610103 Store = info, pri = -1 Request = regionName=frog_stastic,\xA8w\xAB\x04_{201}_1456558503573,1463703203560.e5bc9f89e2abff07d4c5252604307773., storeName=info, fileCount=41, fileSize=10.0 G (8.8 G, 358.9 M, 101.0 M, 114.2 M, 61.5 M, 99.9 M, 28.7 M, 37.4 M, 14.2 M, 66.5 K, 9.9 M, 455.4 K, 8.1 K, 131.4 K, 16.9 M, 16.3 M, 5.2 M, 14.5 M, 21.4 M, 20.3 M, 6.7 M, 14.5 M, 16.6 M, 18.5 M, 20.6 M, 16.5 M, 9.5 M, 15.0 M, 18.7 M, 17.5 M, 5.4 M, 9.5 M, 9.2 M, 11.7 M, 7.4 M, 10.6 M, 9.4 M, 16.2 M, 18.4 M, 17.6 M, 6.8 M), priority=1, time=25985353160078474 Request = regionName=frog_stastic,\xAA\xA0+\x05_{201}_1456561461664,1463812293901.5cec5ef90b3c67369eea603b35cc342f., storeName=info, fileCount=4, fileSize=5.3 G (5.0 G, 241.8 M, 70.2 M, 4.5 M), priority=1, time=25985353195647630 Request = regionName=frog_stastic,\xAE\x89\x99\x08_{211}_1262316156053,1462927592108.8296d6ee80bc9902fd57d779880ac903., storeName=info, fileCount=9, fileSize=5.6 G (5.0 G, 120.5 M, 83.9 M, 29.3 M, 35.0 M, 132.9 M, 93.6 M, 58.9 M, 3.8 M), priority=1, time=25985353260470212 Request = regionName=frog_stastic,\xAE\xB8\xC0\x04_{211}_1455690865804,1463095363704.3ad6c7b91f722e74b19d1051ee8f9bc9., storeName=info, fileCount=4, fileSize=5.9 G (5.6 G, 225.8 M, 78.7 M, 1.0 M), priority=1, time=25985353265167490 Store = info, pri = 2 Request = regionName=frog_stastic,\xB52\xDD\x03_{211}_1457958192380,1463013734212.8e14b8095bafbd57a66dd6ebf7b970be., storeName=info, fileCount=8, fileSize=5.7 G (5.1 G, 236.4 M, 68.1 M, 119.5 M, 50.4 M, 96.5 M, 27.2 M, 42.1 M), priority=1, time=25985353372787351 Request = regionName=frog_stastic,\xB6p\xFE\x07_{211}_1461769241499,1463787272961.99fb3de550578d75852b4bcc620b0ead., storeName=info, fileCount=34, fileSize=10.6 G (9.7 G, 419.2 M, 89.5 M, 9.9 M, 9.1 M, 18.4 K, 11.6 M, 11.0 M, 62.9 K, 9.2 M, 10.5 M, 22.7 M, 14.4 M, 7.8 M, 14.2 M, 14.9 M, 19.5 M, 20.3 M, 18.2 M, 13.8 M, 14.3 M, 16.8 M, 17.4 M, 14.2 M, 9.6 M, 9.7 M, 11.7 M, 9.6 M, 11.2 M, 7.6 M, 14.5 M, 17.8 M, 18.3 M, 9.9 M), priority=1, time=25985353388886901 Request = regionName=frog_stastic,\xB8]s\x06_211_1453617380455,1463658420059.65ea709ff05cd3feb14451eb4cb3261d., storeName=info, fileCount=4, fileSize=5.7 G, priority=1, time=25985353424463443 Store = info, pri = 2 Request = regionName=frog_stastic,\xBC\xE60\x0A_{201}_1462452400459,1463960815872.9248e922fa959806b406d57863da292a., storeName=info, fileCount=28, fileSize=10.4 G, priority=1, time=25985353507981767 Request = regionName=frog_stastic,\xBED\x03\x07_211_1451795201411,1463652327286.8d3158e125f5bc32141024cdd41e6a01., storeName=info, fileCount=9, fileSize=5.5 G (5.1 G, 123.9 M, 52.9 M, 29.9 M, 59.9 M, 124.6 M, 25.2 M, 25.6 M, 3.7 M), priority=1, time=25985353525969973 Request = regionName=frog_stastic,\xBE^j\x07_{211}_1455341670692,1463183723068.00564b782b574d60c00392720156f813., storeName=info, fileCount=8, fileSize=5.7 G, priority=1, time=25985353528631137 Store = info, pri = 2 Request = regionName=frog_stastic,\xC4\xE1\xAE\x07_{221}_1461423892152,1463530356155.b8ca5ea7342c3cb02c225829e2c99486., storeName=info, fileCount=5, fileSize=5.5 G (4.9 G, 418.6 M, 103.6 M, 25.7 M, 2.5 M), priority=1, time=25985353660143974 Request = regionName=frog_stastic,\xC6\xBC\xBD\x07_{211}_1453984969150,1463963140463.d5d88eb4927b1a6794892fac91b11c6b., storeName=info, fileCount=3, fileSize=5.2 G, priority=1, time=25985353763168256 Request = regionName=frog_stastic,\xC8\x19y\x03_{111}_1462609505356,1463876962260.fc9218e88f6fc62bac14c51b09bfb7b8., storeName=info, fileCount=4, fileSize=4.7 G (4.5 G, 187.9 M, 40.7 M, 7.5 M), priority=1, time=25985353781210047 Store = info, pri = 2 Request = regionName=frog_stastic,\xCA\xAD\x03\x07_{211}_1455111853608,1463010646450.366d1cb4259aa7ce55e9acef88922429., storeName=info, fileCount=8, fileSize=5.4 G, priority=1, time=25985353834382933 Request = regionName=frog_stastic,\xCE<\xFF\x04_{211}_1458029524099,1462926196896.6373fe333a47d414acb2ae8dd6da619b., storeName=info, fileCount=3, fileSize=5.8 G (5.7 G, 80.0 M, 7.5 M), priority=1, time=25985353883957905 Request = regionName=frog_stastic,\xCE\x9F3\x07_{211}_1458124639795,1463530377555.724167e0bf308c000073050d99710b1c., storeName=info, fileCount=3, fileSize=5.4 G, priority=1, time=25985353892508461 Store = info, pri = 2 Request = regionName=frog_stastic,\xD4\x98+\x08_{211}_1457277065761,1463972498813.9d6f2950a31ae9ecad51891e93d9ad7f., storeName=info, fileCount=27, fileSize=10.9 G (9.7 G, 825.0 M, 62.7 M, 24.3 M, 30.3 M, 33.9 M, 34.9 M, 47.1 M, 48.0 M, 8.6 M, 8.9 M, 21.0 M, 18.4 M, 4.7 M, 7.7 M, 7.4 M, 7.4 M, 7.4 M, 6.8 M, 5.4 M, 6.8 M, 7.5 M, 6.0 M, 15.0 M, 17.1 M, 17.1 M, 14.1 M), priority=1, time=25985353982058247 Request = regionName=frog_stastic,\xD8\x86\x19\x06_{211}_1458133276187,1462757980519.82c2e0d666a806c476fe0f65bb3ab94f., storeName=info, fileCount=4, fileSize=5.6 G (5.1 G, 275.2 M, 114.4 M, 69.4 M), priority=1, time=25985354048218583 Request = regionName=frog_stastic,\xD8\xC0.\x08_{221}_1458738104761,1462764118160.65dee9f2f5b51fe3d81becb15638f1c7., storeName=info, fileCount=8, fileSize=5.6 G (4.8 G, 427.4 M, 257.2 M, 50.8 M, 16.6 M, 62.9 M, 25.4 M, 20.7 M), priority=1, time=25985354055681102 Request = regionName=frog_stastic,\xDBX\xE9\x02_{211}_14544987,1463361533855.23ff2ffdfe6f76a213fb5122b8a73935., storeName=info, fileCount=9, fileSize=5.7 G (5.2 G, 161.0 M, 42.0 M, 79.0 M, 80.3 M, 70.7 M, 9.8 M, 11.4 M, 6.0 M), priority=1, time=25985354102634928 Request = regionName=frog_stastic,\xDDM\x9D\x01_{201}_1453685885717,1462155172505.55075d68f6381aef1610b1f11c038a55., storeName=info, fileCount=9, fileSize=6.0 G (5.7 G, 221.9 M, 23.2 M, 26.6 M, 31.9 M, 25.6 M, 11.8 M, 11.5 M, 2.0 M), priority=1, time=25985354139061391 Request = regionName=frog_stastic,\xDE\xAB\x0F\x08_{201}_1459955583504,1463617069547.e4ba91bcb4492e6e7a6b8170bed5eb4c., storeName=info, fileCount=9, fileSize=5.4 G (4.9 G, 126.5 M, 96.1 M, 30.4 M, 65.4 M, 137.2 M, 25.4 M, 25.0 M, 760.0 K), priority=1, time=25985354159408104 Store = info, pri = -1 Store = info, pri = 2 Request = regionName=frog_stastic,\xE0\xE1\xD4\x07_{211}_1454312246294,1463700135714.b84e2caced5bbdb077e8876b933a4d88., storeName=info, fileCount=4, fileSize=5.4 G (5.0 G, 312.1 M, 77.3 M, 2.2 M), priority=1, time=25985354200382169 Request = regionName=frog_stastic,\xE2\xA9N\x06_{211}_1454077721307,1462237087065.9e6b1ea2a5061a107e474364f9e75b22., storeName=info, fileCount=8, fileSize=6.1 G (5.0 G, 435.9 M, 101.3 M, 177.9 M, 97.5 M, 122.7 M, 35.3 M, 98.5 M), priority=1, time=25985354234090544 Request = regionName=frog_stastic,\xE2\xF6?\x08_{211}_1462793104465,1463708411686.6ed5b75e70ba7c8b241111d9e11427ba., storeName=info, fileCount=3, fileSize=5.5 G (5.2 G, 318.6 M, 61.6 M), priority=1, time=25985354241323010 Request = regionName=frog_stastic,\xEB|Q\x04_{211}_1456301079618,1462064687825.fb7091d98cedb3b389dee2e147fa14a7., storeName=info, fileCount=9, fileSize=5.8 G (5.4 G, 223.2 M, 21.4 M, 24.1 M, 41.1 M, 39.3 M, 31.6 M, 36.3 M, 5.6 M), priority=1, time=25985354368500455 Request = regionName=frog_stastic,\xEC`\xC8\x06_{211}_1454037954068,1463787581032.880c742d0f89390557d90f44e8890e4a., storeName=info, fileCount=34, fileSize=10.3 G, priority=1, time=25985354380661172 Request = regionName=frog_stastic,\xEE*'\x0A_{211}_1462196857708,1462841069897.606ee20b4957597dda7e54bc59056c4a., storeName=info, fileCount=8, fileSize=5.8 G, priority=1, time=25985354407903002 Store = info, pri = -14 Store = info, pri = 2 Request = regionName=frog_stastic,\xF2_6\x06_{211}_145662086,1462924362733.73ba46767d943174ed0ed9617cd953c6., storeName=info, fileCount=4, fileSize=5.6 G (5.2 G, 388.4 M, 8.9 M, 5.5 M), priority=1, time=25985354482732394 Request = regionName=frog_stastic,\xF6\xE2\xCD\x07_{211}_1454312576353,1464156079922.31d408dd6431e7855148ddc094a58515., storeName=info, fileCount=14, fileSize=9.6 G, priority=1, time=25985354556179767 Request = regionName=frog_stastic,\xF74\xD1\x01_{321}_1454510510215,1461713073614.e05757363c958e8f8224e086af9c95c1., storeName=info, fileCount=8, fileSize=5.7 G (5.2 G, 220.2 M, 118.8 M, 59.0 M, 76.2 M, 64.6 M, 18.7 M, 24.5 M), priority=1, time=25985354559654945 Request = regionName=frog_stastic,\xFA\x1E\xC1\x05_{211}_1454722204107,1462758812669.84b332c7c062e9205640bcb2894f62fd., storeName=info, fileCount=3, fileSize=5.5 G (5.4 G, 49.7 M, 7.2 M), priority=1, time=25985354599709669 Request = regionName=frog_stastic,\xFAD\xB2\x07_{211}_1453939461788,1464147944579.666281e5fc9aa9e9f5fa22060f67d388., storeName=info, fileCount=3, fileSize=5.2 G, priority=1, time=25985354602935688 Request = regionName=frog_stastic,\xFA\x89\x8F\x09_{211}_1459989551962,1463009128420.4813ef97a62f41f898acf4e1f634ea80., storeName=info, fileCount=3, fileSize=5.5 G (5.1 G, 351.7 M, 7.4 M), priority=1, time=25985354609419136 Store = info, pri = -20 Request = regionName=frog_stastic,\xFF-3\x02_{111}_1460742908153,1462241346100.e351698bb149ab4c444e079c9f8271e5., storeName=info, fileCount=4, fileSize=6.2 G (5.6 G, 405.8 M, 124.1 M, 81.3 M), priority=1, time=25985354684681576 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = -9 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -21 Store = info, pri = -21 Store = cf, pri = -26 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = -4 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -14 Store = cf, pri = -38 Store = info, pri = -36 Store = info, pri = -19 Store = info, pri = -14 Store = info, pri = -6 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = -38 Store = info, pri = 2 Store = info, pri = -41 Store = url, pri = -46 Store = url, pri = -47 Store = info, pri = -21 Store = cf, pri = -39 Store = cf, pri = -39 Store = cf, pri = -40 Store = info, pri = -19 Store = cf, pri = -41 Store = cf, pri = -42 Store = cf, pri = -43 Store = info, pri = -28 Store = cf, pri = -45 Store = info, pri = -26 Store = cf, pri = -27 Store = info, pri = -27 Store = cf, pri = -29 Store = info, pri = -20 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -15 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -11 Store = info, pri = -38 Store = info, pri = -40 Store = info, pri = -36 Store = info, pri = 2 Store = info, pri = -36 Store = info, pri = -15 Store = info, pri = -15 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -28 Store = info, pri = -6 Store = info, pri = -27 Store = info, pri = -14 Store = info, pri = -27 Store = info, pri = -30 Store = info, pri = -28 Store = info, pri = -26 Store = info, pri = -21 Store = info, pri = -20 Store = info, pri = -8 Store = info, pri = -2 Store = info, pri = -20 Store = info, pri = -22 Store = info, pri = -20 Store = info, pri = -27 Store = info, pri = -27 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -19 Store = info, pri = -14 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = -6 Store = info, pri = -7 Store = info, pri = -9 Store = info, pri = -5 Store = info, pri = -15 Store = info, pri = -4 Store = info, pri = -27 Store = info, pri = -6 Store = info, pri = -20 Store = info, pri = -5 Store = info, pri = -7 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = -10 Store = info, pri = -16 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = -11 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = -3 Store = info, pri = -5 Store = info, pri = -3 Store = info, pri = -20 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -16 Store = info, pri = -19 Store = info, pri = -10 Store = info, pri = -16 Store = info, pri = -3 Store = info, pri = -2 Store = info, pri = -3 Store = info, pri = -1 Store = info, pri = -4 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = -10 Store = info, pri = -13 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -10 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -13 Request = regionName=frog_stastic,\x0C\x9A\xB4\x04_{211}_1456562869120,1462663335783.a0c82396e74244e30d2b2b13332f67c0., storeName=info, fileCount=9, fileSize=5.8 G (4.9 G, 685.7 M, 76.8 M, 26.8 M, 60.8 M, 60.0 M, 7.0 M, 6.5 M, 2.5 M), priority=1, time=26069586587923987 Request = regionName=frog_stastic,\x0F\x85\x00\x04_{211}_145388488526,1462922358416.0bc1a7293b46d8c11036d8fab3813d7a., storeName=info, fileCount=5, fileSize=5.9 G (5.4 G, 250.6 M, 114.8 M, 80.0 M, 5.9 M), priority=1, time=26069586781202084 Request = regionName=frog_stastic, \x0A\x00\x08_{211}_1456044201042,1464155406193.2bcf8ca2a0cdfa0216f0b5fb6cf14118., storeName=info, fileCount=2, fileSize=4.7 G (4.6 G, 120.0 M), priority=1, time=26069588063521555 Request = regionName=frog_stastic,*\xA7\x9D\x09_{211}_146021018212,1463963512322.1d2bdae5fd4bd4037fd30865466ff885., storeName=info, fileCount=3, fileSize=5.6 G (5.4 G, 211.5 M, 32.7 M), priority=1, time=26069588745738313 Store = info, pri = 2 Request = regionName=frog_stastic,4.\x94\x05_{211}_1454320098861,1459625377462.45e2b196626d9a37a7b2f33220c6490e., storeName=info, fileCount=19, fileSize=11.1 G (9.0 G, 706.7 M, 371.9 M, 94.0 M, 387.9 M, 163.3 M, 122.5 M, 121.6 M, 1.5 M, 8.8 M, 7.3 M, 13.1 M, 14.2 M, 15.0 M, 16.9 M, 14.5 M, 13.8 M, 13.5 M, 7.2 M), priority=1, time=26069589158577681 Request = regionName=frog_stastic,D\x85\xC5\x08_{211}_1457848092178,1463009653338.c7e480ee70f7969f1f655a9954586450., storeName=info, fileCount=5, fileSize=5.5 G (5.0 G, 396.1 M, 120.9 M, 20.0 M, 4.4 M), priority=1, time=26069589840440312 Request = regionName=frog_stastic,D\xDEj\x06_{211}_1454846472526,1464241839063.c7fe7b71d7e26eaa5f679bc590d86cc9., storeName=info, fileCount=15, fileSize=10.4 G (9.4 G, 385.9 M, 48.1 M, 140.8 M, 150.4 M, 54.3 M, 61.8 M, 42.2 M, 64.9 M, 7.6 M, 7.9 M, 16.3 M, 13.9 M, 13.1 M, 1.5 M), priority=1, time=26069589858465498 Request = regionName=frog_stastic,I\xE2\x02\x01_{111}_1454503966173,1461631504723.eb769b5484c589d34d3c351bad2a76d2., storeName=info, fileCount=9, fileSize=5.8 G (5.2 G, 375.1 M, 56.8 M, 62.6 M, 53.9 M, 44.9 M, 45.0 M, 35.9 M, 5.4 M), priority=1, time=26069590004193606 Request = regionName=frog_stastic,PJ\xAB\x04_{211}_1459508856844,1463362368253.023b5381ec3845c258dbaab1516cae82., storeName=info, fileCount=85, fileSize=11.1 G (10.1 G, 98.4 M, 16.9 M, 16.6 M, 17.4 M, 17.8 M, 17.0 M, 17.9 M, 9.9 M, 56.9 K, 13.8 M, 4.9 M, 16.2 M, 23.5 M, 16.2 M, 6.7 M, 6.6 M, 12.3 M, 25.4 M, 19.2 M, 5.7 M, 14.3 M, 20.5 M, 19.8 M, 8.3 M, 13.7 M, 19.7 M, 19.3 M, 8.0 M, 151.3 K, 7.7 K, 169.6 K, 13.2 M, 18.7 M, 16.0 M, 12.1 M, 11.6 M, 11.4 M, 11.7 M, 12.4 M, 10.7 M, 7.3 M, 9.8 M, 9.4 M, 9.8 M, 10.3 M, 11.0 M, 10.7 M, 10.8 M, 11.0 M, 11.8 M, 11.4 M, 9.5 M, 9.4 M, 2.6 M, 8.0 M, 8.5 M, 8.9 M, 8.7 M, 9.2 M, 9.1 M, 9.1 M, 7.7 M, 6.7 M, 6.3 M, 6.1 M, 5.9 M, 5.9 M, 5.6 M, 6.1 M, 5.8 M, 6.4 M, 7.6 M, 2.4 M, 14.1 M, 16.1 M, 14.8 M, 15.4 M, 8.4 M, 12.3 M, 14.3 M, 16.6 M, 13.3 M, 13.1 M, 2.9 M), priority=1, time=26069590199732729 Request = regionName=frog_stastic,`\xE8\x9B\x07_{211}_1454314863927,1462500002349.1125f9792ee8ddc4304fcf1d6bb02971., storeName=info, fileCount=9, fileSize=5.7 G (5.1 G, 196.9 M, 42.6 M, 39.1 M, 66.0 M, 53.5 M, 39.4 M, 113.0 M, 1.6 M), priority=1, time=26069590784995311 Request = regionName=frog_stastic,f\xD3I\x08_{211}_145806183,1464218871084.ea0e259b80b063584ebccb3b97214504., storeName=info, fileCount=19, fileSize=11.0 G (9.0 G, 650.1 M, 197.5 M, 176.6 M, 617.0 M, 239.9 M, 10.0 M, 63.2 K, 7.6 M, 9.1 M, 8.0 M, 15.2 M, 14.2 M, 4.7 M, 12.5 M, 14.2 M, 16.2 M, 14.2 M, 10.2 M), priority=1, time=26069590978307810 Store = info, pri = 2 Request = regionName=frog_stastic,xi\xB2\x07_{211}_1453882262760,1463613594840.68756fe7ba31002a15388a6d27c405d7., storeName=info, fileCount=59, fileSize=10.7 G (9.3 G, 638.8 M, 63.5 M, 2.3 M, 9.9 M, 36.3 K, 11.7 M, 11.5 M, 15.0 M, 15.2 M, 10.9 M, 2.9 M, 19.1 M, 26.1 M, 17.8 M, 2.8 M, 17.6 M, 24.2 M, 19.7 M, 2.2 M, 8.0 K, 175.0 K, 16.9 M, 19.6 M, 3.9 M, 15.4 M, 18.2 M, 21.2 M, 17.5 M, 898.5 K, 14.1 M, 14.4 M, 19.1 M, 19.3 M, 19.8 M, 15.4 M, 10.1 M, 14.2 M, 15.2 M, 18.8 M, 15.1 M, 10.0 M, 9.4 M, 11.5 M, 9.9 M, 9.9 M, 10.1 M, 27.6 K, 12.2 M, 12.1 M, 13.9 M, 13.8 M, 13.0 M, 4.6 M, 12.5 M, 15.9 M, 16.4 M, 13.7 M, 5.7 M), priority=1, time=26069591508976024 Request = regionName=frog_stastic,\x8Cj\x1F\x08_{211}_1456145030708,1462463609351.47be2b705b91d085af6440c53165ad07., storeName=info, fileCount=9, fileSize=5.9 G (5.1 G, 384.4 M, 115.3 M, 45.6 M, 41.8 M, 103.2 M, 127.2 M, 6.8 M, 4.0 M), priority=1, time=26069592140464385 Request = regionName=frog_stastic,\x95y\x84\x02_201_1453620274190,1461924347752.1e8183ced884f421963c707e81d1d180., storeName=info, fileCount=8, fileSize=6.0 G (5.4 G, 403.0 M, 43.2 M, 24.8 M, 14.5 M, 21.2 M, 41.3 M, 29.0 M), priority=1, time=26069592459803632 Request = regionName=frog_stastic,\xAAG\xCC\x06_{211}_1454583767251,1464174386116.2620a0ec245d1087436a34dddb863151., storeName=info, fileCount=19, fileSize=10.8 G (9.4 G, 192.6 M, 178.3 M, 338.3 M, 96.5 M, 224.2 M, 53.6 M, 88.2 M, 150.5 M, 8.4 M, 9.1 M, 17.1 M, 15.4 M, 10.7 M, 14.3 M, 15.7 M, 15.4 M, 13.5 M, 4.9 M), priority=1, time=26069593056433056 Request = regionName=frog_stastic,\xAA\x86w\x06_{211}_1458396303538,1463654574310.36f44af215ff0f187d41392992735860., storeName=info, fileCount=3, fileSize=5.6 G (5.1 G, 399.1 M, 120.7 M), priority=1, time=26069593065274166 Request = regionName=frog_stastic,\xBAc\xC2\x06_211_1451997167,1462459074967.0ca5edc8fa392a924eeb4981b9e4de40., storeName=info, fileCount=8, fileSize=5.7 G (4.8 G, 651.7 M, 66.7 M, 13.8 M, 15.7 M, 53.8 M, 72.6 M, 32.0 M), priority=1, time=26069593557483533 Request = regionName=frog_stastic,\xBC\x8F-\x06_{211}_1455340437632,1464147874075.3e54091a73c0afd056fe6a459a67184c., storeName=info, fileCount=29, fileSize=11.1 G, priority=1, time=26069593611256974 Store = info, pri = 2 Request = regionName=frog_stastic,\xD0)\x9A\x07_{211}_1454224193395,1463786498622.a496b37776dfe6118fe8f637df7f8fc0., storeName=info, fileCount=45, fileSize=10.2 G (8.9 G, 705.5 M, 111.1 M, 61.2 M, 9.1 M, 36.0 K, 8.1 M, 11.6 M, 9.4 M, 4.6 M, 8.5 M, 17.5 M, 20.3 M, 18.3 M, 4.0 M, 12.9 M, 15.2 M, 17.8 M, 18.1 M, 18.2 M, 14.0 M, 6.6 M, 14.8 M, 17.5 M, 16.9 M, 7.5 M, 8.5 M, 12.0 M, 12.7 M, 3.3 M, 10.9 M, 6.9 M, 8.4 M, 7.7 M, 7.7 M, 8.1 M, 8.0 M, 8.4 M, 7.1 M, 5.7 M, 12.2 M, 14.0 M, 16.4 M, 13.4 M, 4.0 M), priority=1, time=26069594125115027 Request = regionName=frog_stastic,\xE4\x82\xB2\x07_{211}_1453864230156,1464155322606.e8114535eafa9499c1b5eb2420f91143., storeName=info, fileCount=20, fileSize=10.5 G (9.4 G, 707.1 M, 316.0 M, 28.9 M, 1.3 M, 12.0 M, 85.7 K, 2.1 M, 6.5 M, 5.9 M, 7.2 M, 11.7 M, 11.2 M, 10.9 M, 4.4 M, 12.8 M, 14.3 M, 16.2 M, 13.5 M, 7.9 M), priority=1, time=26069594670302105 Request = regionName=frog_stastic,\xF4\xF2W\x06_{211}_1458310493728,1463018529683.c4eed1113b9c6bbaa87d21e077dfe651., storeName=info, fileCount=9, fileSize=5.8 G (4.8 G, 362.6 M, 107.8 M, 84.9 M, 377.1 M, 23.1 M, 37.3 M, 49.7 M, 2.8 M), priority=1, time=26069595170583549 Request = regionName=frog_stastic,\xFA\x17\xFA\x09_{211}_1461638107416,1464152450625.37507414adda8b426bf080a4cce51b9d., storeName=info, fileCount=4, fileSize=5.7 G (5.6 G, 115.2 M, 49.4 M, 2.9 M), priority=1, time=26069595291308320 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = cf, pri = 5 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 6 Store = cf, pri = 5 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 3 Store = cf, pri = 4 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xA4e\xDF\x07_{211}_1454499761600,1463650675699.e7d6d3eb3ff2a7cdbe4613d94381ecf9., storeName=info, fileCount=2, fileSize=5.6 G (5.2 G, 427.6 M), priority=8, time=25969002329278881 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = f, pri = 7 Store = info, pri = -16 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = -17 Store = info, pri = -12 Store = info, pri = 3 Store = f, pri = 2 Store = f, pri = 6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 9 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -18 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -35 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -30 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -22 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -11 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = f, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = f, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 7 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = f, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 3 Store = info, pri = 6 Store = info, pri = 3 Store = info, pri = 6 Store = info, pri = 3 Store = info, pri = 6 Store = info, pri = 5 Store = info, pri = 7 Store = info, pri = 5 Store = info, pri = 7 Store = f, pri = 6 Store = info, pri = 7 Store = info, pri = 6 Store = info, pri = 7 Store = f, pri = 5 Store = info, pri = 7 Store = info, pri = 2 Store = f, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = f, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x02\xC3\xC7\x05_{211}_1461832411904,1464147901685.4a396c53225b05dbd15b009376035aec., storeName=info, fileCount=3, fileSize=5.3 G (5.1 G, 111.6 M, 3.3 M), priority=1, time=25985349786125691 Store = info, pri = 6 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x08\xA2\xB3\x07_{211}_1453950819428,1464156393953.f0402a88a45574cba3a94e0b69fe82f5., storeName=info, fileCount=15, fileSize=11.0 G (9.2 G, 443.3 M, 251.0 M, 100.1 M, 96.0 M, 260.5 M, 317.8 M, 349.4 M, 14.1 M, 7.8 M, 7.1 M, 16.8 M, 16.3 M, 16.0 M, 4.1 M), priority=1, time=25985350146650461 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x0C_\x18\x09_{211}_14589203,1463613638229.6e46dee7c2af556f79e4cb026b4d1b91., storeName=info, fileCount=8, fileSize=5.7 G (5.1 G, 441.5 M, 100.0 M, 23.4 M, 8.8 M, 8.6 M, 8.9 M, 17.3 M), priority=1, time=25985350280995547 Store = info, pri = 2 Request = regionName=frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841., storeName=info, fileCount=12, fileSize=10.3 G (9.6 G, 221.0 M, 81.5 M, 77.5 M, 315.8 M, 7.0 M, 11.0 M, 11.3 K, 8.2 M, 559.2 K, 11.5 M, 10.9 M), priority=1, time=25985350359683707 Store = info, pri = 2 Request = regionName=frog_stastic,\x12\xFEK\x07_{211}_1454004208478,1462242237753.47506762e1d475538061725aa67028e4., storeName=info, fileCount=9, fileSize=6.0 G, priority=1, time=25985350477494403 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x14Z)\x03_{311}_145425558826,1463961324008.b8d041d95b97f03c48f4fdd5e41fa6df., storeName=info, fileCount=3, fileSize=5.5 G, priority=1, time=25985350512832183 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x16:I\x06_{211}_145429195,1459647007647.31f1d91704c61e68632ba0bf323834c8., storeName=info, fileCount=9, fileSize=10.4 G, priority=1, time=25985350553030586 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x18\xA4\x93\x09_{211}_1460042214,1463182066728.c0a880e8a4e7af01d9d0d3a4e3847e86., storeName=info, fileCount=8, fileSize=5.8 G, priority=1, time=25985350609979935 Store = info, pri = 2 Request = regionName=frog_stastic,\x1By\x98\x03_{211}_1454169382954,1461805817654.3ef0c0014ed5f5f003510de3ea946cee., storeName=info, fileCount=5, fileSize=6.4 G (5.6 G, 247.4 M, 71.7 M, 86.2 M, 355.9 M), priority=1, time=25985350667862516 Store = info, pri = 2 Request = regionName=frog_stastic,\x1C"\xBE\x07_{211}_1457175189239,1464153363024.e2f79a1fd5fa55ea55a519a571f955ce., storeName=info, fileCount=14, fileSize=10.2 G, priority=1, time=25985350676668305 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,$R\xC9\x07_{211}_1454156466228,1464149621514.0db88a6716f3540f4523348169d1d0a1., storeName=info, fileCount=18, fileSize=10.7 G, priority=1, time=25985350879409726 Store = info, pri = 2 Request = regionName=frog_stastic,&\x93M\x05_{211}_1453972312986,1463613633539.4c14450ce80fb0abd25052c74947bb89., storeName=info, fileCount=53, fileSize=11.4 G (10.2 G, 414.4 M, 117.7 M, 62.0 M, 11.7 M, 10.1 M, 35.5 K, 11.6 M, 11.2 M, 13.9 M, 14.1 M, 12.2 M, 17.4 M, 24.5 M, 16.3 M, 6.9 M, 17.6 M, 22.9 M, 20.2 M, 4.9 M, 49.9 K, 10.1 K, 163.5 K, 17.8 M, 17.4 M, 5.5 M, 15.1 M, 21.1 M, 21.3 M, 9.7 M, 16.5 M, 18.9 M, 19.5 M, 19.9 M, 19.6 M, 14.6 M, 1.1 M, 13.6 M, 16.2 M, 18.8 M, 15.7 M, 450.2 K, 10.5 M, 9.9 M, 12.0 M, 12.1 M, 10.9 M, 11.1 M, 14.5 M, 17.0 M, 16.8 M, 16.1 M, 3.6 M), priority=1, time=25985350925597078 Store = info, pri = 2 Request = regionName=frog_stastic,'|\xE8\x02_{321}_14539659672,1463095091900.3204d7b48068abe67663e921f9365702., storeName=info, fileCount=9, fileSize=6.1 G (5.5 G, 223.0 M, 117.2 M, 84.7 M, 51.1 M, 66.2 M, 42.3 M, 85.2 M, 5.2 M), priority=1, time=25985350939816930 Store = info, pri = 2 Request = regionName=frog_stastic,*0N\x07_{201}_1453965307784,1463097197594.6fa2661a57b4c07b849b7b3dfbf0ea26., storeName=info, fileCount=4, fileSize=5.4 G (5.0 G, 258.8 M, 127.1 M, 48.8 M), priority=1, time=25985350981395023 Request = regionName=frog_stastic,*IB\x06_{201}_145422183596,1463965523979.2da34452406fde5041aed640095f5ce0., storeName=info, fileCount=4, fileSize=5.5 G (5.3 G, 118.3 M, 51.1 M, 4.8 M), priority=1, time=25985350983955462 Request = regionName=frog_stastic,+d\xB6\x01_211_1451784813209,1463181527394.306d71cea0e107e1f67db6e294bd7a99., storeName=info, fileCount=8, fileSize=5.9 G (5.3 G, 383.3 M, 114.5 M, 34.2 M, 43.6 M, 30.3 M, 10.9 M, 3.2 M), priority=1, time=25985351008842614 Store = info, pri = 2 Request = regionName=frog_stastic,.t\xBB\x08_{211}_1463064323505,1463875813883.460013085525c5dd1c6ec7d35e9fc4cd., storeName=info, fileCount=3, fileSize=5.4 G (5.2 G, 168.5 M, 89.0 M), priority=1, time=25985351061251890 Store = info, pri = 6 Request = regionName=frog_stastic,.\xC6\x98\x06_{211}_1453871175844,1464175433969.c6345bbab800650896c1534ef8471d9c., storeName=info, fileCount=14, fileSize=10.9 G, priority=1, time=25985351070075558 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,2R\x04\x08_{211}_1455169810048,1463872958215.0da50b1d9ce68ef4b243fddf6f677e76., storeName=info, fileCount=4, fileSize=5.6 G, priority=1, time=25985351128994510 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,4\xDC@\x08_{211}_1463321972658,1463615953964.f2e66c1bcfdf6e33ebf83c9367064817., storeName=info, fileCount=4, fileSize=5.8 G (5.2 G, 455.7 M, 85.5 M, 4.5 M), priority=1, time=25985351176367810 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,8\x1C4\x07_{211}_145967085,1462670243165.2bf4ccba0ec8fe10422cce9cd1c24bc1., storeName=info, fileCount=2, fileSize=5.5 G (5.4 G, 62.3 M), priority=1, time=25985351222783774 Store = info, pri = 2 Request = regionName=frog_stastic,9\xBB|\x02_{211}_1456581475491,1462232866133.62b75e490181e71436e6ebe3e874e5d2., storeName=info, fileCount=8, fileSize=6.6 G, priority=1, time=25985351253241023 Store = info, pri = 2 Request = regionName=frog_stastic,>|\x1E\x09_{211}_1461065667650,1463964642009.2fbe268a5b626b75ae929bbac79681c3., storeName=info, fileCount=26, fileSize=10.8 G (9.8 G, 761.7 M, 57.7 M, 9.9 M, 9.4 M, 7.8 M, 8.0 M, 24.8 K, 6.1 M, 7.7 M, 9.2 M, 19.3 M, 15.5 M, 1.1 M, 9.8 M, 9.3 M, 11.6 M, 9.3 M, 11.3 M, 1.8 M, 8.6 M, 12.2 M, 11.7 M, 10.8 M, 11.1 M, 9.9 M), priority=1, time=25985351335209164 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,D\x06e\x05_{211}_14587337894,1460377908522.2f866f9935a7587454368b06fbf38d0b., storeName=info, fileCount=5, fileSize=9.1 G (7.7 G, 613.0 M, 222.9 M, 668.9 M, 2.0 M), priority=1, time=25985351422948257 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,E\xED\xAB\x02_{311}_1455525778875,1460657584762.3418a165596e438ced91a1ec521166fc., storeName=info, fileCount=9, fileSize=7.9 G, priority=1, time=25985351454723534 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,H\xCD#\x03_{321}_1455103276258,1463009218589.01850da777b5b8af650a860a7c00efe6., storeName=info, fileCount=8, fileSize=5.9 G, priority=1, time=25985351510197494 Store = info, pri = 2 Request = regionName=frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86., storeName=info, fileCount=4, fileSize=10.1 G (9.1 G, 975.1 M, 108.0 M, 6.9 M), priority=1, time=25985351524680880 Store = info, pri = 4 Request = regionName=frog_stastic,N\xB0=\x09_{211}_1458969069852,1464048109535.e6942a79d258e051a8ac1c30698adc63., storeName=info, fileCount=21, fileSize=11.0 G, priority=1, time=25985351620623992 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,Pf0\x06_{211}_1460551667379,1463009050841.04bc7c5244b2d602486330285dab05de., storeName=info, fileCount=8, fileSize=5.7 G (4.8 G, 355.9 M, 69.3 M, 122.0 M, 107.8 M, 110.5 M, 78.1 M, 101.6 M), priority=1, time=25985351648935327 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,V5\x94\x06_211_13253770703,1463649313230.e3c7ac939720dc7a6433ce0839149c00., storeName=info, fileCount=45, fileSize=10.4 G, priority=1, time=25985351751717954 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 5 Request = regionName=frog_stastic,Z\x1F\xAD\x08_{211}_1457085067659,1463009094938.73d5713cd2e0b70944e009a48f0c147e., storeName=info, fileCount=9, fileSize=5.3 G, priority=1, time=25985351835477691 Request = regionName=frog_stastic,Z>\xFD\x04_{211}_1454126,1463961450371.419ff528d525f2e7918e55ecdb7c9507., storeName=info, fileCount=24, fileSize=5.4 G, priority=1, time=25985351839009635 Request = regionName=frog_stastic,Z_\xE3\x07_{211}_1456535196961,1462929968807.2e84c835b6064ffcb7cb8885adfc64d2., storeName=info, fileCount=9, fileSize=5.6 G (5.0 G, 234.7 M, 153.4 M, 19.2 M, 26.4 M, 82.1 M, 25.4 M, 25.4 M, 529.0 K), priority=1, time=25985351842298815 Store = info, pri = 2 Request = regionName=frog_stastic,\x5C\xB5\xCE\x07_{211}_1454226317,1464147941823.121eb032ec691120d270d2f48727b12a., storeName=info, fileCount=19, fileSize=11.0 G, priority=1, time=25985351884185096 Store = info, pri = 2 Request = regionName=frog_stastic,]\xCA\xF6\x02_211_1451825007302,1461718696652.2173f3da3a7fbcbc61665e8df79cc540., storeName=info, fileCount=9, fileSize=5.9 G, priority=1, time=25985351898968207 Store = info, pri = 2 Request = regionName=frog_stastic,`\x19\x1A\x06_{211}_14605542755,1464226103685.2e74f7d6177af5deba6f5e2d2a3c536f., storeName=info, fileCount=8, fileSize=10.3 G (9.1 G, 409.5 M, 209.1 M, 170.7 M, 106.0 M, 127.3 M, 89.8 M, 101.2 M), priority=1, time=25985351939447241 Store = info, pri = 2 Request = regionName=frog_stastic,`J3\x08_{211}_1456910191483,1463530362324.999c6cc911ae970fe1bc2481c984843d., storeName=info, fileCount=4, fileSize=5.5 G (5.0 G, 449.3 M, 121.5 M, 16.6 M), priority=1, time=25985351944825650 Request = regionName=frog_stastic,`P\xC8\x07_{211}_1457141904415,1462924103103.e39545f059dae0e3662e053e18e46853., storeName=info, fileCount=2, fileSize=5.4 G (5.4 G, 58.7 M), priority=1, time=25985351945417795 Request = regionName=frog_stastic,b\x9F\xEF\x08_{201}_145952917,1463359379319.10b5653e13490e61ccba51a21eb11aeb., storeName=info, fileCount=9, fileSize=5.7 G (5.0 G, 383.9 M, 117.7 M, 82.9 M, 23.6 M, 25.1 M, 9.3 M, 8.0 M, 3.5 M), priority=1, time=25985351990927016 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,hI\x98\x07_{211}_1453887884810,1462413263691.d68e17787b4c10e97942c9c373963d19., storeName=info, fileCount=9, fileSize=5.7 G, priority=1, time=25985352075971099 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,jQ\xB7\x05_{201}_1456314454381,1463792679573.4873db0477eca875d8b8a0a42d307b85., storeName=info, fileCount=3, fileSize=5.8 G (5.4 G, 258.7 M, 69.0 M), priority=1, time=25985352112597418 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,vn\xA6\x08_{211}_145734965005,1463527286649.80a33fce10bc74940c59ab0e189604aa., storeName=info, fileCount=3, fileSize=5.2 G (4.7 G, 401.4 M, 124.5 M), priority=1, time=25985352311775786 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,zw\x8D\x08_{201}_1457227011,1464147918329.e9a60dd7e9de5be246bcb6c61af87316., storeName=info, fileCount=23, fileSize=11.0 G (9.3 G, 1.3 G, 95.7 M, 20.1 M, 25.5 M, 27.3 M, 28.5 M, 22.5 M, 7.9 M, 31.5 K, 6.4 M, 9.8 M, 11.4 M, 11.7 M, 10.2 M, 4.1 M, 6.0 M, 13.8 M, 11.6 M, 11.0 M, 11.0 M, 11.0 M, 3.2 M), priority=1, time=25985352379277770 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,|9_\x07_{211}_14536003383,1463008949799.31a078f1d61bbdef2eb5e68332660155., storeName=info, fileCount=8, fileSize=5.9 G, priority=1, time=25985352404146504 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x86s\x10\x08_{211}_1455326432157,1462459695095.effec219dbe1eded2b5078ad5967a552., storeName=info, fileCount=4, fileSize=5.8 G, priority=1, time=25985352587576957 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x8C\xF0\xFB\x06_{211}_1455070176931,1464156211761.a0806a595c9ce8adae28a1ce6abb2d67., storeName=info, fileCount=16, fileSize=10.3 G (8.4 G, 679.8 M, 238.5 M, 243.8 M, 240.7 M, 344.0 M, 103.9 M, 26.1 M, 26.2 M, 2.3 M, 6.6 M, 12.8 M, 11.3 M, 11.0 M, 11.1 M, 8.1 M), priority=1, time=25985352703058556 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x91\xE3\x95\x00_{211}_1454652500066,1459762408613.dab74dc15ebeaa1680eca8bfce556c5a., storeName=info, fileCount=8, fileSize=7.7 G (7.1 G, 180.8 M, 104.4 M, 77.4 M, 99.6 M, 90.4 M, 31.0 M, 37.1 M), priority=1, time=25985352777984579 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x94\x8C\x89\x05_{211}_1454055279764,1463649467998.3a929f988795bc66ab59c1003c38e816., storeName=info, fileCount=3, fileSize=6.0 G (5.6 G, 485.6 M, 4.9 M), priority=1, time=25985352824276923 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x98\xBA\xB2\x07_{211}_1453944492041,1464151531550.2530974ab992de27c3b34df73a0c4ab7., storeName=info, fileCount=3, fileSize=5.2 G (5.2 G, 75.8 M, 3.2 M), priority=1, time=25985352893849401 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x9D>\xD7\x00_{211}_1456570305238,1463613461308.2ec487c7e8ea65478fd3e0eb4651b825., storeName=info, fileCount=4, fileSize=6.0 G (5.7 G, 322.2 M, 66.6 M, 6.3 M), priority=1, time=25985352979754750 Store = info, pri = 2 Request = regionName=frog_stastic,\x9E\x7F\xB0\x05_{211}_1460025716831,1463702141998.975fb5b9116ef7700047a0505186108e., storeName=info, fileCount=43, fileSize=10.7 G (9.6 G, 442.0 M, 125.0 M, 40.8 M, 11.1 M, 12.0 M, 26.6 K, 12.3 M, 10.3 M, 8.1 M, 136.0 K, 10.8 K, 161.5 K, 18.0 M, 17.8 M, 3.4 M, 15.5 M, 18.8 M, 19.8 M, 15.8 M, 3.5 M, 15.9 M, 15.1 M, 18.3 M, 19.1 M, 16.7 M, 15.1 M, 2.3 M, 13.9 M, 17.1 M, 18.1 M, 11.3 M, 9.8 M, 9.9 M, 12.7 M, 3.9 M, 11.1 M, 9.9 M, 14.7 M, 16.8 M, 17.5 M, 16.0 M, 3.4 M), priority=1, time=25985352996833576 Request = regionName=frog_stastic,\x9E\xE1"\x08_{211}_1455505168111,1463444620140.7135b768eb2d69128c82476b8bb826ad., storeName=info, fileCount=4, fileSize=5.3 G, priority=1, time=25985353005715587 Request = regionName=frog_stastic,\x9F\xEF\xAB\x02_{311}_1454203051436,1460959214471.27dd14df66c0cc0e25ce5f8d5ff545e5., storeName=info, fileCount=9, fileSize=7.3 G (6.4 G, 423.5 M, 244.4 M, 74.9 M, 48.6 M, 67.4 M, 11.2 M, 10.1 M, 3.4 M), priority=1, time=25985353017975663 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xA0\x93\xD1\x05_{211}_1459437876185,1462501769552.6024687ebc600a1a0c3f78c2a1faa2c4., storeName=info, fileCount=3, fileSize=5.6 G, priority=1, time=25985353033630407 Store = cf, pri = 2 Request = regionName=frog_stastic,\xA2\xD2\x97\x08_{211}_1456639408260,1462579974134.c465b46858c98687881bdb4dbacb1621., storeName=info, fileCount=3, fileSize=5.8 G, priority=1, time=25985353073096628 Request = regionName=frog_stastic,\xA2\xE0*\x08_{211}_1455587431819,1462750384354.6c2eafc0282791dc56a3c5630de8c6a6., storeName=info, fileCount=4, fileSize=5.9 G (5.3 G, 425.7 M, 124.2 M, 52.7 M), priority=1, time=25985353074275198 Request = regionName=frog_stastic,\xA4\x92m\x03_{111}_1462113770578,1462923416951.8e68a829132244b5d8de4a66aa82deef., storeName=info, fileCount=4, fileSize=5.7 G (5.0 G, 591.9 M, 58.1 M, 7.7 M), priority=1, time=25985353102205879 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xAC\xD9l\x08_{211}_1456460628782,1464155651888.1b9b0f4d55df88bf633290183df94e4a., storeName=info, fileCount=16, fileSize=11.0 G (9.6 G, 592.0 M, 144.3 M, 140.9 M, 105.6 M, 125.5 M, 100.6 M, 66.9 M, 39.0 M, 2.8 M, 52.1 K, 14.2 M, 16.4 M, 16.7 M, 16.3 M, 907.8 K), priority=1, time=25985353235923674 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xB2K\xAD\x09_{211}_1461626266440,1463183253871.39b608a722c174c0a452182ed7315fbd., storeName=info, fileCount=4, fileSize=5.5 G (5.0 G, 441.1 M, 97.4 M, 349.5 K), priority=1, time=25985353318743436 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xBA\x9E-\x09_{211}_14586311136,1463009483042.f2fbad8cd5558d7007da767ef14f346c., storeName=info, fileCount=2, fileSize=5.5 G (5.4 G, 80.6 M), priority=1, time=25985353465253499 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xBD\x07\xC8\x02_111_1453711255140,1460962480333.a8063670d32bc8183f5e7c0932617574., storeName=info, fileCount=9, fileSize=7.4 G (6.4 G, 435.7 M, 41.6 M, 65.8 M, 110.8 M, 258.6 M, 60.7 M, 54.0 M, 3.6 M), priority=1, time=25985353510885028 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xC0>\x09\x08_{211}_1455505286698,1463269707002.2cae5e5c53964a7c94cbf7837f595f9e., storeName=info, fileCount=9, fileSize=5.6 G, priority=1, time=25985353559642053 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xC8\x1E\xCD\x04_{211}_145390843471,1463099569745.92f9076b0c7a3fede1914dcae9841240., storeName=info, fileCount=8, fileSize=5.4 G (4.6 G, 422.8 M, 75.0 M, 66.4 M, 29.1 M, 55.9 M, 90.0 M, 71.9 M), priority=1, time=25985353781851158 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xCA\xEBu\x06_{201}_1454480275015,1463649495569.d8a72685083c375c6225e08515143123., storeName=info, fileCount=4, fileSize=4.9 G (4.5 G, 338.3 M, 57.4 M, 5.4 M), priority=1, time=25985353840097638 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xCFR\xFE\x02_{111}_1454938743156,1462063046869.99a6851c8721ca2e4732a9c141b16983., storeName=info, fileCount=8, fileSize=5.9 G (5.3 G, 355.3 M, 69.0 M, 78.4 M, 44.7 M, 65.3 M, 10.3 M, 4.6 M), priority=1, time=25985353902892680 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Request = regionName=frog_stastic,\xD6-\xFC\x06_{211}_1457172314914,1463703469772.5a0661f434a04cad5455d765c6dc5eb5., storeName=info, fileCount=4, fileSize=5.4 G (5.0 G, 289.7 M, 87.5 M, 5.1 M), priority=1, time=25985354007769420 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xD8\xEC)\x03_{111}_1454751090639,1464226110243.85e1dea255faf897d7c7cb58ba0552ac., storeName=info, fileCount=8, fileSize=10.7 G, priority=1, time=25985354059548074 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Request = regionName=frog_stastic,\xDD\xA2\xC1\x01_111_1451633775444,1461492234656.b343bfecdb338731dd34263a1667bdd7., storeName=info, fileCount=7, fileSize=6.4 G (5.6 G, 417.0 M, 396.4 M, 8.9 M, 10.5 M, 10.4 M, 1.8 M), priority=1, time=25985354141774282 Store = info, pri = 2 Request = regionName=frog_stastic,\xDE\xD83\x03_{311}_1455068903014,1462666863547.3f5ba804aed1a5a9eb417737eab6534f., storeName=info, fileCount=8, fileSize=5.6 G (5.1 G, 400.0 M, 63.2 M, 15.8 M, 25.6 M, 18.5 M, 20.6 M, 51.4 M), priority=1, time=25985354163654674 Request = regionName=frog_stastic,\xDE\xDE\xC7\x04_{211}_1462110015838,1462666863547.d2e61edd46745fa17162024d61721f1a., storeName=info, fileCount=9, fileSize=5.7 G, priority=1, time=25985354164180496 Request = regionName=frog_stastic,\xE0Z\xBD\x07_{211}_1455264004259,1463441328092.de0c8f671755c7cccf1ef79316365aee., storeName=info, fileCount=4, fileSize=5.6 G (5.0 G, 522.8 M, 57.6 M, 7.4 M), priority=1, time=25985354184551603 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xE2\x14\xBD\x08_{211}_1459839415,1463272441069.70dcc0821a5b105d554ab0602171460e., storeName=info, fileCount=8, fileSize=5.2 G (4.5 G, 427.8 M, 124.9 M, 83.3 M, 22.5 M, 8.2 M, 9.3 M, 19.8 M), priority=1, time=25985354219227568 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xE4|h\x05_{211}_1461848478285,1463878207743.1aa3956d5c127e3f893d93ae8acb036b., storeName=info, fileCount=32, fileSize=10.5 G, priority=1, time=25985354261034332 Store = info, pri = 2 Request = regionName=frog_stastic,\xEC'3\x08_{211}_1457234203546,1462924104120.d9a644e2b82c8bc59042fcbe086343e0., storeName=info, fileCount=9, fileSize=5.4 G (4.6 G, 224.2 M, 232.9 M, 122.8 M, 55.7 M, 22.7 M, 53.4 M, 41.7 M, 293.9 K), priority=1, time=25985354375137648 Store = info, pri = 2 Request = regionName=frog_stastic,\xEDQ\x8D\x01_{311}_1454162392399,1463181602855.79a355bce75420d1c952cf3bf57ced43., storeName=info, fileCount=9, fileSize=5.9 G (5.2 G, 409.9 M, 102.8 M, 21.7 M, 28.3 M, 15.7 M, 27.1 M, 40.5 M, 6.8 M), priority=1, time=25985354398327106 Store = info, pri = 2 Request = regionName=frog_stastic,\xEE1\x0E\x07_211_145375934,1462925442043.c23bcfac7f619afba8479d2810aed6d4., storeName=info, fileCount=8, fileSize=5.8 G (4.8 G, 388.5 M, 160.2 M, 63.1 M, 207.6 M, 117.4 M, 55.7 M, 23.5 M), priority=1, time=25985354408441007 Request = regionName=frog_stastic,\xEE\xA9\x8A\x07_{211}_145650302546,1463270019723.c3342f64f111fac026ad494db2835387., storeName=info, fileCount=3, fileSize=5.6 G (5.2 G, 363.9 M, 2.5 M), priority=1, time=25985354424373217 Request = regionName=frog_stastic,\xEE\xB6\x9F\x07_{211}_1453607674466,1462242686154.1726f10b6e035ae2bf47e7282772c132., storeName=info, fileCount=9, fileSize=6.1 G, priority=1, time=25985354425451886 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xF3`\xC2\x02_{211}_1458476871924,1462460973380.7af3ad2aa54d23f6a60ab84c2ef59f98., storeName=info, fileCount=3, fileSize=5.5 G (5.4 G, 73.0 M, 3.9 M), priority=1, time=25985354498385494 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xF8\xA1d\x08_{211}_1456450013,1463269334000.622b859fde0c8f80782cc367fd1ea576., storeName=info, fileCount=8, fileSize=5.1 G, priority=1, time=25985354581358856 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xFA|\xAA\x06_{211}_1463058019507,1463615192083.451cd37e91da7efa95715becc8d8187c., storeName=info, fileCount=53, fileSize=10.6 G (9.4 G, 387.9 M, 192.6 M, 30.7 M, 11.8 M, 67.6 K, 13.3 M, 13.7 M, 9.9 M, 2.4 M, 9.9 M, 23.0 M, 17.2 M, 8.3 M, 11.5 M, 22.0 M, 18.5 M, 9.0 M, 148.9 K, 9.1 K, 154.6 K, 14.9 M, 18.9 M, 4.9 M, 15.2 M, 18.0 M, 18.9 M, 13.6 M, 13.6 M, 12.3 M, 15.4 M, 16.1 M, 16.2 M, 16.6 M, 13.7 M, 11.8 M, 14.5 M, 13.5 M, 16.2 M, 14.2 M, 4.5 M, 9.2 M, 8.6 M, 10.5 M, 11.2 M, 6.5 M, 11.0 M, 8.2 M, 14.2 M, 16.7 M, 16.7 M, 16.2 M, 2.1 M), priority=1, time=25985354608076464 Store = info, pri = 2 Request = regionName=frog_stastic,\xFB\xD1:\x04_{211}_14576700772,1461285010993.11ca2f9848f63571470a3fa0c2e64db8., storeName=info, fileCount=8, fileSize=6.2 G, priority=1, time=25985354625746497 Request = regionName=frog_stastic,\xFD\x14]\x00_{211}_1455086102,1463014312682.e4c1f4975ff8c536062de25b61d0fd50., storeName=info, fileCount=8, fileSize=6.3 G (6.0 G, 123.5 M, 93.8 M, 19.8 M, 29.8 M, 17.8 M, 32.7 M, 48.9 M), priority=1, time=25985354649855708 Request = regionName=frog_stastic,\xFE"\x7F\x06_{211}_145803562,1462754127743.d8ce5bec176c148d377cf029282f275f., storeName=info, fileCount=3, fileSize=5.5 G (5.4 G, 57.5 M, 3.5 M), priority=1, time=25985354659208299 Store = info, pri = 2 Store = info, pri = 2 Store = f, pri = 2 Store = f, pri = 3 Store = f, pri = 3 Store = cf, pri = 2 Store = cf, pri = 3 Store = f, pri = 2 Store = f, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = 2 Store = info, pri = -23 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Request = regionName=image_ocr,\x01Q\x8C\x9E\x89\x93,1450000373968.61e4dbf820e913b99acc87e0baf3f9fd., storeName=f, fileCount=2, fileSize=2.7 G (2.7 G, 9.3 K), priority=8, time=25999003021349575 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = cf, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x02j\xB0\x04_211_1451808774587,1463702142309.3177c7a6ef0fb63f7fafaa71432ef184., storeName=info, fileCount=2, fileSize=5.5 G (5.1 G, 420.9 M), priority=8, time=26009002564605008 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 5 Store = cf, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = cf, pri = 5 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = -2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -30 Store = info, pri = 5 Store = info, pri = -5 Store = info, pri = 3 Store = info, pri = -8 Store = info, pri = 3 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 7 Store = info, pri = 3 Store = info, pri = 3 Store = info, pri = 2 Store = f, pri = 6 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 7 Store = f, pri = 3 Store = info, pri = 3 Store = 0, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 7 Store = info, pri = 3 Store = info, pri = 4 Store = info, pri = 2 Store = f, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = f, pri = 6 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 5 Store = info, pri = 2 Store = f, pri = 4 Store = info, pri = -24 Store = info, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = url, pri = -47 Store = info, pri = 6 Store = info, pri = 2 Store = info, pri = 3 Store = cf, pri = -38 Store = info, pri = 7 Store = info, pri = -2 Store = info, pri = 2 Store = cf, pri = -40 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -29 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = -43 Store = info, pri = 7 Store = cf, pri = 2 Store = info, pri = 4 Store = cf, pri = -45 Store = f, pri = 2 Store = cf, pri = -26 Store = info, pri = -9 Store = cf, pri = -27 Request = regionName=frog_stastic,\xDA\xBE\xBE\x04_{211}_1455284918285,1463527407489.e1b017ac9c5af830243de79465e4c8ee., storeName=info, fileCount=2, fileSize=5.0 G (4.6 G, 466.5 M), priority=8, time=25939002308835995 Store = info, pri = -10 Store = info, pri = 2 Store = cf, pri = -28 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = -22 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = -7 Store = info, pri = -26 Store = info, pri = -29 Store = cf, pri = 7 Store = info, pri = -20 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = -9 Store = info, pri = -20 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -17 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = -4 Store = info, pri = -1 Store = info, pri = -3 Store = info, pri = 3 Store = info, pri = -1 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -2 Store = info, pri = 2 Store = info, pri = -20 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = -4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -12 Store = info, pri = -18 Store = info, pri = 2 Store = info, pri = -8 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 3 Store = info, pri = 2 Store = cf, pri = 2 Store = cf, pri = 2 Store = cf, pri = 6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -1 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -9 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = cf, pri = 5 Store = info, pri = 2 Store = cf, pri = 5 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -3 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = -10 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x18\xB1\x9D\x04_{211}_145979887,1463098895475.03fb06c0180ddf6e58eea90d7bba47f2., storeName=info, fileCount=8, fileSize=5.7 G (4.8 G, 367.4 M, 47.8 M, 95.2 M, 104.2 M, 87.8 M, 222.1 M, 15.9 M), priority=1, time=26069587535316679 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,0\xC4\xC9\x06_{211}_1453536186374,1463575371362.29372ea71ba21ac36363b3c90f7c23dc., storeName=info, fileCount=8, fileSize=5.5 G (4.9 G, 233.9 M, 95.9 M, 47.7 M, 23.7 M, 46.5 M, 59.6 M, 109.1 M), priority=1, time=26069589037155007 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,;Z\x8F\x02_311_1453775924077,1462753689704.9462ccb98ada23930d850bdea7b50b3f., storeName=info, fileCount=8, fileSize=5.2 G, priority=1, time=26069589501792900 Store = info, pri = 3 Store = info, pri = 2 Store = info, pri = 3 Request = regionName=frog_stastic,D\xE4\x9F\x09_{211}_1262603533740,1464241839063.7bf57f3a5cef204805985af519de15cd., storeName=info, fileCount=14, fileSize=10.4 G, priority=1, time=26069589858890283 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,W\xC5c\x02_{111}_1455638162072,1457666068293.5ff823f725c1c6a978622cdb4f7afccf., storeName=info, fileCount=9, fileSize=6.4 G (5.7 G, 123.9 M, 99.7 M, 86.6 M, 301.1 M, 93.0 M, 62.3 M, 6.6 M, 1.7 M), priority=1, time=26069590475931917 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,j\x17\x0E\x05_{211}_1460278127544,1463096262252.0b74bac4ed64e5d5ecf704da7dad172f., storeName=info, fileCount=3, fileSize=5.7 G (5.3 G, 404.8 M, 2.4 M), priority=1, time=26069591065698218 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,y{\x9A\x02_311_1453730571122,1463654425515.0cda0d590fa95524069d1e0fac276e52., storeName=info, fileCount=4, fileSize=5.5 G (5.2 G, 223.2 M, 100.2 M, 6.3 M), priority=1, time=26069591548832520 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\x96\xE0\xD7\x07_{211}_14543775405,1463097626423.457389d38704952cf68cf9fbafceec95., storeName=info, fileCount=9, fileSize=5.7 G (4.7 G, 413.7 M, 114.3 M, 47.6 M, 80.0 M, 240.4 M, 23.5 M, 19.9 M, 924.8 K), priority=1, time=26069592502436312 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xAB\x1E\xF3\x02_{211}_14544114121,1461478862554.06a7a02c576e30d9b61e94e141f3b8e0., storeName=info, fileCount=9, fileSize=6.4 G, priority=1, time=26069593081820712 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xC0\xB1\x85\x07_{211}_1457261967821,1464154211354.4c30f6cf6c7bfa512b1163408788da3e., storeName=info, fileCount=23, fileSize=10.7 G, priority=1, time=26069593715384561 Store = info, pri = 2 Store = f, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xD8\x99\x9E\x08_{211}_1457516913068,1464147979941.1975b5f7fb6b3ed6fe4961533949e0f5., storeName=info, fileCount=4, fileSize=5.4 G (5.3 G, 107.6 M, 35.7 M, 931.3 K), priority=1, time=26069594358484186 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Request = regionName=frog_stastic,\xF7\xF0\xD9\x03_211_1453727557726,1462231912351.96fdb2656ab5606f0d06cc8d2076c926., storeName=info, fileCount=4, fileSize=6.1 G (5.9 G, 184.5 M, 6.7 M, 2.0 M), priority=1, time=26069595228388170 Store = info, pri = 2 Request = regionName=frog_stastic,\xFC\xD3\x9E\x08_{211}_1458359018560,1463962462339.0ca8804b7f489f0f2ebaddb529967de0., storeName=info, fileCount=35, fileSize=10.6 G (9.0 G, 763.0 M, 410.9 M, 51.4 M, 21.1 M, 26.7 M, 27.1 M, 27.9 M, 9.9 M, 5.8 M, 12.6 K, 18.9 M, 16.0 M, 13.8 M, 13.7 M, 15.7 M, 17.1 M, 14.7 M, 9.8 M, 9.7 M, 11.5 M, 6.6 M, 10.3 M, 13.9 M, 156.1 K, 12.2 M, 12.3 M, 14.1 M, 14.3 M, 6.4 M, 14.1 M, 16.3 M, 13.7 M, 13.6 M, 3.6 M), priority=1, time=26069595378032535 Request = regionName=image_ocr,\x01R\x8D`iv,1454465628305.fd127776eace622ffbff859009527d12., storeName=f, fileCount=2, fileSize=3.6 G (3.6 G, 5.6 K), priority=8, time=26079003235332917 SmallCompation Queue: Store = cf, pri = -48 Store = info, pri = -42 Store = info, pri = -19 Store = info, pri = -10 Store = cf, pri = -30 Store = info, pri = -10 Store = info, pri = -19 Store = info, pri = -5 Store = info, pri = -5 Store = info, pri = -9 Store = info, pri = -19 Store = info, pri = -9 Store = info, pri = 0 Store = info, pri = -9 Store = info, pri = -9 Request = regionName=frog_stastic,\xC0K\x04\x08_{211}_1455327960876,1458862320780.b710d6ba7aef8054fe90dae5be8382f8., storeName=info, fileCount=3, fileSize=29.5 M (9.7 M, 6.7 M, 13.1 M), priority=1, time=26069593700859583 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = 0 Store = info, pri = -9 Store = info, pri = 2 Store = info, pri = -9 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 7 Store = cf, pri = 4 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 6 Store = info, pri = 2 Store = 0, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 0 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 2 Store = cf, pri = 2 Store = info, pri = 5 Store = cf, pri = 2 Store = cf, pri = 4 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 6 Store = info, pri = 2 Store = cf, pri = 5 Store = content, pri = 7 Store = LiveQOS, pri = 7 Store = info, pri = 6 Store = info, pri = 5 Store = cf, pri = 7 Store = cf, pri = 2 Store = cf, pri = 7 Store = LiveQOS, pri = 7 Store = LiveQOS, pri = 7 Store = cf, pri = 7 Store = info, pri = 7 Store = info, pri = 2 Store = info, pri = 5 Store = info, pri = 4 Store = info, pri = 6 Store = info, pri = 5 Store = cf, pri = 7 Store = content, pri = 7 Store = info, pri = 5 Request = regionName=frog_stastic,\xC0K\x04\x08_{211}_1455327960876,1458862320780.b710d6ba7aef8054fe90dae5be8382f8., storeName=info, fileCount=7, fileSize=102.0 M (14.1 M, 14.2 M, 16.8 M, 16.5 M, 14.0 M, 13.4 M, 13.1 M), priority=1, time=26069860488855357 Store = info, pri = 6 Store = info, pri = 2 Store = cf, pri = 7 Store = info, pri = 5 Store = info, pri = 5 Store = info, pri = 5 Store = info, pri = 6 Store = cf, pri = 5 Store = cf, pri = 7 Store = info, pri = 5 Store = cf, pri = 6 Store = info, pri = 6 Store = info, pri = 2 Store = info, pri = 2 Store = info, pri = 4 Store = info, pri = 4 Store = info, pri = 6 Store = info, pri = 4 Store = cf, pri = 5 Store = info, pri = 5 Store = info, pri = 6 Store = info, pri = 5 Store = info, pri = 6 Store = cf, pri = 7 Store = content, pri = 7 Store = info, pri = 7 Store = content, pri = 7 Split Queue: Region Merge Queue: Flush Queue summary: flush_queue=6 Flush Queue Queue dump: Flush Queue: [flush region frog_stastic,\xEC`\xC8\x06_{211}_1454037954068,1463787581032.880c742d0f89390557d90f44e8890e4a.] [flush region frog_stastic,J\x08\x7F\x04_{211}_1455521065789,1460472441110.d13dc38891b807c97bfc2cab7fa60f86.] [flush region ape_profile:student_keypoint_7day,Sz\xB7\x01\x00\x00\x00J20160429\x00\x0B\xBC\xB7,1462994414228.06f17e0fe577e3cca272af449c3dc455.] [flush region ape_profile:student_keypoint_7day,\xB2:~\x03\x00\x00\x00I\x00\x0B\x9A%20160413,1462994351971.81194e359707acadee2906ffe36ab130.] [flush region frog_stastic,\x0F<\x80\x00_211_1453625257737,1464218845975.56a21606788d0eeff0b268b0bb670841.] [flush region frog_stastic,\x81n\x8D\x00_{311}_1455203248372,1461067416754.248e5726c8fdd029c61433c7f291eed3.]