2018-05-24 15:24:48,124 DEBUG [main] hbase.HBaseTestingUtility(344): Setting hbase.rootdir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a 2018-05-24 15:24:48,147 INFO [main] hbase.HBaseTestingUtility(456): System.getProperty("hadoop.log.dir") already set to: /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop-log-dir so I do NOT create it in target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8 2018-05-24 15:24:48,147 WARN [main] hbase.HBaseTestingUtility(460): hadoop.log.dir property value differs in configuration and system: Configuration=/home/zhangduo/hbase/code/hbase-server/../logs while System=/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop-log-dir Erasing configuration value by system value. 2018-05-24 15:24:48,148 INFO [main] hbase.HBaseTestingUtility(456): System.getProperty("hadoop.tmp.dir") already set to: /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop-tmp-dir so I do NOT create it in target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8 2018-05-24 15:24:48,148 WARN [main] hbase.HBaseTestingUtility(460): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-zhangduo while System=/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop-tmp-dir Erasing configuration value by system value. 2018-05-24 15:24:48,149 DEBUG [main] hbase.HBaseTestingUtility(344): Setting hbase.rootdir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8 2018-05-24 15:24:48,164 INFO [Time-limited test] hbase.HBaseZKTestingUtility(86): Created new mini-cluster data directory: /home/zhangduo/hbase/code/hbase-server/target/test-data/beed6418-e48c-46bf-be34-417a9436d9c8/cluster_788354ac-d6f1-4a7d-8536-bba882fdb84e, deleteOnExit=true 2018-05-24 15:24:48,256 ERROR [Time-limited test] server.ZooKeeperServer(472): ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 2018-05-24 15:24:48,266 INFO [Time-limited test] zookeeper.MiniZooKeeperCluster(281): Started MiniZooKeeperCluster and ran successful 'stat' on client port=59029 2018-05-24 15:24:48,267 INFO [Time-limited test] hbase.HBaseTestingUtility(954): Starting up minicluster with 1 master(s) and 3 regionserver(s) and 3 datanode(s) 2018-05-24 15:24:48,267 INFO [Time-limited test] hbase.HBaseZKTestingUtility(86): Created new mini-cluster data directory: /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d, deleteOnExit=true 2018-05-24 15:24:48,267 INFO [Time-limited test] hbase.HBaseTestingUtility(969): STARTING DFS 2018-05-24 15:24:48,268 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting test.cache.data to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cache_data in system properties and HBase conf 2018-05-24 15:24:48,268 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting hadoop.tmp.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop_tmp in system properties and HBase conf 2018-05-24 15:24:48,268 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting hadoop.log.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/hadoop_logs in system properties and HBase conf 2018-05-24 15:24:48,268 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting mapreduce.cluster.local.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/mapred_local in system properties and HBase conf 2018-05-24 15:24:48,270 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting mapreduce.cluster.temp.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/mapred_temp in system properties and HBase conf 2018-05-24 15:24:48,270 INFO [Time-limited test] hbase.HBaseTestingUtility(737): read short circuit is OFF 2018-05-24 15:24:48,351 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2018-05-24 15:24:48,640 DEBUG [Time-limited test] fs.HFileSystem(317): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2018-05-24 15:24:49,399 WARN [Time-limited test] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2018-05-24 15:24:49,524 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2018-05-24 15:24:49,582 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:49,606 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_42269_hdfs____.f0lrfj/webapp 2018-05-24 15:24:49,804 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:760) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:639) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:819) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:803) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1500) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1115) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:986) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:815) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:103) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:49,820 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42269 2018-05-24 15:24:50,323 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:50,328 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_37249_datanode____.okbx3a/webapp 2018-05-24 15:24:50,465 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:103) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:50,466 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37249 2018-05-24 15:24:50,695 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:50,708 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_45073_datanode____.v4onfy/webapp 2018-05-24 15:24:50,904 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:103) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:50,910 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45073 2018-05-24 15:24:50,954 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:50,972 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_39161_datanode____qqsfot/webapp 2018-05-24 15:24:51,161 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:41639] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:51,170 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:41639] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:51,177 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:103) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:51,189 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39161 2018-05-24 15:24:51,239 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb929c1a3a: from storage DS-65746aac-e5e4-4474-b835-d3d17c2bfc20 node DatanodeRegistration(127.0.0.1:40385, datanodeUuid=8678fa9b-2fa8-4b26-9691-42c75c7ec67c, infoPort=42649, infoSecurePort=0, ipcPort=34557, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs 2018-05-24 15:24:51,239 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb929c1b8d: from storage DS-2a788e78-421e-43b8-b8a8-c19fa49f729a node DatanodeRegistration(127.0.0.1:34749, datanodeUuid=07d13644-69cc-4676-aa76-1b28cca0517a, infoPort=46271, infoSecurePort=0, ipcPort=44601, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs 2018-05-24 15:24:51,239 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb929c1a3a: from storage DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd node DatanodeRegistration(127.0.0.1:40385, datanodeUuid=8678fa9b-2fa8-4b26-9691-42c75c7ec67c, infoPort=42649, infoSecurePort=0, ipcPort=34557, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:51,239 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb929c1b8d: from storage DS-08830373-3d87-445b-b412-c1b527de7a64 node DatanodeRegistration(127.0.0.1:34749, datanodeUuid=07d13644-69cc-4676-aa76-1b28cca0517a, infoPort=46271, infoSecurePort=0, ipcPort=44601, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:51,325 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:41639] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:51,333 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb98ba896e: from storage DS-77a0454e-e42a-47c6-abf9-5d05341de1b8 node DatanodeRegistration(127.0.0.1:45859, datanodeUuid=a1f333d7-dd6a-42f5-89c1-4bdd87d38d9e, infoPort=40521, infoSecurePort=0, ipcPort=44391, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs 2018-05-24 15:24:51,334 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cb98ba896e: from storage DS-e0952bf6-c8a5-4968-a264-e4885ae83da0 node DatanodeRegistration(127.0.0.1:45859, datanodeUuid=a1f333d7-dd6a-42f5-89c1-4bdd87d38d9e, infoPort=40521, infoSecurePort=0, ipcPort=44391, storageInfo=lv=-56;cid=testClusterID;nsid=891091178;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:51,534 DEBUG [Time-limited test] hbase.HBaseTestingUtility(672): Setting hbase.rootdir to /home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a 2018-05-24 15:24:51,542 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:51,544 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:51,806 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 7 2018-05-24 15:24:51,806 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741825_1001 size 7 2018-05-24 15:24:51,807 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741825_1001 size 7 2018-05-24 15:24:52,216 INFO [Time-limited test] util.FSUtils(515): Created version file at hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77 with version=8 2018-05-24 15:24:52,216 INFO [Time-limited test] hbase.HBaseTestingUtility(1213): Setting hbase.fs.tmp.dir to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/hbase-staging 2018-05-24 15:24:52,375 INFO [Time-limited test] metrics.MetricRegistriesLoader(66): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-24 15:24:52,633 INFO [Time-limited test] client.ConnectionUtils(122): master/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:52,647 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:52,648 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:52,648 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:52,735 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:52,867 DEBUG [Time-limited test] util.ClassSize(229): Using Unsafe to estimate memory layout 2018-05-24 15:24:52,927 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:46811 2018-05-24 15:24:52,936 INFO [Time-limited test] hfile.CacheConfig(553): Allocating onheap LruBlockCache size=707.60 MB, blockSize=64 KB 2018-05-24 15:24:52,942 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:52,943 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:52,946 DEBUG [Time-limited test] mob.MobFileCache(123): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-24 15:24:52,947 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:52,949 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:52,987 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=master:46811 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:53,017 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:468110x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:53,018 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): master:46811-0x16391092ecc0000 connected 2018-05-24 15:24:53,047 DEBUG [Time-limited test] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/master 2018-05-24 15:24:53,048 DEBUG [Time-limited test] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:24:53,056 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46811 2018-05-24 15:24:53,058 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=46811 2018-05-24 15:24:53,058 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46811 2018-05-24 15:24:53,063 INFO [Time-limited test] master.HMaster(496): hbase.rootdir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77, hbase.cluster.distributed=false 2018-05-24 15:24:53,146 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:53,146 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:53,147 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:53,147 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:53,150 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:53,151 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:53,153 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:46367 2018-05-24 15:24:53,154 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,155 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,156 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,160 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,162 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:46367 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:53,170 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:463670x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:53,171 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:463670x0, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/master 2018-05-24 15:24:53,171 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:46367-0x16391092ecc0001 connected 2018-05-24 15:24:53,172 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:24:53,181 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46367 2018-05-24 15:24:53,185 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=46367 2018-05-24 15:24:53,190 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46367 2018-05-24 15:24:53,213 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:53,213 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:53,213 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:53,214 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:53,214 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:53,214 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:53,218 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:38897 2018-05-24 15:24:53,219 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,220 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,222 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,226 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,229 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:38897 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:53,241 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:388970x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:53,242 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:38897-0x16391092ecc0002 connected 2018-05-24 15:24:53,242 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/master 2018-05-24 15:24:53,243 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:24:53,248 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38897 2018-05-24 15:24:53,257 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=38897 2018-05-24 15:24:53,261 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38897 2018-05-24 15:24:53,280 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:53,280 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:53,280 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:53,280 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:53,281 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:53,281 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:53,283 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:39191 2018-05-24 15:24:53,284 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,284 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,286 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,287 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,289 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:39191 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:53,300 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:391910x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:53,301 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:39191-0x16391092ecc0003 connected 2018-05-24 15:24:53,301 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/master 2018-05-24 15:24:53,302 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:24:53,308 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39191 2018-05-24 15:24:53,317 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=39191 2018-05-24 15:24:53,321 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39191 2018-05-24 15:24:53,328 INFO [Thread-157] master.HMaster(2034): Adding backup master ZNode /cluster1/backup-masters/zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,335 DEBUG [Thread-157] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/backup-masters/zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,358 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/master 2018-05-24 15:24:53,358 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/master 2018-05-24 15:24:53,360 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/master 2018-05-24 15:24:53,361 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/master 2018-05-24 15:24:53,362 DEBUG [Thread-157] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/master 2018-05-24 15:24:53,363 INFO [Thread-157] master.ActiveMasterManager(172): Deleting ZNode for /cluster1/backup-masters/zhangduo-ubuntu,46811,1527146692264 from backup master directory 2018-05-24 15:24:53,368 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/master 2018-05-24 15:24:53,368 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/backup-masters/zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,369 WARN [Thread-157] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:53,369 INFO [Thread-157] master.ActiveMasterManager(181): Registered as active master=zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,376 INFO [Thread-157] regionserver.ChunkCreator(498): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 318, initial count 0 2018-05-24 15:24:53,378 INFO [Thread-157] regionserver.ChunkCreator(498): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 353, initial count 0 2018-05-24 15:24:53,458 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:24:53,463 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:24:53,471 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|FINALIZED], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:24:53,474 DEBUG [Thread-157] util.FSUtils(667): Created cluster ID file at hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/hbase.id with ID: 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:24:53,503 INFO [Thread-157] master.MasterFileSystem(393): BOOTSTRAP: creating hbase:meta region 2018-05-24 15:24:53,507 INFO [Thread-157] regionserver.HRegion(6928): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'false', BLOCKSIZE => '8192'}, {NAME => 'rep_barrier', VERSIONS => '2147483647', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'table', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77 Table name == hbase:meta 2018-05-24 15:24:53,545 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|FINALIZED]]} size 0 2018-05-24 15:24:53,545 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|FINALIZED], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:24:53,548 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741827_1003 size 32 2018-05-24 15:24:53,551 DEBUG [Thread-157] regionserver.HRegion(828): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:24:53,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info 2018-05-24 15:24:53,603 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:53,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:53,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:24:53,629 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,630 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:53,631 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:53,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table 2018-05-24 15:24:53,636 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:53,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:53,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:53,644 DEBUG [Thread-157] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740 2018-05-24 15:24:53,658 DEBUG [Thread-157] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7M)) instead. 2018-05-24 15:24:53,665 DEBUG [Thread-157] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:24:53,665 INFO [Thread-157] regionserver.HRegion(976): Opened 1588230740; next sequenceid=2 2018-05-24 15:24:53,665 DEBUG [Thread-157] regionserver.HRegion(1515): Closing 1588230740, disabling compactions & flushes 2018-05-24 15:24:53,665 DEBUG [Thread-157] regionserver.HRegion(1555): Updates disabled for region hbase:meta,,1.1588230740 2018-05-24 15:24:53,666 INFO [Thread-157] regionserver.HRegion(1669): Closed hbase:meta,,1.1588230740 2018-05-24 15:24:53,701 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|FINALIZED]]} size 0 2018-05-24 15:24:53,701 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|FINALIZED]]} size 0 2018-05-24 15:24:53,705 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|FINALIZED]]} size 0 2018-05-24 15:24:53,709 DEBUG [Thread-157] util.FSTableDescriptors(683): Wrote into hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2018-05-24 15:24:53,742 INFO [Thread-157] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:53,753 INFO [Thread-157] coordination.ZKSplitLogManagerCoordination(492): Found 0 orphan tasks and 0 rescan nodes 2018-05-24 15:24:53,776 INFO [Thread-157] zookeeper.ReadOnlyZKClient(139): Connect 0x6b3915ea to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:53,800 DEBUG [Thread-157] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3175a5ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:53,825 INFO [Thread-157] balancer.BaseLoadBalancer(1039): slop=0.001, tablesOnMaster=false, systemTablesOnMaster=false 2018-05-24 15:24:53,830 INFO [Thread-157] balancer.StochasticLoadBalancer(214): Loaded config; maxSteps=1000000, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, etc. 2018-05-24 15:24:53,845 DEBUG [Thread-157] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/balancer 2018-05-24 15:24:53,846 DEBUG [Thread-157] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/normalizer 2018-05-24 15:24:53,851 DEBUG [Thread-157] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/switch/split 2018-05-24 15:24:53,852 DEBUG [Thread-157] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/switch/merge 2018-05-24 15:24:53,888 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/running 2018-05-24 15:24:53,889 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/running 2018-05-24 15:24:53,889 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/running 2018-05-24 15:24:53,889 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/running 2018-05-24 15:24:53,890 INFO [Thread-157] master.HMaster(787): Active/primary master=zhangduo-ubuntu,46811,1527146692264, sessionid=0x16391092ecc0000, setting cluster-up flag (Was=false) 2018-05-24 15:24:53,913 DEBUG [Thread-157] procedure.ZKProcedureUtil(272): Clearing all znodes /cluster1/flush-table-proc/acquired, /cluster1/flush-table-proc/reached, /cluster1/flush-table-proc/abort 2018-05-24 15:24:53,914 DEBUG [Thread-157] procedure.ZKProcedureCoordinator(250): Starting controller for procedure member=zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,922 DEBUG [Thread-157] procedure.ZKProcedureUtil(272): Clearing all znodes /cluster1/online-snapshot/acquired, /cluster1/online-snapshot/reached, /cluster1/online-snapshot/abort 2018-05-24 15:24:53,923 DEBUG [Thread-157] procedure.ZKProcedureCoordinator(250): Starting controller for procedure member=zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:53,935 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(874): ClusterId : 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:24:53,935 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(874): ClusterId : 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:24:53,937 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(874): ClusterId : 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:24:53,940 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:53,940 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:53,940 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:53,946 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:53,946 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:53,946 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:53,946 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:53,946 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:53,947 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:53,949 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:53,950 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:53,951 INFO [RS:2;zhangduo-ubuntu:39191] zookeeper.ReadOnlyZKClient(139): Connect 0x12185cae to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:53,951 INFO [RS:1;zhangduo-ubuntu:38897] zookeeper.ReadOnlyZKClient(139): Connect 0x6079590f to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:53,954 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:53,956 INFO [RS:0;zhangduo-ubuntu:46367] zookeeper.ReadOnlyZKClient(139): Connect 0x0b61cf03 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:53,965 DEBUG [RS:2;zhangduo-ubuntu:39191] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cdfa09d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:53,975 DEBUG [RS:2;zhangduo-ubuntu:39191] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18e037de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:53,977 DEBUG [RS:1;zhangduo-ubuntu:38897] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ebeab70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:53,977 DEBUG [RS:0;zhangduo-ubuntu:46367] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a6201f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:53,977 DEBUG [RS:1;zhangduo-ubuntu:38897] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a81327f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:53,977 DEBUG [RS:0;zhangduo-ubuntu:46367] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@199a473, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:53,978 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:2;zhangduo-ubuntu:39191 2018-05-24 15:24:53,979 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:1;zhangduo-ubuntu:38897 2018-05-24 15:24:53,979 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:0;zhangduo-ubuntu:46367 2018-05-24 15:24:53,983 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:53,983 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:53,984 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=MASTER_OPEN_REGION-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:53,985 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=MASTER_CLOSE_REGION-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:53,985 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=MASTER_SERVER_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:53,985 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:53,985 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=M_LOG_REPLAY_OPS-master/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:53,985 DEBUG [Thread-157] executor.ExecutorService(92): Starting executor service name=MASTER_TABLE_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:53,985 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,46811,1527146692264 with port=46367, startcode=1527146693128 2018-05-24 15:24:53,986 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:53,987 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:53,987 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:53,987 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:53,987 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,46811,1527146692264 with port=38897, startcode=1527146693212 2018-05-24 15:24:53,988 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,46811,1527146692264 with port=39191, startcode=1527146693279 2018-05-24 15:24:54,007 INFO [Thread-157] procedure2.ProcedureExecutor(533): Starting 16 core workers (bigger of cpus/4 or 16) with max (burst) worker count=160 2018-05-24 15:24:54,018 WARN [Thread-157] util.CommonFSUtils$StreamCapabilities(830): Your Hadoop installation does not include the StreamCapabilities class from HDFS-11644, so we will skip checking if any FSDataOutputStreams actually support hflush/hsync. If you are running on top of HDFS this probably just means you have an older version and this can be ignored. If you are running on top of an alternate FileSystem implementation you should manually verify that hflush and hsync are implemented; otherwise you risk data loss and hard to diagnose errors when our assumptions are violated. 2018-05-24 15:24:54,018 DEBUG [Thread-157] util.CommonFSUtils$StreamCapabilities(837): The first request to check for StreamCapabilities came from this stacktrace. java.lang.ClassNotFoundException: org.apache.hadoop.fs.StreamCapabilities at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.util.CommonFSUtils$StreamCapabilities.(CommonFSUtils.java:826) at org.apache.hadoop.hbase.util.CommonFSUtils.hasCapability(CommonFSUtils.java:864) at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.rollWriter(WALProcedureStore.java:1042) at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.recoverLease(WALProcedureStore.java:382) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.start(ProcedureExecutor.java:550) at org.apache.hadoop.hbase.master.HMaster.startProcedureExecutor(HMaster.java:1273) at org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:1179) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:887) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2054) at org.apache.hadoop.hbase.master.HMaster.lambda$0(HMaster.java:573) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:54,020 DEBUG [Thread-157] wal.WALProcedureStore(1078): Roll new state log: 1 2018-05-24 15:24:54,021 INFO [Thread-157] procedure2.ProcedureExecutor(552): Recovered WALProcedureStore lease in 13msec 2018-05-24 15:24:54,022 INFO [Thread-157] procedure2.ProcedureExecutor(566): Loaded WALProcedureStore in 0msec 2018-05-24 15:24:54,027 INFO [Thread-157] procedure2.TimeoutExecutorThread(82): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1527146724027 2018-05-24 15:24:54,030 INFO [Thread-157] procedure2.RemoteProcedureDispatcher(97): Instantiated, coreThreads=128 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2018-05-24 15:24:54,032 INFO [Thread-157] cleaner.CleanerChore$DirScanPool(87): Cleaner pool size is 1 2018-05-24 15:24:54,034 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2018-05-24 15:24:54,036 INFO [Thread-157] zookeeper.RecoverableZooKeeper(106): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:54,039 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2018-05-24 15:24:54,041 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2018-05-24 15:24:54,042 INFO [Thread-157] cleaner.LogCleaner(122): Creating OldWALs cleaners with size=2 2018-05-24 15:24:54,049 DEBUG [Thread-157-EventThread] zookeeper.ZKWatcher(478): replicationLogCleaner0x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:54,051 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2018-05-24 15:24:54,052 DEBUG [Thread-157-EventThread] zookeeper.ZKWatcher(541): replicationLogCleaner-0x16391092ecc0008 connected 2018-05-24 15:24:54,058 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2018-05-24 15:24:54,058 DEBUG [Thread-157] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2018-05-24 15:24:54,063 DEBUG [Thread-157] cleaner.HFileCleaner(207): Starting for large file=Thread[Thread-157-HFileCleaner.large.0-1527146694059,5,FailOnTimeoutGroup] 2018-05-24 15:24:54,069 DEBUG [Thread-157] cleaner.HFileCleaner(222): Starting for small files=Thread[Thread-157-HFileCleaner.small.0-1527146694069,5,FailOnTimeoutGroup] 2018-05-24 15:24:54,070 INFO [Thread-157] master.HMaster(897): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1527146693352, completionTime=-1 2018-05-24 15:24:54,070 INFO [Thread-157] master.ServerManager(867): Waiting on regionserver count=0; waited=0ms, expecting min=3 server(s), max=3 server(s), timeout=4500ms, lastChange=0ms 2018-05-24 15:24:54,074 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.0 (auth:SIMPLE) 2018-05-24 15:24:54,074 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.2 (auth:SIMPLE) 2018-05-24 15:24:54,074 INFO [RS-EventLoopGroup-1-4] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.1 (auth:SIMPLE) 2018-05-24 15:24:54,079 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 37727 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:54,079 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 54927 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:54,079 INFO [RS-EventLoopGroup-1-4] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 38591 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:54,090 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,093 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,106 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77 2018-05-24 15:24:54,106 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77 2018-05-24 15:24:54,107 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77 2018-05-24 15:24:54,106 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:41639 2018-05-24 15:24:54,107 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:54,109 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:41639 2018-05-24 15:24:54,109 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:54,109 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:41639 2018-05-24 15:24:54,109 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:54,114 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:24:54,114 DEBUG [RS:0;zhangduo-ubuntu:46367] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,114 DEBUG [RS:1;zhangduo-ubuntu:38897] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,115 WARN [RS:1;zhangduo-ubuntu:38897] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:54,115 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,116 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,116 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,114 DEBUG [RS:2;zhangduo-ubuntu:39191] zookeeper.ZKUtil(355): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,114 WARN [RS:0;zhangduo-ubuntu:46367] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:54,117 WARN [RS:2;zhangduo-ubuntu:39191] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:54,121 INFO [Thread-157] master.ServerManager(887): Finished waiting on RegionServer count=3; waited=51ms, expected min=3 server(s), max=3 server(s), master is running 2018-05-24 15:24:54,121 INFO [RS:1;zhangduo-ubuntu:38897] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:54,121 INFO [RS:2;zhangduo-ubuntu:39191] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:54,121 INFO [RS:0;zhangduo-ubuntu:46367] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:54,128 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1815): logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,128 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1815): logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,128 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1815): logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,157 DEBUG [RS:0;zhangduo-ubuntu:46367] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,157 DEBUG [RS:2;zhangduo-ubuntu:39191] zookeeper.ZKUtil(355): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,157 DEBUG [RS:0;zhangduo-ubuntu:46367] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,158 DEBUG [RS:2;zhangduo-ubuntu:39191] zookeeper.ZKUtil(355): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,158 DEBUG [RS:1;zhangduo-ubuntu:38897] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,158 DEBUG [RS:0;zhangduo-ubuntu:46367] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,158 DEBUG [RS:1;zhangduo-ubuntu:38897] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,159 DEBUG [RS:1;zhangduo-ubuntu:38897] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,159 DEBUG [RS:2;zhangduo-ubuntu:39191] zookeeper.ZKUtil(355): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,164 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:54,167 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:54,168 DEBUG [RS:1;zhangduo-ubuntu:38897] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:54,170 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:54,170 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:54,170 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:54,219 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:54,221 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:54,222 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:54,224 INFO [RS:2;zhangduo-ubuntu:39191] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:54,224 INFO [RS:0;zhangduo-ubuntu:46367] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:54,224 INFO [RS:1;zhangduo-ubuntu:38897] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:54,228 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:54,228 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:54,228 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:54,241 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,243 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:54,244 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,244 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,244 DEBUG [RS:1;zhangduo-ubuntu:38897] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,242 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,245 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,246 DEBUG [RS:0;zhangduo-ubuntu:46367] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,242 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:54,246 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:54,247 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:54,247 DEBUG [RS:2;zhangduo-ubuntu:39191] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:54,305 INFO [SplitLogWorker-zhangduo-ubuntu:38897] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,38897,1527146693212 starting 2018-05-24 15:24:54,309 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:54,309 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:54,310 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:54,305 INFO [SplitLogWorker-zhangduo-ubuntu:46367] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,46367,1527146693128 starting 2018-05-24 15:24:54,306 INFO [SplitLogWorker-zhangduo-ubuntu:39191] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,39191,1527146693279 starting 2018-05-24 15:24:54,351 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,39191,1527146693279, RpcServer on zhangduo-ubuntu/127.0.1.1:39191, sessionid=0x16391092ecc0003 2018-05-24 15:24:54,351 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:54,351 DEBUG [RS:2;zhangduo-ubuntu:39191] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,351 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,39191,1527146693279' 2018-05-24 15:24:54,351 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/flush-table-proc/abort' 2018-05-24 15:24:54,352 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/flush-table-proc/acquired' 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,39191,1527146693279' 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/online-snapshot/abort' 2018-05-24 15:24:54,353 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/online-snapshot/acquired' 2018-05-24 15:24:54,354 DEBUG [RS:2;zhangduo-ubuntu:39191] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:54,354 INFO [RS:2;zhangduo-ubuntu:39191] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:54,354 INFO [RS:2;zhangduo-ubuntu:39191] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:54,366 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,46367,1527146693128, RpcServer on zhangduo-ubuntu/127.0.1.1:46367, sessionid=0x16391092ecc0001 2018-05-24 15:24:54,366 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:54,366 DEBUG [RS:0;zhangduo-ubuntu:46367] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,368 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,46367,1527146693128' 2018-05-24 15:24:54,371 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/flush-table-proc/abort' 2018-05-24 15:24:54,372 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/flush-table-proc/acquired' 2018-05-24 15:24:54,372 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,38897,1527146693212, RpcServer on zhangduo-ubuntu/127.0.1.1:38897, sessionid=0x16391092ecc0002 2018-05-24 15:24:54,372 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:54,372 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:54,372 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:54,372 DEBUG [RS:1;zhangduo-ubuntu:38897] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,372 DEBUG [RS:0;zhangduo-ubuntu:46367] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:54,373 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,46367,1527146693128' 2018-05-24 15:24:54,373 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/online-snapshot/abort' 2018-05-24 15:24:54,373 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,38897,1527146693212' 2018-05-24 15:24:54,373 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/flush-table-proc/abort' 2018-05-24 15:24:54,374 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/online-snapshot/acquired' 2018-05-24 15:24:54,374 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/flush-table-proc/acquired' 2018-05-24 15:24:54,374 DEBUG [RS:0;zhangduo-ubuntu:46367] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:54,374 INFO [RS:0;zhangduo-ubuntu:46367] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:54,375 INFO [RS:0;zhangduo-ubuntu:46367] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:54,377 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:54,377 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:54,377 DEBUG [RS:1;zhangduo-ubuntu:38897] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:24:54,377 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,38897,1527146693212' 2018-05-24 15:24:54,377 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster1/online-snapshot/abort' 2018-05-24 15:24:54,378 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster1/online-snapshot/acquired' 2018-05-24 15:24:54,378 DEBUG [RS:1;zhangduo-ubuntu:38897] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:54,378 INFO [RS:1;zhangduo-ubuntu:38897] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:54,379 INFO [RS:1;zhangduo-ubuntu:38897] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:54,459 DEBUG [Thread-157] procedure2.ProcedureExecutor(884): Stored pid=1, state=RUNNABLE:RECOVER_META_PREPARE; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2018-05-24 15:24:54,488 INFO [PEWorker-1] procedure.RecoverMetaProcedure(125): Start pid=1, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2018-05-24 15:24:54,491 DEBUG [PEWorker-1] zookeeper.ZKUtil(614): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Unable to get data of znode /cluster1/meta-region-server because node does not exist (not an error) 2018-05-24 15:24:54,494 DEBUG [PEWorker-1] master.MasterWalManager(169): No log files to split, proceeding... 2018-05-24 15:24:54,527 DEBUG [PEWorker-1] zookeeper.ZKUtil(614): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Unable to get data of znode /cluster1/meta-region-server because node does not exist (not an error) 2018-05-24 15:24:54,527 INFO [PEWorker-1] procedure.RecoverMetaProcedure(157): pid=1, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=null 2018-05-24 15:24:54,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740}] 2018-05-24 15:24:54,556 INFO [PEWorker-2] procedure.MasterProcedureScheduler(640): pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740 checking lock on 1588230740 2018-05-24 15:24:54,562 INFO [PEWorker-2] assignment.AssignProcedure(218): Starting pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2018-05-24 15:24:54,715 DEBUG [master/zhangduo-ubuntu:0] assignment.AssignmentManager(1774): Processing assignQueue; systemServersCount=3, allServersCount=3 2018-05-24 15:24:54,718 DEBUG [master/zhangduo-ubuntu:0] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region hbase:meta,,1.1588230740 2018-05-24 15:24:54,726 INFO [PEWorker-3] assignment.AssignProcedure(246): Early suspend! pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,376 WARN [RS:2;zhangduo-ubuntu:39191] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:24:55,376 INFO [RS:2;zhangduo-ubuntu:39191] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C39191%2C1527146693279, suffix=, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:24:55,383 WARN [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:24:55,384 INFO [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C46367%2C1527146693128, suffix=, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:24:55,392 WARN [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:24:55,392 INFO [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C38897%2C1527146693212, suffix=, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:24:55,412 DEBUG [RS:0;zhangduo-ubuntu:46367] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(421): org.apache.hadoop.hdfs.protocolPB.PBHelperClient not found (Hadoop is pre-2.8.0?); using class org.apache.hadoop.hdfs.protocolPB.PBHelper instead. 2018-05-24 15:24:55,451 DEBUG [RS:0;zhangduo-ubuntu:46367] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(494): No DfsClientConf class found, should be hadoop 2.7- java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.client.impl.DfsClientConf at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createChecksumCreater(FanOutOneBlockAsyncDFSOutputHelper.java:492) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:556) at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:51) at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:168) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:165) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:102) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createAsyncWriter(AsyncFSWAL.java:610) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:616) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:1) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:769) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:500) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:441) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:142) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:1) at org.apache.hadoop.hbase.wal.SyncReplicationWALProvider.getWAL(SyncReplicationWALProvider.java:195) at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:262) at org.apache.hadoop.hbase.regionserver.HRegionServer.getWAL(HRegionServer.java:2110) at org.apache.hadoop.hbase.regionserver.HRegionServer.buildServerLoad(HRegionServer.java:1326) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1191) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1007) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:183) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$0(MiniHBaseCluster.java:182) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1726) at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:307) at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:164) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:55,452 DEBUG [RS:0;zhangduo-ubuntu:46367] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(528): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2018-05-24 15:24:55,486 DEBUG [RS-EventLoopGroup-5-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(199): No PBHelperClient class found, should be hadoop 2.7- java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.protocolPB.PBHelperClient at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createPBHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:197) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:261) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:661) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$3(FanOutOneBlockAsyncDFSOutputHelper.java:656) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$14.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:720) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$14.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:1) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:507) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:500) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:479) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:420) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:104) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:82) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:638) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:676) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:552) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:394) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:304) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:55,497 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK] 2018-05-24 15:24:55,500 DEBUG [RS-EventLoopGroup-5-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK] 2018-05-24 15:24:55,500 DEBUG [RS-EventLoopGroup-5-6] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:24:55,501 DEBUG [RS-EventLoopGroup-5-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK] 2018-05-24 15:24:55,503 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK] 2018-05-24 15:24:55,505 DEBUG [RS-EventLoopGroup-5-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:24:55,511 DEBUG [RS-EventLoopGroup-5-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:24:55,512 DEBUG [RS-EventLoopGroup-5-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK] 2018-05-24 15:24:55,513 DEBUG [RS-EventLoopGroup-5-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK] 2018-05-24 15:24:55,538 INFO [RS:2;zhangduo-ubuntu:39191] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 2018-05-24 15:24:55,538 INFO [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 2018-05-24 15:24:55,538 INFO [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 2018-05-24 15:24:55,539 DEBUG [RS:2;zhangduo-ubuntu:39191] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK], DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK], DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK]] 2018-05-24 15:24:55,539 DEBUG [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK], DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK], DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK]] 2018-05-24 15:24:55,539 DEBUG [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK], DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK], DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK]] 2018-05-24 15:24:55,556 INFO [PEWorker-4] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,562 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(466): META region location doesn't exist, create it 2018-05-24 15:24:55,564 INFO [PEWorker-4] assignment.RegionTransitionProcedure(251): Dispatch pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,742 DEBUG [RSProcedureDispatcher-pool4-t1] master.ServerManager(779): New admin connection to zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,750 INFO [RS-EventLoopGroup-5-5] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:24:55,751 INFO [RS-EventLoopGroup-5-5] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 34392 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:55,755 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39191] regionserver.RSRpcServices(1983): Open hbase:meta,,1.1588230740 2018-05-24 15:24:55,757 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:55,764 WARN [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:24:55,764 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C39191%2C1527146693279.meta, suffix=.meta, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:24:55,774 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:24:55,779 DEBUG [RS-EventLoopGroup-5-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK] 2018-05-24 15:24:55,779 DEBUG [RS-EventLoopGroup-5-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK] 2018-05-24 15:24:55,789 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta 2018-05-24 15:24:55,790 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK], DatanodeInfoWithStorage[127.0.0.1:40385,DS-65746aac-e5e4-4474-b835-d3d17c2bfc20,DISK], DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK]] 2018-05-24 15:24:55,791 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:24:55,808 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(200): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-24 15:24:55,821 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(8081): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-24 15:24:55,828 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.RegionCoprocessorHost(394): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-24 15:24:55,832 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-24 15:24:55,832 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:24:55,844 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info 2018-05-24 15:24:55,844 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info 2018-05-24 15:24:55,845 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:55,848 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:55,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:55,852 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:24:55,852 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:24:55,852 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:55,853 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:55,854 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:55,856 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table 2018-05-24 15:24:55,856 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table 2018-05-24 15:24:55,857 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:55,857 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:55,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:55,864 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740 2018-05-24 15:24:55,868 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7M)) instead. 2018-05-24 15:24:55,870 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 1588230740; next sequenceid=2 2018-05-24 15:24:55,898 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-24 15:24:55,911 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,911 DEBUG [PEWorker-6] assignment.RegionTransitionProcedure(363): Finishing pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,912 INFO [PEWorker-6] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,912 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-24 15:24:55,915 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/meta-region-server 2018-05-24 15:24:55,915 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:meta,,1.1588230740 on zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:55,942 INFO [PEWorker-6] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=1, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2018-05-24 15:24:55,942 INFO [PEWorker-6] procedure2.ProcedureExecutor(1265): Finished pid=2, ppid=1, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740 in 1.3860sec 2018-05-24 15:24:55,954 INFO [PEWorker-8] procedure2.ProcedureExecutor(1265): Finished pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.8070sec 2018-05-24 15:24:55,956 INFO [Thread-157] master.HMaster(3602): hbase:meta deployed at=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:24:56,000 INFO [RS-EventLoopGroup-5-5] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:24:56,000 INFO [RS-EventLoopGroup-5-5] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 34400 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:56,046 INFO [Thread-157] master.MasterWalManager(189): Log folder hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212 belongs to an existing region server 2018-05-24 15:24:56,047 INFO [Thread-157] master.MasterWalManager(189): Log folder hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279 belongs to an existing region server 2018-05-24 15:24:56,048 INFO [Thread-157] master.MasterWalManager(189): Log folder hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128 belongs to an existing region server 2018-05-24 15:24:56,048 DEBUG [Thread-157] assignment.AssignmentManager(1209): Joining cluster... 2018-05-24 15:24:56,054 INFO [Thread-157] assignment.AssignmentManager(1220): Number of RegionServers=3 2018-05-24 15:24:56,055 INFO [Thread-157] procedure2.TimeoutExecutorThread(82): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1527146701054 2018-05-24 15:24:56,055 INFO [Thread-157] assignment.AssignmentManager(1227): Joined the cluster in 7msec, failover=true 2018-05-24 15:24:56,082 INFO [Thread-157] master.TableNamespaceManager(96): Namespace table not found. Creating... 2018-05-24 15:24:56,086 INFO [Thread-157] master.HMaster(1812): Client=null/null create 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} 2018-05-24 15:24:56,216 DEBUG [Thread-157] procedure2.ProcedureExecutor(884): Stored pid=3, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2018-05-24 15:24:56,267 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW]]} size 0 2018-05-24 15:24:56,268 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW]]} size 0 2018-05-24 15:24:56,269 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW]]} size 0 2018-05-24 15:24:56,272 DEBUG [PEWorker-7] util.FSTableDescriptors(683): Wrote into hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2018-05-24 15:24:56,276 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(6928): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/.tmp Table name == hbase:namespace 2018-05-24 15:24:56,296 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741835_1011{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:24:56,297 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741835_1011{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:24:56,300 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741835_1011{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:24:56,301 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(828): Instantiated hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:24:56,302 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1515): Closing 9de803c8ab8fedb0c6b8072a4649d9cd, disabling compactions & flushes 2018-05-24 15:24:56,302 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1555): Updates disabled for region hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,302 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1669): Closed hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,358 DEBUG [PEWorker-7] hbase.MetaTableAccessor(2145): Put {"totalColumns":2,"row":"hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":1527146696323},{"qualifier":"state","vlen":6,"tag":[],"timestamp":1527146696323}]},"ts":1527146696323} 2018-05-24 15:24:56,419 INFO [PEWorker-7] hbase.MetaTableAccessor(1520): Added 1 regions to meta. 2018-05-24 15:24:56,435 DEBUG [PEWorker-7] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146696431}]},"ts":1527146696431} 2018-05-24 15:24:56,450 INFO [PEWorker-7] hbase.MetaTableAccessor(1665): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2018-05-24 15:24:56,454 DEBUG [PEWorker-7] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,464 INFO [PEWorker-7] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128}] 2018-05-24 15:24:56,477 INFO [PEWorker-9] procedure.MasterProcedureScheduler(640): pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128 checking lock on 9de803c8ab8fedb0c6b8072a4649d9cd 2018-05-24 15:24:56,488 INFO [PEWorker-9] assignment.AssignProcedure(218): Starting pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128; rit=OFFLINE, location=zhangduo-ubuntu,46367,1527146693128; forceNewPlan=false, retain=false 2018-05-24 15:24:56,647 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 1 retained the pre-restart assignment. 2018-05-24 15:24:56,648 INFO [PEWorker-10] assignment.RegionStateStore(197): pid=4 updating hbase:meta row=9de803c8ab8fedb0c6b8072a4649d9cd, regionState=OPENING, regionLocation=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,654 INFO [PEWorker-10] assignment.RegionTransitionProcedure(251): Dispatch pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,807 DEBUG [RSProcedureDispatcher-pool4-t2] master.ServerManager(779): New admin connection to zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,815 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:24:56,815 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 42310 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:56,816 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46367] regionserver.RSRpcServices(1983): Open hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,827 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 9de803c8ab8fedb0c6b8072a4649d9cd, NAME => 'hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:24:56,830 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table namespace 9de803c8ab8fedb0c6b8072a4649d9cd 2018-05-24 15:24:56,830 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:24:56,837 DEBUG [StoreOpener-9de803c8ab8fedb0c6b8072a4649d9cd-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/info 2018-05-24 15:24:56,838 DEBUG [StoreOpener-9de803c8ab8fedb0c6b8072a4649d9cd-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/info 2018-05-24 15:24:56,838 INFO [StoreOpener-9de803c8ab8fedb0c6b8072a4649d9cd-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:56,839 INFO [StoreOpener-9de803c8ab8fedb0c6b8072a4649d9cd-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:56,840 INFO [StoreOpener-9de803c8ab8fedb0c6b8072a4649d9cd-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:56,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd 2018-05-24 15:24:56,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:24:56,852 INFO [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 9de803c8ab8fedb0c6b8072a4649d9cd; next sequenceid=2 2018-05-24 15:24:56,857 INFO [PostOpenDeployTasks:9de803c8ab8fedb0c6b8072a4649d9cd] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,861 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,861 DEBUG [PEWorker-5] assignment.RegionTransitionProcedure(363): Finishing pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,862 INFO [PEWorker-5] assignment.RegionStateStore(197): pid=4 updating hbase:meta row=9de803c8ab8fedb0c6b8072a4649d9cd, regionState=OPEN, openSeqNum=2, regionLocation=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,864 DEBUG [PostOpenDeployTasks:9de803c8ab8fedb0c6b8072a4649d9cd] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:24:56,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. on zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:24:56,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=3, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=hbase:namespace; resume parent processing. 2018-05-24 15:24:56,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=4, ppid=3, state=SUCCESS; AssignProcedure table=hbase:namespace, region=9de803c8ab8fedb0c6b8072a4649d9cd, target=zhangduo-ubuntu,46367,1527146693128 in 406msec 2018-05-24 15:24:56,903 DEBUG [PEWorker-11] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146696903}]},"ts":1527146696903} 2018-05-24 15:24:56,908 INFO [PEWorker-11] hbase.MetaTableAccessor(1665): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2018-05-24 15:24:56,941 INFO [PEWorker-11] procedure2.ProcedureExecutor(1265): Finished pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 836msec 2018-05-24 15:24:56,942 DEBUG [Thread-157] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/namespace 2018-05-24 15:24:56,943 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster1/namespace 2018-05-24 15:24:56,956 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:24:56,956 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 42314 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:57,083 DEBUG [Thread-157] procedure2.ProcedureExecutor(884): Stored pid=5, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2018-05-24 15:24:57,134 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/namespace 2018-05-24 15:24:57,178 INFO [PEWorker-12] procedure2.ProcedureExecutor(1265): Finished pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 194msec 2018-05-24 15:24:57,303 DEBUG [Thread-157] procedure2.ProcedureExecutor(884): Stored pid=6, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2018-05-24 15:24:57,347 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/namespace 2018-05-24 15:24:57,382 INFO [PEWorker-13] procedure2.ProcedureExecutor(1265): Finished pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 179msec 2018-05-24 15:24:57,396 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/namespace/default 2018-05-24 15:24:57,398 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/namespace/hbase 2018-05-24 15:24:57,398 INFO [Thread-157] master.HMaster(963): Master has completed initialization 4.025sec 2018-05-24 15:24:57,401 INFO [Thread-157] quotas.MasterQuotaManager(90): Quota support disabled 2018-05-24 15:24:57,402 INFO [Thread-157] zookeeper.ZKWatcher(205): not a secure deployment, proceeding 2018-05-24 15:24:57,451 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(139): Connect 0x5e8870bc to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:57,457 DEBUG [Time-limited test] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d181e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:57,482 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:24:57,482 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 34424 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:57,493 INFO [Time-limited test] hbase.HBaseTestingUtility(1045): Minicluster is up; activeMaster=zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:24:57,493 INFO [Time-limited test] hbase.HBaseTestingUtility(954): Starting up minicluster with 1 master(s) and 3 regionserver(s) and 3 datanode(s) 2018-05-24 15:24:57,493 INFO [Time-limited test] hbase.HBaseZKTestingUtility(86): Created new mini-cluster data directory: /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03, deleteOnExit=true 2018-05-24 15:24:57,493 INFO [Time-limited test] hbase.HBaseTestingUtility(969): STARTING DFS 2018-05-24 15:24:57,513 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting test.cache.data to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cache_data in system properties and HBase conf 2018-05-24 15:24:57,513 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting hadoop.tmp.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/hadoop_tmp in system properties and HBase conf 2018-05-24 15:24:57,513 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting hadoop.log.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/hadoop_logs in system properties and HBase conf 2018-05-24 15:24:57,513 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting mapreduce.cluster.local.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/mapred_local in system properties and HBase conf 2018-05-24 15:24:57,514 INFO [Time-limited test] hbase.HBaseTestingUtility(746): Setting mapreduce.cluster.temp.dir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/mapred_temp in system properties and HBase conf 2018-05-24 15:24:57,514 INFO [Time-limited test] hbase.HBaseTestingUtility(737): read short circuit is OFF 2018-05-24 15:24:57,514 DEBUG [Time-limited test] fs.HFileSystem(317): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2018-05-24 15:24:57,611 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:57,616 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_32831_hdfs____.amairj/webapp 2018-05-24 15:24:57,749 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:760) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:639) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:819) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:803) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1500) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1115) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:986) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:815) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:104) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:57,751 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32831 2018-05-24 15:24:57,848 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:57,853 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_39283_datanode____p8zgmm/webapp 2018-05-24 15:24:57,972 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:104) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:57,973 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39283 2018-05-24 15:24:58,028 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:58,032 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_46029_datanode____.qvrnqc/webapp 2018-05-24 15:24:58,119 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:38079] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:58,137 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd2df0770b: from storage DS-85003ea0-aa94-4757-8e9e-555a470316f1 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=2007c688-9835-4ef8-af24-d266953a1238, infoPort=35913, infoSecurePort=0, ipcPort=38373, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs 2018-05-24 15:24:58,138 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd2df0770b: from storage DS-b37460aa-1473-46d5-826f-abc526fd58b1 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=2007c688-9835-4ef8-af24-d266953a1238, infoPort=35913, infoSecurePort=0, ipcPort=38373, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:58,184 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:104) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:58,187 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46029 2018-05-24 15:24:58,250 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2018-05-24 15:24:58,254 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/zhangduo/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_37479_datanode____7sl5l/webapp 2018-05-24 15:24:58,333 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:38079] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:58,345 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd3a9aba45: from storage DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4 node DatanodeRegistration(127.0.0.1:45001, datanodeUuid=f94a33a7-5224-407f-87c5-a1b6e29eb241, infoPort=39607, infoSecurePort=0, ipcPort=34551, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs 2018-05-24 15:24:58,345 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd3a9aba45: from storage DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88 node DatanodeRegistration(127.0.0.1:45001, datanodeUuid=f94a33a7-5224-407f-87c5-a1b6e29eb241, infoPort=39607, infoSecurePort=0, ipcPort=34551, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:58,402 WARN [Time-limited test] log.Slf4jLog(89): EXCEPTION java.net.ConnectException: 拒绝连接 (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.mortbay.xml.XmlParser.parse(XmlParser.java:188) at org.mortbay.xml.XmlParser.parse(XmlParser.java:204) at org.mortbay.jetty.webapp.TagLibConfiguration.configureWebApp(TagLibConfiguration.java:238) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1279) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.mortbay.jetty.Server.doStart(Server.java:224) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:877) at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.(DatanodeHttpServer.java:104) at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:760) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1136) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:429) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2406) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2293) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1453) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:836) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:746) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:660) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:631) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:970) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:850) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:832) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:814) at org.apache.hadoop.hbase.replication.SyncReplicationTestBase.setUp(SyncReplicationTestBase.java:104) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.setUp(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:24:58,407 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37479 2018-05-24 15:24:58,806 ERROR [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:38079] datanode.DirectoryScanner(430): dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000 2018-05-24 15:24:58,813 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd568e5926: from storage DS-3b396433-7c05-4241-ac25-f012e6c4eb69 node DatanodeRegistration(127.0.0.1:39253, datanodeUuid=c16eaf65-6efe-4a59-810e-e4de07365c07, infoPort=46585, infoSecurePort=0, ipcPort=45099, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs 2018-05-24 15:24:58,814 INFO [Block report processor] blockmanagement.BlockManager(1933): BLOCK* processReport 0x307cd568e5926: from storage DS-dc755e38-4b2d-4079-9d67-5bab8270103f node DatanodeRegistration(127.0.0.1:39253, datanodeUuid=c16eaf65-6efe-4a59-810e-e4de07365c07, infoPort=46585, infoSecurePort=0, ipcPort=45099, storageInfo=lv=-56;cid=testClusterID;nsid=378331353;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs 2018-05-24 15:24:58,868 DEBUG [Time-limited test] hbase.HBaseTestingUtility(672): Setting hbase.rootdir to /home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8 2018-05-24 15:24:58,869 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,870 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,903 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|FINALIZED]]} size 0 2018-05-24 15:24:58,905 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|FINALIZED], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:24:58,909 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741825_1001 size 7 2018-05-24 15:24:58,911 INFO [Time-limited test] util.FSUtils(515): Created version file at hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d with version=8 2018-05-24 15:24:58,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1213): Setting hbase.fs.tmp.dir to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/hbase-staging 2018-05-24 15:24:58,913 INFO [Time-limited test] client.ConnectionUtils(122): master/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:58,913 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:58,914 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:58,914 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:58,914 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:58,916 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:39993 2018-05-24 15:24:58,917 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:58,917 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:58,918 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,919 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,920 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=master:39993 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:58,924 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:399930x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:58,924 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): master:39993-0x16391092ecc000a connected 2018-05-24 15:24:58,936 DEBUG [Time-limited test] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/master 2018-05-24 15:24:58,936 DEBUG [Time-limited test] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:24:58,937 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39993 2018-05-24 15:24:58,938 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=39993 2018-05-24 15:24:58,939 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39993 2018-05-24 15:24:58,939 INFO [Time-limited test] master.HMaster(496): hbase.rootdir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d, hbase.cluster.distributed=false 2018-05-24 15:24:58,952 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:58,952 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:58,953 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:58,953 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:58,953 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:58,953 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:58,955 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:34061 2018-05-24 15:24:58,956 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:58,956 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:58,958 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,959 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:58,960 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:34061 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:58,968 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:340610x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:58,968 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:340610x0, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/master 2018-05-24 15:24:58,970 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:340610x0, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:24:58,971 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:34061-0x16391092ecc000b connected 2018-05-24 15:24:58,976 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34061 2018-05-24 15:24:58,987 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=34061 2018-05-24 15:24:58,990 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34061 2018-05-24 15:24:59,008 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:59,008 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:59,008 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:59,009 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:59,009 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:59,009 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:59,011 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:37499 2018-05-24 15:24:59,012 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,012 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,013 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:59,014 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:59,015 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:37499 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:59,019 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:374990x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:59,020 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:37499-0x16391092ecc000c connected 2018-05-24 15:24:59,020 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/master 2018-05-24 15:24:59,021 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:24:59,022 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37499 2018-05-24 15:24:59,023 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=37499 2018-05-24 15:24:59,024 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37499 2018-05-24 15:24:59,039 INFO [Time-limited test] client.ConnectionUtils(122): regionserver/zhangduo-ubuntu:0 server-side Connection retries=45 2018-05-24 15:24:59,040 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=50, handlerCount=5 2018-05-24 15:24:59,040 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=60, handlerCount=6 2018-05-24 15:24:59,040 INFO [Time-limited test] ipc.RpcExecutor(148): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2018-05-24 15:24:59,040 INFO [Time-limited test] ipc.RpcServerFactory(65): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-24 15:24:59,040 INFO [Time-limited test] io.ByteBufferPool(83): Created with bufferSize=64 KB and maxPoolSize=320 B 2018-05-24 15:24:59,042 INFO [Time-limited test] ipc.NettyRpcServer(109): Bind to /127.0.1.1:42271 2018-05-24 15:24:59,043 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,044 INFO [Time-limited test] hfile.CacheConfig(262): Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,045 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:59,046 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:59,047 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(106): Process identifier=regionserver:42271 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:59,050 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:422710x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:59,052 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(541): regionserver:42271-0x16391092ecc000d connected 2018-05-24 15:24:59,052 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/master 2018-05-24 15:24:59,052 DEBUG [Time-limited test] zookeeper.ZKUtil(357): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:24:59,054 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=5 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42271 2018-05-24 15:24:59,056 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=6 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=1, port=42271 2018-05-24 15:24:59,057 DEBUG [Time-limited test] ipc.RpcExecutor(263): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42271 2018-05-24 15:24:59,058 INFO [Thread-406] master.HMaster(2034): Adding backup master ZNode /cluster2/backup-masters/zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,060 DEBUG [Thread-406] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/backup-masters/zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,061 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/master 2018-05-24 15:24:59,061 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/master 2018-05-24 15:24:59,061 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/master 2018-05-24 15:24:59,061 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/master 2018-05-24 15:24:59,066 DEBUG [Thread-406] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/master 2018-05-24 15:24:59,066 INFO [Thread-406] master.ActiveMasterManager(172): Deleting ZNode for /cluster2/backup-masters/zhangduo-ubuntu,39993,1527146698913 from backup master directory 2018-05-24 15:24:59,071 WARN [Thread-406] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:59,071 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/master 2018-05-24 15:24:59,071 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/backup-masters/zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,071 INFO [Thread-406] master.ActiveMasterManager(181): Registered as active master=zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,104 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:24:59,105 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:24:59,107 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:24:59,110 DEBUG [Thread-406] util.FSUtils(667): Created cluster ID file at hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/hbase.id with ID: 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:24:59,116 INFO [Thread-406] master.MasterFileSystem(393): BOOTSTRAP: creating hbase:meta region 2018-05-24 15:24:59,117 INFO [Thread-406] regionserver.HRegion(6928): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'false', BLOCKSIZE => '8192'}, {NAME => 'rep_barrier', VERSIONS => '2147483647', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'table', VERSIONS => '3', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d Table name == hbase:meta 2018-05-24 15:24:59,135 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:24:59,138 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:24:59,138 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741827_1003{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:24:59,140 DEBUG [Thread-406] regionserver.HRegion(828): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:24:59,147 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/info 2018-05-24 15:24:59,148 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,149 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:59,150 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:59,152 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:24:59,153 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,153 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:59,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:59,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/table 2018-05-24 15:24:59,157 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:24:59,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:24:59,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:24:59,160 DEBUG [Thread-406] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740 2018-05-24 15:24:59,175 DEBUG [Thread-406] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7M)) instead. 2018-05-24 15:24:59,181 DEBUG [Thread-406] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:24:59,182 INFO [Thread-406] regionserver.HRegion(976): Opened 1588230740; next sequenceid=2 2018-05-24 15:24:59,182 DEBUG [Thread-406] regionserver.HRegion(1515): Closing 1588230740, disabling compactions & flushes 2018-05-24 15:24:59,182 DEBUG [Thread-406] regionserver.HRegion(1555): Updates disabled for region hbase:meta,,1.1588230740 2018-05-24 15:24:59,182 INFO [Thread-406] regionserver.HRegion(1669): Closed hbase:meta,,1.1588230740 2018-05-24 15:24:59,200 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741828_1004{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:24:59,201 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741828_1004 size 1447 2018-05-24 15:24:59,201 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741828_1004 size 1447 2018-05-24 15:24:59,203 DEBUG [Thread-406] util.FSTableDescriptors(683): Wrote into hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2018-05-24 15:24:59,358 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:24:59,358 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:24:59,358 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:24:59,359 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:24:59,359 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:24:59,362 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:24:59,385 INFO [Thread-406] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:24:59,386 INFO [Thread-406] coordination.ZKSplitLogManagerCoordination(492): Found 0 orphan tasks and 0 rescan nodes 2018-05-24 15:24:59,393 INFO [Thread-406] zookeeper.ReadOnlyZKClient(139): Connect 0x7b004625 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:59,400 DEBUG [Thread-406] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@749ad502, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:59,413 INFO [Thread-406] balancer.BaseLoadBalancer(1039): slop=0.001, tablesOnMaster=false, systemTablesOnMaster=false 2018-05-24 15:24:59,413 INFO [Thread-406] balancer.StochasticLoadBalancer(214): Loaded config; maxSteps=1000000, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, etc. 2018-05-24 15:24:59,428 DEBUG [Thread-406] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/balancer 2018-05-24 15:24:59,429 DEBUG [Thread-406] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/normalizer 2018-05-24 15:24:59,431 DEBUG [Thread-406] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/switch/split 2018-05-24 15:24:59,431 DEBUG [Thread-406] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/switch/merge 2018-05-24 15:24:59,435 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/running 2018-05-24 15:24:59,435 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/running 2018-05-24 15:24:59,435 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/running 2018-05-24 15:24:59,435 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/running 2018-05-24 15:24:59,435 INFO [Thread-406] master.HMaster(787): Active/primary master=zhangduo-ubuntu,39993,1527146698913, sessionid=0x16391092ecc000a, setting cluster-up flag (Was=false) 2018-05-24 15:24:59,443 DEBUG [Thread-406] procedure.ZKProcedureUtil(272): Clearing all znodes /cluster2/flush-table-proc/acquired, /cluster2/flush-table-proc/reached, /cluster2/flush-table-proc/abort 2018-05-24 15:24:59,444 DEBUG [Thread-406] procedure.ZKProcedureCoordinator(250): Starting controller for procedure member=zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,453 DEBUG [Thread-406] procedure.ZKProcedureUtil(272): Clearing all znodes /cluster2/online-snapshot/acquired, /cluster2/online-snapshot/reached, /cluster2/online-snapshot/abort 2018-05-24 15:24:59,454 DEBUG [Thread-406] procedure.ZKProcedureCoordinator(250): Starting controller for procedure member=zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=MASTER_OPEN_REGION-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=MASTER_CLOSE_REGION-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=MASTER_SERVER_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=5, maxPoolSize=5 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=M_LOG_REPLAY_OPS-master/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:59,456 DEBUG [Thread-406] executor.ExecutorService(92): Starting executor service name=MASTER_TABLE_OPERATIONS-master/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,459 INFO [Thread-406] procedure2.ProcedureExecutor(533): Starting 16 core workers (bigger of cpus/4 or 16) with max (burst) worker count=160 2018-05-24 15:24:59,473 DEBUG [Thread-406] wal.WALProcedureStore(1078): Roll new state log: 1 2018-05-24 15:24:59,474 INFO [Thread-406] procedure2.ProcedureExecutor(552): Recovered WALProcedureStore lease in 15msec 2018-05-24 15:24:59,474 INFO [Thread-406] procedure2.ProcedureExecutor(566): Loaded WALProcedureStore in 0msec 2018-05-24 15:24:59,482 INFO [Thread-406] procedure2.TimeoutExecutorThread(82): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.ProcedureExecutor$CompletedProcedureCleaner; timeout=30000, timestamp=1527146729482 2018-05-24 15:24:59,483 INFO [Thread-406] procedure2.RemoteProcedureDispatcher(97): Instantiated, coreThreads=128 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2018-05-24 15:24:59,483 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2018-05-24 15:24:59,483 INFO [Thread-406] zookeeper.RecoverableZooKeeper(106): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:24:59,488 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(874): ClusterId : 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:24:59,489 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(874): ClusterId : 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:24:59,489 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2018-05-24 15:24:59,489 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2018-05-24 15:24:59,489 INFO [Thread-406] cleaner.LogCleaner(122): Creating OldWALs cleaners with size=2 2018-05-24 15:24:59,489 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(874): ClusterId : 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:24:59,490 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:59,491 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:59,491 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2018-05-24 15:24:59,491 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2018-05-24 15:24:59,491 DEBUG [Thread-406] cleaner.CleanerChore(234): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2018-05-24 15:24:59,492 DEBUG [Thread-406] cleaner.HFileCleaner(207): Starting for large file=Thread[Thread-406-HFileCleaner.large.0-1527146699491,5,FailOnTimeoutGroup] 2018-05-24 15:24:59,492 DEBUG [Thread-406] cleaner.HFileCleaner(222): Starting for small files=Thread[Thread-406-HFileCleaner.small.0-1527146699492,5,FailOnTimeoutGroup] 2018-05-24 15:24:59,492 INFO [Thread-406] master.HMaster(897): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1527146699060, completionTime=-1 2018-05-24 15:24:59,492 INFO [Thread-406] master.ServerManager(867): Waiting on regionserver count=0; waited=0ms, expecting min=3 server(s), max=3 server(s), timeout=4500ms, lastChange=0ms 2018-05-24 15:24:59,493 DEBUG [Thread-406-EventThread] zookeeper.ZKWatcher(478): replicationLogCleaner0x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:24:59,493 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:59,493 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:59,494 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:59,494 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:59,496 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initializing 2018-05-24 15:24:59,497 DEBUG [Thread-406-EventThread] zookeeper.ZKWatcher(541): replicationLogCleaner-0x16391092ecc000f connected 2018-05-24 15:24:59,498 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:59,500 INFO [RS:2;zhangduo-ubuntu:42271] zookeeper.ReadOnlyZKClient(139): Connect 0x382bdaa4 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:59,500 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:59,500 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(47): Procedure flush-table-proc initialized 2018-05-24 15:24:59,500 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initializing 2018-05-24 15:24:59,506 INFO [RS:0;zhangduo-ubuntu:34061] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce1e6d8 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:59,511 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(47): Procedure online-snapshot initialized 2018-05-24 15:24:59,518 INFO [RS:1;zhangduo-ubuntu:37499] zookeeper.ReadOnlyZKClient(139): Connect 0x6e960057 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:24:59,522 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38de659c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:59,522 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ddcece3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:59,522 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:0;zhangduo-ubuntu:34061 2018-05-24 15:24:59,523 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:59,524 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:59,522 DEBUG [RS:2;zhangduo-ubuntu:42271] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36ec23d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:59,524 DEBUG [RS:2;zhangduo-ubuntu:42271] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32d3b1d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:59,524 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:2;zhangduo-ubuntu:42271 2018-05-24 15:24:59,524 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:59,524 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:59,526 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,39993,1527146698913 with port=34061, startcode=1527146698952 2018-05-24 15:24:59,527 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,39993,1527146698913 with port=42271, startcode=1527146699039 2018-05-24 15:24:59,536 DEBUG [RS:1;zhangduo-ubuntu:37499] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6051f3f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:24:59,538 DEBUG [RS:1;zhangduo-ubuntu:37499] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@646e6b27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:24:59,538 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:24:59,538 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.ShutdownHook(88): Installed shutdown hook thread: Shutdownhook:RS:1;zhangduo-ubuntu:37499 2018-05-24 15:24:59,538 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:24:59,538 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.RegionServerCoprocessorHost(67): System coprocessor loading is enabled 2018-05-24 15:24:59,542 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.RegionServerCoprocessorHost(68): Table coprocessor loading is enabled 2018-05-24 15:24:59,542 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:24:59,544 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(2602): reportForDuty to master=zhangduo-ubuntu,39993,1527146698913 with port=37499, startcode=1527146699007 2018-05-24 15:24:59,552 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.5 (auth:SIMPLE) 2018-05-24 15:24:59,553 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 35871 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:59,553 DEBUG [WALProcedureStoreSyncThread] wal.WALProcedureStore(1078): Roll new state log: 2 2018-05-24 15:24:59,553 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.3 (auth:SIMPLE) 2018-05-24 15:24:59,553 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 52097 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:59,555 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,567 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d 2018-05-24 15:24:59,567 INFO [RS-EventLoopGroup-8-4] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.4 (auth:SIMPLE) 2018-05-24 15:24:59,567 INFO [RS-EventLoopGroup-8-4] ipc.ServerRpcConnection(558): Connection from 127.0.1.1 port: 34997 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:24:59,568 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,568 INFO [WALProcedureStoreSyncThread] wal.ProcedureWALFile(163): Archiving hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/MasterProcWALs/pv2-00000000000000000001.log to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs/pv2-00000000000000000001.log 2018-05-24 15:24:59,568 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d 2018-05-24 15:24:59,572 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:38079 2018-05-24 15:24:59,572 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:59,572 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:38079 2018-05-24 15:24:59,572 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:59,573 INFO [WALProcedureStoreSyncThread] wal.WALProcedureStore(1171): Removed log=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/MasterProcWALs/pv2-00000000000000000001.log, activeLogs=[hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/MasterProcWALs/pv2-00000000000000000002.log] 2018-05-24 15:24:59,574 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.ServerManager(428): Registering regionserver=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,575 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:24:59,575 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1506): Config from master: hbase.rootdir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d 2018-05-24 15:24:59,575 DEBUG [RS:2;zhangduo-ubuntu:42271] zookeeper.ZKUtil(355): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,576 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1506): Config from master: fs.defaultFS=hdfs://localhost:38079 2018-05-24 15:24:59,577 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1506): Config from master: hbase.master.info.port=-1 2018-05-24 15:24:59,577 DEBUG [RS:1;zhangduo-ubuntu:37499] zookeeper.ZKUtil(355): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,577 WARN [RS:1;zhangduo-ubuntu:37499] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:59,577 INFO [RS:1;zhangduo-ubuntu:37499] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:59,577 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,577 WARN [RS:2;zhangduo-ubuntu:42271] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:59,577 INFO [RS:2;zhangduo-ubuntu:42271] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:59,577 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1815): logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,577 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1815): logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,578 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,578 DEBUG [RS:0;zhangduo-ubuntu:34061] zookeeper.ZKUtil(355): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,578 WARN [RS:0;zhangduo-ubuntu:34061] hbase.ZNodeClearer(63): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2018-05-24 15:24:59,578 INFO [RS:0;zhangduo-ubuntu:34061] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:24:59,579 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1815): logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,593 INFO [Thread-406] master.ServerManager(887): Finished waiting on RegionServer count=3; waited=101ms, expected min=3 server(s), max=3 server(s), master is running 2018-05-24 15:24:59,593 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:24:59,594 DEBUG [RS:2;zhangduo-ubuntu:42271] zookeeper.ZKUtil(355): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,594 DEBUG [RS:0;zhangduo-ubuntu:34061] zookeeper.ZKUtil(355): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,595 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,595 DEBUG [RS:2;zhangduo-ubuntu:42271] zookeeper.ZKUtil(355): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,595 DEBUG [RS:0;zhangduo-ubuntu:34061] zookeeper.ZKUtil(355): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,595 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,595 DEBUG [RS:1;zhangduo-ubuntu:37499] zookeeper.ZKUtil(355): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,595 DEBUG [RS:0;zhangduo-ubuntu:34061] zookeeper.ZKUtil(355): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,595 DEBUG [RS:2;zhangduo-ubuntu:42271] zookeeper.ZKUtil(355): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,595 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,596 DEBUG [RS:1;zhangduo-ubuntu:37499] zookeeper.ZKUtil(355): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,598 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:59,598 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:59,598 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:59,598 DEBUG [RS:1;zhangduo-ubuntu:37499] zookeeper.ZKUtil(355): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,600 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:59,600 INFO [RS:0;zhangduo-ubuntu:34061] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:59,598 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:59,603 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:59,604 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:59,605 INFO [RS:2;zhangduo-ubuntu:42271] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:59,605 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:59,607 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,608 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,609 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,609 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.Replication(144): Replication stats-in-log period=5 seconds 2018-05-24 15:24:59,609 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.MetricsRegionServerWrapperImpl(144): Computing regionserver metrics every 5000 milliseconds 2018-05-24 15:24:59,609 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,610 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,610 DEBUG [RS:0;zhangduo-ubuntu:34061] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,610 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,610 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,610 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,611 DEBUG [RS:2;zhangduo-ubuntu:42271] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,611 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.MemStoreFlusher(133): globalMemStoreLimit=707.6 M, globalMemStoreLimitLowMark=672.2 M, Offheap=false 2018-05-24 15:24:59,612 INFO [RS:1;zhangduo-ubuntu:37499] throttle.PressureAwareCompactionThroughputController(134): Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-24 15:24:59,612 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer$CompactionChecker(1706): CompactionChecker runs every PT0.1S 2018-05-24 15:24:59,630 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_OPEN_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_CLOSE_META-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,642 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,643 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/zhangduo-ubuntu:0, corePoolSize=10, maxPoolSize=10 2018-05-24 15:24:59,643 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/zhangduo-ubuntu:0, corePoolSize=3, maxPoolSize=3 2018-05-24 15:24:59,643 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0, corePoolSize=2, maxPoolSize=2 2018-05-24 15:24:59,643 DEBUG [RS:1;zhangduo-ubuntu:37499] executor.ExecutorService(92): Starting executor service name=RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0, corePoolSize=1, maxPoolSize=1 2018-05-24 15:24:59,643 INFO [SplitLogWorker-zhangduo-ubuntu:42271] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,42271,1527146699039 starting 2018-05-24 15:24:59,650 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:59,650 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,42271,1527146699039, RpcServer on zhangduo-ubuntu/127.0.1.1:42271, sessionid=0x16391092ecc000d 2018-05-24 15:24:59,651 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:59,651 DEBUG [RS:2;zhangduo-ubuntu:42271] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,651 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,42271,1527146699039' 2018-05-24 15:24:59,651 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/flush-table-proc/abort' 2018-05-24 15:24:59,653 INFO [SplitLogWorker-zhangduo-ubuntu:34061] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,34061,1527146698952 starting 2018-05-24 15:24:59,653 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/flush-table-proc/acquired' 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,42271,1527146699039' 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/online-snapshot/abort' 2018-05-24 15:24:59,659 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/online-snapshot/acquired' 2018-05-24 15:24:59,660 DEBUG [RS:2;zhangduo-ubuntu:42271] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:59,660 INFO [RS:2;zhangduo-ubuntu:42271] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:59,660 INFO [RS:2;zhangduo-ubuntu:42271] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:59,669 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HeapMemoryManager(210): Starting, tuneOn=false 2018-05-24 15:24:59,669 INFO [SplitLogWorker-zhangduo-ubuntu:37499] regionserver.SplitLogWorker(211): SplitLogWorker zhangduo-ubuntu,37499,1527146699007 starting 2018-05-24 15:24:59,673 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,34061,1527146698952, RpcServer on zhangduo-ubuntu/127.0.1.1:34061, sessionid=0x16391092ecc000b 2018-05-24 15:24:59,673 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:59,673 DEBUG [RS:0;zhangduo-ubuntu:34061] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,673 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,34061,1527146698952' 2018-05-24 15:24:59,673 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/flush-table-proc/abort' 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/flush-table-proc/acquired' 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,34061,1527146698952' 2018-05-24 15:24:59,674 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/online-snapshot/abort' 2018-05-24 15:24:59,675 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/online-snapshot/acquired' 2018-05-24 15:24:59,675 DEBUG [RS:0;zhangduo-ubuntu:34061] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:59,675 INFO [RS:0;zhangduo-ubuntu:34061] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:59,675 INFO [RS:0;zhangduo-ubuntu:34061] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:59,683 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1547): Serving as zhangduo-ubuntu,37499,1527146699007, RpcServer on zhangduo-ubuntu/127.0.1.1:37499, sessionid=0x16391092ecc000c 2018-05-24 15:24:59,683 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc starting 2018-05-24 15:24:59,683 DEBUG [RS:1;zhangduo-ubuntu:37499] flush.RegionServerFlushTableProcedureManager(104): Start region server flush procedure manager zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,683 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,37499,1527146699007' 2018-05-24 15:24:59,683 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/flush-table-proc/abort' 2018-05-24 15:24:59,683 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/flush-table-proc/acquired' 2018-05-24 15:24:59,684 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(55): Procedure flush-table-proc started 2018-05-24 15:24:59,684 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot starting 2018-05-24 15:24:59,684 DEBUG [RS:1;zhangduo-ubuntu:37499] snapshot.RegionServerSnapshotManager(124): Start Snapshot Manager zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:24:59,684 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'zhangduo-ubuntu,37499,1527146699007' 2018-05-24 15:24:59,684 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(135): Checking for aborted procedures on node: '/cluster2/online-snapshot/abort' 2018-05-24 15:24:59,685 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.ZKProcedureMemberRpcs(155): Looking for new procedures under znode:'/cluster2/online-snapshot/acquired' 2018-05-24 15:24:59,685 DEBUG [RS:1;zhangduo-ubuntu:37499] procedure.RegionServerProcedureManagerHost(55): Procedure online-snapshot started 2018-05-24 15:24:59,685 INFO [RS:1;zhangduo-ubuntu:37499] quotas.RegionServerRpcQuotaManager(62): Quota support disabled 2018-05-24 15:24:59,685 INFO [RS:1;zhangduo-ubuntu:37499] quotas.RegionServerSpaceQuotaManager(84): Quota support disabled, not starting space quota manager. 2018-05-24 15:24:59,717 DEBUG [Thread-406] procedure2.ProcedureExecutor(884): Stored pid=1, state=RUNNABLE:RECOVER_META_PREPARE; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2018-05-24 15:24:59,734 INFO [PEWorker-1] procedure.RecoverMetaProcedure(125): Start pid=1, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=null, splitWal=true 2018-05-24 15:24:59,735 DEBUG [PEWorker-1] zookeeper.ZKUtil(614): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Unable to get data of znode /cluster2/meta-region-server because node does not exist (not an error) 2018-05-24 15:24:59,737 DEBUG [PEWorker-1] master.MasterWalManager(169): No log files to split, proceeding... 2018-05-24 15:24:59,757 DEBUG [PEWorker-1] zookeeper.ZKUtil(614): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Unable to get data of znode /cluster2/meta-region-server because node does not exist (not an error) 2018-05-24 15:24:59,757 INFO [PEWorker-1] procedure.RecoverMetaProcedure(157): pid=1, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=null, splitWal=true; Retaining meta assignment to server=null 2018-05-24 15:24:59,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740}] 2018-05-24 15:24:59,769 INFO [PEWorker-1] procedure.MasterProcedureScheduler(640): pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740 checking lock on 1588230740 2018-05-24 15:24:59,769 INFO [PEWorker-1] assignment.AssignProcedure(218): Starting pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=null; forceNewPlan=false, retain=false 2018-05-24 15:24:59,919 DEBUG [master/zhangduo-ubuntu:0] assignment.AssignmentManager(1774): Processing assignQueue; systemServersCount=3, allServersCount=3 2018-05-24 15:24:59,920 DEBUG [master/zhangduo-ubuntu:0] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region hbase:meta,,1.1588230740 2018-05-24 15:24:59,925 INFO [PEWorker-3] assignment.AssignProcedure(246): Early suspend! pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,212 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:00,212 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:00,665 WARN [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:00,665 INFO [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C42271%2C1527146699039, suffix=, logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039, archiveDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:25:00,675 DEBUG [RS-EventLoopGroup-11-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:00,675 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK] 2018-05-24 15:25:00,680 DEBUG [RS-EventLoopGroup-11-6] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK] 2018-05-24 15:25:00,683 WARN [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:00,683 INFO [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C34061%2C1527146698952, suffix=, logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952, archiveDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:25:00,703 DEBUG [RS-EventLoopGroup-11-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK] 2018-05-24 15:25:00,704 WARN [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:00,704 INFO [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C37499%2C1527146699007, suffix=, logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007, archiveDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:25:00,704 DEBUG [RS-EventLoopGroup-11-6] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:00,705 DEBUG [RS-EventLoopGroup-11-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK] 2018-05-24 15:25:00,714 INFO [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 2018-05-24 15:25:00,715 DEBUG [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK]] 2018-05-24 15:25:00,718 INFO [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 2018-05-24 15:25:00,722 INFO [PEWorker-4] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,723 DEBUG [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK], DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK]] 2018-05-24 15:25:00,723 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(466): META region location doesn't exist, create it 2018-05-24 15:25:00,725 INFO [PEWorker-4] assignment.RegionTransitionProcedure(251): Dispatch pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,735 DEBUG [RS-EventLoopGroup-11-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK] 2018-05-24 15:25:00,735 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK] 2018-05-24 15:25:00,735 DEBUG [RS-EventLoopGroup-11-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:00,749 INFO [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 2018-05-24 15:25:00,751 DEBUG [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK], DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK]] 2018-05-24 15:25:00,876 DEBUG [RSProcedureDispatcher-pool13-t1] master.ServerManager(779): New admin connection to zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,882 INFO [RS-EventLoopGroup-11-6] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:00,882 INFO [RS-EventLoopGroup-11-6] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46128 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:00,883 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=42271] regionserver.RSRpcServices(1983): Open hbase:meta,,1.1588230740 2018-05-24 15:25:00,884 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:25:00,887 WARN [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:00,887 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C42271%2C1527146699039.meta, suffix=.meta, logDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039, archiveDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:25:00,893 DEBUG [RS-EventLoopGroup-11-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK] 2018-05-24 15:25:00,893 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK] 2018-05-24 15:25:00,894 DEBUG [RS-EventLoopGroup-11-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:00,901 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.meta.1527146700888.meta 2018-05-24 15:25:00,901 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK], DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK]] 2018-05-24 15:25:00,902 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:00,902 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(200): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-24 15:25:00,902 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(8081): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-24 15:25:00,904 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.RegionCoprocessorHost(394): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-24 15:25:00,904 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-24 15:25:00,904 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:00,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/info 2018-05-24 15:25:00,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/info 2018-05-24 15:25:00,909 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:00,910 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:00,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:00,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:25:00,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:25:00,913 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:00,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:00,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:00,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/table 2018-05-24 15:25:00,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/table 2018-05-24 15:25:00,916 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:00,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:00,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:00,920 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740 2018-05-24 15:25:00,923 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7M)) instead. 2018-05-24 15:25:00,925 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 1588230740; next sequenceid=2 2018-05-24 15:25:00,927 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-24 15:25:00,932 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,933 DEBUG [PEWorker-5] assignment.RegionTransitionProcedure(363): Finishing pid=2, ppid=1, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,934 INFO [PEWorker-5] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,934 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-24 15:25:00,937 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:meta,,1.1588230740 on zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:00,938 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster2/meta-region-server 2018-05-24 15:25:00,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=1, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=null, splitWal=true; resume parent processing. 2018-05-24 15:25:00,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=2, ppid=1, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740 in 1.1810sec 2018-05-24 15:25:01,073 INFO [PEWorker-6] procedure2.ProcedureExecutor(1265): Finished pid=1, state=SUCCESS; RecoverMetaProcedure failedMetaServer=null, splitWal=true in 1.3660sec 2018-05-24 15:25:01,074 INFO [Thread-406] master.HMaster(3602): hbase:meta deployed at=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:01,079 INFO [RS-EventLoopGroup-11-6] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:01,079 INFO [RS-EventLoopGroup-11-6] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46136 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:01,090 INFO [Thread-406] master.MasterWalManager(189): Log folder hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952 belongs to an existing region server 2018-05-24 15:25:01,091 INFO [Thread-406] master.MasterWalManager(189): Log folder hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007 belongs to an existing region server 2018-05-24 15:25:01,092 INFO [Thread-406] master.MasterWalManager(189): Log folder hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039 belongs to an existing region server 2018-05-24 15:25:01,092 DEBUG [Thread-406] assignment.AssignmentManager(1209): Joining cluster... 2018-05-24 15:25:01,095 INFO [Thread-406] assignment.AssignmentManager(1220): Number of RegionServers=3 2018-05-24 15:25:01,095 INFO [Thread-406] procedure2.TimeoutExecutorThread(82): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=5000, timestamp=1527146706095 2018-05-24 15:25:01,095 INFO [Thread-406] assignment.AssignmentManager(1227): Joined the cluster in 3msec, failover=true 2018-05-24 15:25:01,100 INFO [Thread-406] master.TableNamespaceManager(96): Namespace table not found. Creating... 2018-05-24 15:25:01,100 INFO [Thread-406] master.HMaster(1812): Client=null/null create 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} 2018-05-24 15:25:01,212 DEBUG [Thread-406] procedure2.ProcedureExecutor(884): Stored pid=3, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2018-05-24 15:25:01,285 WARN [IPC Server handler 1 on 38079] blockmanagement.BlockPlacementPolicyDefault(385): Failed to place enough replicas, still in need of 1 to reach 3 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy 2018-05-24 15:25:01,286 WARN [IPC Server handler 1 on 38079] protocol.BlockStoragePolicy(160): Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=3, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}) 2018-05-24 15:25:01,286 WARN [IPC Server handler 1 on 38079] blockmanagement.BlockPlacementPolicyDefault(385): Failed to place enough replicas, still in need of 1 to reach 3 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]} 2018-05-24 15:25:01,305 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741835_1011{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 476 2018-05-24 15:25:01,305 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741835_1011 size 476 2018-05-24 15:25:01,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:25:01,711 DEBUG [PEWorker-7] util.FSTableDescriptors(683): Wrote into hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2018-05-24 15:25:01,714 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(6928): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', VERSIONS => '10', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'true', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '8192'} RootDir = hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/.tmp Table name == hbase:namespace 2018-05-24 15:25:01,743 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:25:01,745 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:25:01,745 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|FINALIZED], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:25:01,748 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(828): Instantiated hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:01,749 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1515): Closing d77868aa490028a29e5134871d432554, disabling compactions & flushes 2018-05-24 15:25:01,749 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1555): Updates disabled for region hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:01,749 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1669): Closed hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:01,769 DEBUG [PEWorker-7] hbase.MetaTableAccessor(2145): Put {"totalColumns":2,"row":"hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":1527146701769},{"qualifier":"state","vlen":6,"tag":[],"timestamp":1527146701769}]},"ts":1527146701769} 2018-05-24 15:25:01,777 INFO [PEWorker-7] hbase.MetaTableAccessor(1520): Added 1 regions to meta. 2018-05-24 15:25:01,788 DEBUG [PEWorker-7] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146701788}]},"ts":1527146701788} 2018-05-24 15:25:01,791 INFO [PEWorker-7] hbase.MetaTableAccessor(1665): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2018-05-24 15:25:01,796 DEBUG [PEWorker-7] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:01,810 INFO [PEWorker-7] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039}] 2018-05-24 15:25:01,827 INFO [PEWorker-9] procedure.MasterProcedureScheduler(640): pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039 checking lock on d77868aa490028a29e5134871d432554 2018-05-24 15:25:01,831 INFO [PEWorker-9] assignment.AssignProcedure(218): Starting pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039; rit=OFFLINE, location=zhangduo-ubuntu,42271,1527146699039; forceNewPlan=false, retain=false 2018-05-24 15:25:01,984 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 1 retained the pre-restart assignment. 2018-05-24 15:25:01,985 INFO [PEWorker-8] assignment.RegionStateStore(197): pid=4 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=OPENING, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:01,990 INFO [PEWorker-8] assignment.RegionTransitionProcedure(251): Dispatch pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:02,142 INFO [RpcServer.priority.FPBQ.Fifo.handler=4,queue=0,port=42271] regionserver.RSRpcServices(1983): Open hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:02,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => d77868aa490028a29e5134871d432554, NAME => 'hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:02,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table namespace d77868aa490028a29e5134871d432554 2018-05-24 15:25:02,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:02,166 DEBUG [StoreOpener-d77868aa490028a29e5134871d432554-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info 2018-05-24 15:25:02,166 DEBUG [StoreOpener-d77868aa490028a29e5134871d432554-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info 2018-05-24 15:25:02,166 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:02,166 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:02,167 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:02,170 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554 2018-05-24 15:25:02,183 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:25:02,184 INFO [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened d77868aa490028a29e5134871d432554; next sequenceid=2 2018-05-24 15:25:02,187 INFO [PostOpenDeployTasks:d77868aa490028a29e5134871d432554] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:02,190 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:02,190 DEBUG [PEWorker-10] assignment.RegionTransitionProcedure(363): Finishing pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:02,191 INFO [PEWorker-10] assignment.RegionStateStore(197): pid=4 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=OPEN, openSeqNum=2, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:02,191 DEBUG [PostOpenDeployTasks:d77868aa490028a29e5134871d432554] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:25:02,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. on zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:02,227 INFO [PEWorker-10] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=3, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=hbase:namespace; resume parent processing. 2018-05-24 15:25:02,227 INFO [PEWorker-10] procedure2.ProcedureExecutor(1265): Finished pid=4, ppid=3, state=SUCCESS; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,42271,1527146699039 in 386msec 2018-05-24 15:25:02,227 DEBUG [PEWorker-10] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146702227}]},"ts":1527146702227} 2018-05-24 15:25:02,230 INFO [PEWorker-10] hbase.MetaTableAccessor(1665): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2018-05-24 15:25:02,271 INFO [PEWorker-10] procedure2.ProcedureExecutor(1265): Finished pid=3, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.1520sec 2018-05-24 15:25:02,331 DEBUG [Thread-406] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/namespace 2018-05-24 15:25:02,332 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/cluster2/namespace 2018-05-24 15:25:02,372 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(135): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-24 15:25:02,373 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(139): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-24 15:25:02,448 DEBUG [Thread-406] procedure2.ProcedureExecutor(884): Stored pid=5, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2018-05-24 15:25:02,505 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/namespace 2018-05-24 15:25:02,537 INFO [PEWorker-12] procedure2.ProcedureExecutor(1265): Finished pid=5, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 189msec 2018-05-24 15:25:02,657 DEBUG [Thread-406] procedure2.ProcedureExecutor(884): Stored pid=6, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2018-05-24 15:25:02,700 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/namespace 2018-05-24 15:25:02,724 INFO [PEWorker-13] procedure2.ProcedureExecutor(1265): Finished pid=6, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 168msec 2018-05-24 15:25:02,735 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster2/namespace/default 2018-05-24 15:25:02,737 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster2/namespace/hbase 2018-05-24 15:25:02,738 INFO [Thread-406] master.HMaster(963): Master has completed initialization 3.666sec 2018-05-24 15:25:02,738 INFO [Thread-406] quotas.MasterQuotaManager(90): Quota support disabled 2018-05-24 15:25:02,738 INFO [Thread-406] zookeeper.ZKWatcher(205): not a secure deployment, proceeding 2018-05-24 15:25:02,786 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(139): Connect 0x49ac7b18 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:02,795 DEBUG [Time-limited test] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58ecb8b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:02,803 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:02,803 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46154 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:02,807 INFO [Time-limited test] hbase.HBaseTestingUtility(1045): Minicluster is up; activeMaster=zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:25:02,819 INFO [RS-EventLoopGroup-1-5] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:02,819 INFO [RS-EventLoopGroup-1-5] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 34958 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:02,833 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.HMaster$3(1776): Client=zhangduo//127.0.0.1 create 'SyncRep', {NAME => 'cf', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '1', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2018-05-24 15:25:02,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] procedure2.ProcedureExecutor(884): Stored pid=7, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=SyncRep 2018-05-24 15:25:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,038 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:25:03,040 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:25:03,041 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741836_1012{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|FINALIZED], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|FINALIZED]]} size 0 2018-05-24 15:25:03,045 DEBUG [PEWorker-14] util.FSTableDescriptors(683): Wrote into hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/.tmp/data/default/SyncRep/.tabledesc/.tableinfo.0000000001 2018-05-24 15:25:03,051 INFO [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(6928): creating HRegion SyncRep HTD == 'SyncRep', {NAME => 'cf', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '1', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/.tmp Table name == SyncRep 2018-05-24 15:25:03,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,074 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:25:03,077 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741837_1013 size 42 2018-05-24 15:25:03,077 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741837_1013 size 42 2018-05-24 15:25:03,078 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(828): Instantiated SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:03,079 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1515): Closing 12bc853c9c26f021bc64e25ae2f0bff8, disabling compactions & flushes 2018-05-24 15:25:03,079 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,079 INFO [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1669): Closed SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,109 DEBUG [PEWorker-14] hbase.MetaTableAccessor(2145): Put {"totalColumns":2,"row":"SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":1527146703109},{"qualifier":"state","vlen":6,"tag":[],"timestamp":1527146703109}]},"ts":1527146703109} 2018-05-24 15:25:03,116 INFO [PEWorker-14] hbase.MetaTableAccessor(1520): Added 1 regions to meta. 2018-05-24 15:25:03,127 DEBUG [PEWorker-14] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"SyncRep","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146703127}]},"ts":1527146703127} 2018-05-24 15:25:03,130 INFO [PEWorker-14] hbase.MetaTableAccessor(1665): Updated tableName=SyncRep, state=ENABLING in hbase:meta 2018-05-24 15:25:03,133 DEBUG [PEWorker-14] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,138 INFO [PEWorker-14] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:03,152 INFO [PEWorker-15] procedure.MasterProcedureScheduler(640): pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:03,154 INFO [PEWorker-15] assignment.AssignProcedure(218): Starting pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OFFLINE, location=zhangduo-ubuntu,39191,1527146693279; forceNewPlan=false, retain=false 2018-05-24 15:25:03,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,307 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 1 retained the pre-restart assignment. 2018-05-24 15:25:03,309 INFO [PEWorker-16] assignment.RegionStateStore(197): pid=8 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=OPENING, regionLocation=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,313 INFO [PEWorker-16] assignment.RegionTransitionProcedure(251): Dispatch pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,467 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39191] regionserver.RSRpcServices(1983): Open SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,474 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 12bc853c9c26f021bc64e25ae2f0bff8, NAME => 'SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:03,474 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table SyncRep 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:03,474 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:03,479 DEBUG [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/cf 2018-05-24 15:25:03,479 DEBUG [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/cf 2018-05-24 15:25:03,484 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] hfile.CacheConfig(239): Created cacheConfig for cf: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:03,484 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:03,485 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] regionserver.HStore(327): Store=cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:03,487 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:03,495 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:25:03,495 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 12bc853c9c26f021bc64e25ae2f0bff8; next sequenceid=2 2018-05-24 15:25:03,498 INFO [PostOpenDeployTasks:12bc853c9c26f021bc64e25ae2f0bff8] regionserver.HRegionServer(2188): Post open deploy tasks for SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,501 DEBUG [PEWorker-1] assignment.RegionTransitionProcedure(363): Finishing pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,502 DEBUG [PostOpenDeployTasks:12bc853c9c26f021bc64e25ae2f0bff8] regionserver.HRegionServer(2212): Finished post open deploy task for SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:03,502 INFO [PEWorker-1] assignment.RegionStateStore(197): pid=8 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=OPEN, repBarrier=2, openSeqNum=2, regionLocation=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,503 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. on zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:03,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=7, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=SyncRep; resume parent processing. 2018-05-24 15:25:03,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=8, ppid=7, state=SUCCESS; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279 in 369msec 2018-05-24 15:25:03,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"SyncRep","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146703529}]},"ts":1527146703529} 2018-05-24 15:25:03,533 INFO [PEWorker-2] hbase.MetaTableAccessor(1665): Updated tableName=SyncRep, state=ENABLED in hbase:meta 2018-05-24 15:25:03,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=7, state=SUCCESS; CreateTableProcedure table=SyncRep in 715msec 2018-05-24 15:25:03,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,577 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3647): Operation: CREATE, Table Name: default:SyncRep completed 2018-05-24 15:25:03,581 INFO [RS-EventLoopGroup-8-5] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:03,585 INFO [RS-EventLoopGroup-8-5] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 45606 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:03,590 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.HMaster$3(1776): Client=zhangduo//127.0.0.1 create 'SyncRep', {NAME => 'cf', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '1', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2018-05-24 15:25:03,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] procedure2.ProcedureExecutor(884): Stored pid=7, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=SyncRep 2018-05-24 15:25:03,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,733 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:25:03,737 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:25:03,737 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741837_1013{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|FINALIZED], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:25:03,741 DEBUG [PEWorker-14] util.FSTableDescriptors(683): Wrote into hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/.tmp/data/default/SyncRep/.tabledesc/.tableinfo.0000000001 2018-05-24 15:25:03,742 INFO [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(6928): creating HRegion SyncRep HTD == 'SyncRep', {NAME => 'cf', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '1', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} RootDir = hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/.tmp Table name == SyncRep 2018-05-24 15:25:03,756 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|FINALIZED]]} size 0 2018-05-24 15:25:03,756 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|FINALIZED]]} size 0 2018-05-24 15:25:03,758 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741838_1014 size 42 2018-05-24 15:25:03,759 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(828): Instantiated SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:03,760 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1515): Closing 338f611b3d7ef43c4ac40748d46eac23, disabling compactions & flushes 2018-05-24 15:25:03,760 DEBUG [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:03,760 INFO [RegionOpenAndInitThread-SyncRep-1] regionserver.HRegion(1669): Closed SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:03,779 DEBUG [PEWorker-14] hbase.MetaTableAccessor(2145): Put {"totalColumns":2,"row":"SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":1527146703779},{"qualifier":"state","vlen":6,"tag":[],"timestamp":1527146703779}]},"ts":1527146703779} 2018-05-24 15:25:03,783 INFO [PEWorker-14] hbase.MetaTableAccessor(1520): Added 1 regions to meta. 2018-05-24 15:25:03,794 DEBUG [PEWorker-14] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"SyncRep","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146703794}]},"ts":1527146703794} 2018-05-24 15:25:03,798 INFO [PEWorker-14] hbase.MetaTableAccessor(1665): Updated tableName=SyncRep, state=ENABLING in hbase:meta 2018-05-24 15:25:03,802 DEBUG [PEWorker-14] balancer.RegionLocationFinder(280): HDFSBlocksDistribution not found in cache for region SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:03,806 INFO [PEWorker-14] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039}] 2018-05-24 15:25:03,812 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1d5e5bc6] blockmanagement.BlockManager(1567): BLOCK* ask 127.0.0.1:39253 to replicate blk_1073741835_1011 to datanode(s) 127.0.0.1:34351 2018-05-24 15:25:03,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:03,821 INFO [PEWorker-15] procedure.MasterProcedureScheduler(640): pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039 checking lock on 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:25:03,823 INFO [PEWorker-15] assignment.AssignProcedure(218): Starting pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039; rit=OFFLINE, location=zhangduo-ubuntu,42271,1527146699039; forceNewPlan=false, retain=false 2018-05-24 15:25:03,975 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 1 retained the pre-restart assignment. 2018-05-24 15:25:03,977 INFO [PEWorker-16] assignment.RegionStateStore(197): pid=8 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=OPENING, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:03,980 INFO [PEWorker-16] assignment.RegionTransitionProcedure(251): Dispatch pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:04,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:04,131 INFO [RpcServer.priority.FPBQ.Fifo.handler=4,queue=0,port=42271] regionserver.RSRpcServices(1983): Open SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:04,137 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 338f611b3d7ef43c4ac40748d46eac23, NAME => 'SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:04,138 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table SyncRep 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:25:04,138 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:04,142 DEBUG [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf 2018-05-24 15:25:04,143 DEBUG [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf 2018-05-24 15:25:04,143 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] hfile.CacheConfig(239): Created cacheConfig for cf: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:04,144 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:04,145 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] regionserver.HStore(327): Store=cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:04,148 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:25:04,153 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2018-05-24 15:25:04,154 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 338f611b3d7ef43c4ac40748d46eac23; next sequenceid=2 2018-05-24 15:25:04,155 INFO [PostOpenDeployTasks:338f611b3d7ef43c4ac40748d46eac23] regionserver.HRegionServer(2188): Post open deploy tasks for SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:04,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=2, pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:04,158 DEBUG [PEWorker-2] assignment.RegionTransitionProcedure(363): Finishing pid=8, ppid=7, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039; rit=OPENING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:04,158 INFO [PEWorker-2] assignment.RegionStateStore(197): pid=8 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=OPEN, repBarrier=2, openSeqNum=2, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:04,158 DEBUG [PostOpenDeployTasks:338f611b3d7ef43c4ac40748d46eac23] regionserver.HRegionServer(2212): Finished post open deploy task for SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:25:04,160 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. on zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:25:04,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=7, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE; CreateTableProcedure table=SyncRep; resume parent processing. 2018-05-24 15:25:04,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=8, ppid=7, state=SUCCESS; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,42271,1527146699039 in 356msec 2018-05-24 15:25:04,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2145): Put {"totalColumns":1,"row":"SyncRep","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":1527146704185}]},"ts":1527146704185} 2018-05-24 15:25:04,188 INFO [PEWorker-1] hbase.MetaTableAccessor(1665): Updated tableName=SyncRep, state=ENABLED in hbase:meta 2018-05-24 15:25:04,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=7, state=SUCCESS; CreateTableProcedure table=SyncRep in 611msec 2018-05-24 15:25:04,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=7 2018-05-24 15:25:04,321 INFO [Time-limited test] client.HBaseAdmin$TableFuture(3647): Operation: CREATE, Table Name: default:SyncRep completed 2018-05-24 15:25:04,322 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:25:04,323 INFO [Time-limited test] fs.HFileSystem(348): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-24 15:25:04,337 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.HMaster(3426): Client=zhangduo//127.0.0.1 creating replication peer, id=1, config=clusterKey=localhost:59029:/cluster2,replicationEndpointImpl=null,replicateAllUserTables=false,tableCFs={SyncRep=null},bandwidth=0,serial=false,remoteWALDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs, state=ENABLED 2018-05-24 15:25:04,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] procedure2.ProcedureExecutor(884): Stored pid=9, state=RUNNABLE:PRE_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.AddPeerProcedure 2018-05-24 15:25:04,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:04,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=11, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=12, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:04,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:04,675 DEBUG [RSProcedureDispatcher-pool4-t5] master.ServerManager(779): New admin connection to zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:04,681 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:04,681 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:04,681 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:04,682 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 56662 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:04,684 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:04,724 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:04,724 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:04,729 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:04,758 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,39191,1527146693279 suceeded 2018-05-24 15:25:04,758 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,38897,1527146693212 suceeded 2018-05-24 15:25:04,761 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,46367,1527146693128 suceeded 2018-05-24 15:25:04,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:04,775 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=10, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 262msec 2018-05-24 15:25:04,775 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=11, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 262msec 2018-05-24 15:25:04,799 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x62bacbcc to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:04,801 INFO [PEWorker-10] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=9, state=RUNNABLE:POST_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.AddPeerProcedure; resume parent processing. 2018-05-24 15:25:04,801 INFO [PEWorker-10] procedure2.ProcedureExecutor(1265): Finished pid=12, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 264msec 2018-05-24 15:25:04,801 INFO [PEWorker-10] replication.AddPeerProcedure(101): Successfully added ENABLED peer 1, config clusterKey=localhost:59029:/cluster2,replicationEndpointImpl=null,replicateAllUserTables=false,tableCFs={SyncRep=null},bandwidth=0,serial=false,remoteWALDir=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs 2018-05-24 15:25:04,808 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x32f008e3 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:04,816 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@51c98b9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:04,816 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x6d1d8475 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:04,819 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:04,821 INFO [PEWorker-10] procedure2.ProcedureExecutor(1265): Finished pid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.AddPeerProcedure in 463msec 2018-05-24 15:25:04,824 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@5472a467, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:04,826 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:04,826 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@be2c212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:04,827 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:04,828 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:04,831 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0017 connected 2018-05-24 15:25:04,831 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:04,833 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C38897%2C1527146693212 2018-05-24 15:25:04,834 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:04,841 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:04,844 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0018 connected 2018-05-24 15:25:04,846 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:04,847 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C46367%2C1527146693128 2018-05-24 15:25:04,847 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:04,848 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:04,850 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0019 connected 2018-05-24 15:25:04,852 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:04,853 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C39191%2C1527146693279 2018-05-24 15:25:04,854 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:04,867 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741835_1011 size 476 2018-05-24 15:25:05,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:05,071 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.HMaster(3426): Client=zhangduo//127.0.0.1 creating replication peer, id=1, config=clusterKey=localhost:59029:/cluster1,replicationEndpointImpl=null,replicateAllUserTables=false,tableCFs={SyncRep=null},bandwidth=0,serial=false,remoteWALDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/remoteWALs, state=ENABLED 2018-05-24 15:25:05,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] procedure2.ProcedureExecutor(884): Stored pid=9, state=RUNNABLE:PRE_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.AddPeerProcedure 2018-05-24 15:25:05,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:05,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=11, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=12, ppid=9, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:05,397 DEBUG [RSProcedureDispatcher-pool13-t5] master.ServerManager(779): New admin connection to zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:25:05,397 DEBUG [RSProcedureDispatcher-pool13-t6] master.ServerManager(779): New admin connection to zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:25:05,398 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:05,400 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:05,401 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:05,402 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 39024 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:05,402 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 43984 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:05,403 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:05,404 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=ADD_PEER 2018-05-24 15:25:05,427 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:05,436 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:05,436 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:05,446 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:05,467 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:05,476 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for ADD on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:05,492 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=11, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 256msec 2018-05-24 15:25:05,500 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x2a80b27f to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:05,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:05,513 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x03f233b5 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:05,519 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@6503226, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:05,521 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:05,527 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:05,529 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc001b connected 2018-05-24 15:25:05,529 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:05,531 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C42271%2C1527146699039 2018-05-24 15:25:05,531 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:05,531 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@6e68a55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:05,532 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:05,537 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:05,539 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc001d connected 2018-05-24 15:25:05,539 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:05,540 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C37499%2C1527146699007 2018-05-24 15:25:05,540 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:05,563 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x3a220842 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:05,580 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@683ada56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:05,585 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:05,588 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:05,589 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc001f connected 2018-05-24 15:25:05,590 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:05,590 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C34061%2C1527146698952 2018-05-24 15:25:05,590 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:05,602 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:05,602 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:05,602 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:05,602 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=10, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 257msec 2018-05-24 15:25:05,633 INFO [PEWorker-8] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=9, state=RUNNABLE:POST_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.AddPeerProcedure; resume parent processing. 2018-05-24 15:25:05,633 INFO [PEWorker-11] replication.AddPeerProcedure(101): Successfully added ENABLED peer 1, config clusterKey=localhost:59029:/cluster1,replicationEndpointImpl=null,replicateAllUserTables=false,tableCFs={SyncRep=null},bandwidth=0,serial=false,remoteWALDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/remoteWALs 2018-05-24 15:25:05,633 INFO [PEWorker-8] procedure2.ProcedureExecutor(1265): Finished pid=12, ppid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 257msec 2018-05-24 15:25:05,643 INFO [PEWorker-11] procedure2.ProcedureExecutor(1265): Finished pid=9, state=SUCCESS; org.apache.hadoop.hbase.master.replication.AddPeerProcedure in 562msec 2018-05-24 15:25:05,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=9 2018-05-24 15:25:05,815 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.HMaster(3445): Client=zhangduo//127.0.0.1 disable replication peer, id=1 2018-05-24 15:25:05,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] procedure2.ProcedureExecutor(884): Stored pid=13, state=RUNNABLE:PRE_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure 2018-05-24 15:25:05,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:05,960 INFO [PEWorker-11] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=15, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=16, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:06,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,131 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,132 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,132 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,146 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,146 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,147 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,147 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C38897%2C1527146693212,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:06,155 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,155 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,155 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,165 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x62bacbcc to localhost:59029 2018-05-24 15:25:06,165 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,166 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C38897%2C1527146693212,1 terminated 2018-05-24 15:25:06,167 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,168 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,168 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,168 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,169 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x32f008e3 to localhost:59029 2018-05-24 15:25:06,172 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x6d1d8475 to localhost:59029 2018-05-24 15:25:06,172 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,172 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C39191%2C1527146693279,1 terminated 2018-05-24 15:25:06,172 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,175 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,38897,1527146693212 suceeded 2018-05-24 15:25:06,174 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,179 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C46367%2C1527146693128,1 terminated 2018-05-24 15:25:06,179 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,186 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,46367,1527146693128 suceeded 2018-05-24 15:25:06,202 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,39191,1527146693279 suceeded 2018-05-24 15:25:06,213 INFO [PEWorker-15] procedure2.ProcedureExecutor(1265): Finished pid=14, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 219msec 2018-05-24 15:25:06,226 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x75daa34b to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,229 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x0d9c3221 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,234 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@a47fc01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,235 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,234 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@1baabff5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,235 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,249 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,249 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x0e0fe6a7 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,251 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0022 connected 2018-05-24 15:25:06,252 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:06,253 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C39191%2C1527146693279 2018-05-24 15:25:06,254 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:06,254 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,254 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:06,256 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C38897%2C1527146693212 2018-05-24 15:25:06,263 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0023 connected 2018-05-24 15:25:06,265 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:06,272 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@2635abba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,272 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,283 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,284 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0025 connected 2018-05-24 15:25:06,285 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 200719f0-fbff-407a-971e-9e5afc318d6c -> 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 2018-05-24 15:25:06,285 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C46367%2C1527146693128 2018-05-24 15:25:06,285 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:06,325 INFO [PEWorker-16] procedure2.ProcedureExecutor(1265): Finished pid=16, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 238msec 2018-05-24 15:25:06,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=13, state=RUNNABLE:POST_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure; resume parent processing. 2018-05-24 15:25:06,347 INFO [PEWorker-2] replication.DisablePeerProcedure(67): Successfully disabled peer 1 2018-05-24 15:25:06,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=15, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 244msec 2018-05-24 15:25:06,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure in 532msec 2018-05-24 15:25:06,408 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:25:06,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,543 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.HMaster(3445): Client=zhangduo//127.0.0.1 disable replication peer, id=1 2018-05-24 15:25:06,542 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:06,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] procedure2.ProcedureExecutor(884): Stored pid=13, state=RUNNABLE:PRE_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure 2018-05-24 15:25:06,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,700 INFO [PEWorker-10] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=15, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=16, ppid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,868 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,868 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,869 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=DISABLE_PEER 2018-05-24 15:25:06,881 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,881 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,881 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,881 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,885 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,885 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,885 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:06,890 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(482): Terminate replication source for 1 2018-05-24 15:25:06,890 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Peer 1 state or config changed. Will close the previous replication source and open a new one 2018-05-24 15:25:06,897 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x2a80b27f to localhost:59029 2018-05-24 15:25:06,897 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,897 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x03f233b5 to localhost:59029 2018-05-24 15:25:06,900 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C42271%2C1527146699039,1 terminated 2018-05-24 15:25:06,900 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x3a220842 to localhost:59029 2018-05-24 15:25:06,900 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,900 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,900 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C34061%2C1527146698952,1 terminated 2018-05-24 15:25:06,904 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:06,905 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C37499%2C1527146699007,1 terminated 2018-05-24 15:25:06,905 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,904 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:06,904 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(489): Startup replication source for 1 2018-05-24 15:25:06,912 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:06,912 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for DISABLE on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:06,922 INFO [PEWorker-15] procedure2.ProcedureExecutor(1265): Finished pid=16, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 211msec 2018-05-24 15:25:06,951 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x15a007bb to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,956 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x396e206e to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,958 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@2aedb942, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,958 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:06,971 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x77648aa6 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:06,971 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,976 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0027 connected 2018-05-24 15:25:06,978 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:06,978 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@7338187a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,978 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,982 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C42271%2C1527146699039 2018-05-24 15:25:06,982 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:06,982 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@535e0040, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:06,983 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:06,984 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,985 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc002a connected 2018-05-24 15:25:06,986 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:06,988 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc002b connected 2018-05-24 15:25:06,989 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:06,989 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C34061%2C1527146698952 2018-05-24 15:25:06,989 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:06,989 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:06,990 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C37499%2C1527146699007 2018-05-24 15:25:06,990 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:07,033 INFO [PEWorker-16] procedure2.ProcedureExecutor(1265): Finished pid=15, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 218msec 2018-05-24 15:25:07,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=13, state=RUNNABLE:POST_PEER_MODIFICATION; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure; resume parent processing. 2018-05-24 15:25:07,157 INFO [PEWorker-1] replication.DisablePeerProcedure(67): Successfully disabled peer 1 2018-05-24 15:25:07,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=14, ppid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 218msec 2018-05-24 15:25:07,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.replication.DisablePeerProcedure in 614msec 2018-05-24 15:25:07,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=13 2018-05-24 15:25:07,279 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.HMaster(3491): Client=zhangduo//127.0.0.1 transit current cluster state to STANDBY in a synchronous replication peer id=1 2018-05-24 15:25:07,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] procedure2.ProcedureExecutor(884): Stored pid=17, state=RUNNABLE:PRE_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure 2018-05-24 15:25:07,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:07,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=18, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=19, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=20, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:07,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:07,588 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,588 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,588 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,590 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:07,590 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:07,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:07,607 INFO [PEWorker-6] procedure2.ProcedureExecutor(1265): Finished pid=20, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 174msec 2018-05-24 15:25:07,607 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=19, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 169msec 2018-05-24 15:25:07,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:07,719 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=20, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 174msec 2018-05-24 15:25:07,730 INFO [PEWorker-8] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=17, state=RUNNABLE:REMOVE_ALL_REPLICATION_QUEUES_IN_PEER; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:07,730 INFO [PEWorker-8] procedure2.ProcedureExecutor(1265): Finished pid=18, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 174msec 2018-05-24 15:25:07,731 DEBUG [PEWorker-11] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 2018-05-24 15:25:07,733 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 2018-05-24 15:25:07,733 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1 2018-05-24 15:25:07,733 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1 2018-05-24 15:25:07,735 DEBUG [PEWorker-11] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 2018-05-24 15:25:07,737 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 2018-05-24 15:25:07,737 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1 2018-05-24 15:25:07,737 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1 2018-05-24 15:25:07,739 DEBUG [PEWorker-11] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 2018-05-24 15:25:07,740 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 2018-05-24 15:25:07,740 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1 2018-05-24 15:25:07,740 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1 2018-05-24 15:25:07,767 INFO [PEWorker-11] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=22, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=23, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:07,930 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,930 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,930 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:07,969 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:07,969 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(422): Terminate replication source for 1 2018-05-24 15:25:07,969 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Sync replication peer 1 is transiting to STANDBY. Will close the previous replication source and open a new one 2018-05-24 15:25:07,969 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C42271%2C1527146699039,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:07,971 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C42271%2C1527146699039,1] replication.ReplicationUtils(234): Interrupted while sleeping between retries 2018-05-24 15:25:07,974 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:07,973 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(178): queueId=1, ReplicationSource : 1, currentBandwidth=0 2018-05-24 15:25:07,977 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(422): Terminate replication source for 1 2018-05-24 15:25:07,977 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Sync replication peer 1 is transiting to STANDBY. Will close the previous replication source and open a new one 2018-05-24 15:25:07,977 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(422): Terminate replication source for 1 2018-05-24 15:25:07,978 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C37499%2C1527146699007,1] replication.ReplicationUtils(234): Interrupted while sleeping between retries 2018-05-24 15:25:07,978 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C37499%2C1527146699007,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:07,978 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(481): Closing source 1 because: Sync replication peer 1 is transiting to STANDBY. Will close the previous replication source and open a new one 2018-05-24 15:25:07,979 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C34061%2C1527146698952,1] replication.ReplicationUtils(234): Interrupted while sleeping between retries 2018-05-24 15:25:07,979 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C34061%2C1527146698952,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:07,994 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x15a007bb to localhost:59029 2018-05-24 15:25:07,995 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:07,995 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x77648aa6 to localhost:59029 2018-05-24 15:25:07,995 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C42271%2C1527146699039,1 terminated 2018-05-24 15:25:07,995 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x396e206e to localhost:59029 2018-05-24 15:25:07,997 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:07,997 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C34061%2C1527146698952,1 terminated 2018-05-24 15:25:07,998 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(433): Startup replication source for 1 2018-05-24 15:25:07,997 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:07,999 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C37499%2C1527146699007,1 terminated 2018-05-24 15:25:07,999 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(433): Startup replication source for 1 2018-05-24 15:25:07,998 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(433): Startup replication source for 1 2018-05-24 15:25:08,015 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.RecoverableZooKeeper(176): Node /cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 already deleted, retry=false 2018-05-24 15:25:08,015 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] replication.ZKReplicationQueueStorage(200): /cluster2/replication/rs/zhangduo-ubuntu,34061,1527146698952/1/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 already deleted when removing log 2018-05-24 15:25:08,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:08,017 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(178): WAL roll requested 2018-05-24 15:25:08,024 DEBUG [RS-EventLoopGroup-11-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88,DISK] 2018-05-24 15:25:08,024 DEBUG [RS-EventLoopGroup-11-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK] 2018-05-24 15:25:08,025 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK] 2018-05-24 15:25:08,027 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.RecoverableZooKeeper(176): Node /cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 already deleted, retry=false 2018-05-24 15:25:08,027 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] replication.ZKReplicationQueueStorage(200): /cluster2/replication/rs/zhangduo-ubuntu,37499,1527146699007/1/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 already deleted when removing log 2018-05-24 15:25:08,027 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] zookeeper.RecoverableZooKeeper(176): Node /cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 already deleted, retry=false 2018-05-24 15:25:08,027 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] replication.ZKReplicationQueueStorage(200): /cluster2/replication/rs/zhangduo-ubuntu,42271,1527146699039/1/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 already deleted when removing log 2018-05-24 15:25:08,027 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(178): WAL roll requested 2018-05-24 15:25:08,033 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(178): WAL roll requested 2018-05-24 15:25:08,039 DEBUG [RS-EventLoopGroup-11-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK] 2018-05-24 15:25:08,040 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK] 2018-05-24 15:25:08,039 DEBUG [RS-EventLoopGroup-11-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:08,042 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK] 2018-05-24 15:25:08,042 DEBUG [RS-EventLoopGroup-11-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK] 2018-05-24 15:25:08,045 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK] 2018-05-24 15:25:08,045 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x06a8c374 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:08,048 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x49961abb to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:08,056 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.ReadOnlyZKClient(139): Connect 0x0a52ac6a to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:08,217 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@4d9a1c73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:08,217 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:08,217 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@21165a27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:08,218 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:08,218 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@4d00e075, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:08,219 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] zookeeper.RecoverableZooKeeper(106): Process identifier=connection to cluster: 1 connecting to ZooKeeper ensemble=localhost:59029 2018-05-24 15:25:08,311 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:08,311 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:08,312 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(478): connection to cluster: 10x0, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-24 15:25:08,312 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc002f connected 2018-05-24 15:25:08,314 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0030 connected 2018-05-24 15:25:08,315 DEBUG [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1-EventThread] zookeeper.ZKWatcher(541): connection to cluster: 1-0x16391092ecc0031 connected 2018-05-24 15:25:08,318 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:08,318 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:08,318 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(682): Rolled WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 with entries=0, filesize=83 B; new WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 2018-05-24 15:25:08,319 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C34061%2C1527146698952 2018-05-24 15:25:08,319 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:08,318 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(682): Rolled WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146700666 with entries=4, filesize=831 B; new WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 2018-05-24 15:25:08,319 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1] regionserver.ReplicationSource(448): Replicating 9f6978cd-8dfc-49c3-a3e3-7ddc9b0cd3d6 -> 200719f0-fbff-407a-971e-9e5afc318d6c 2018-05-24 15:25:08,323 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C42271%2C1527146699039 2018-05-24 15:25:08,324 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:08,325 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(682): Rolled WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 with entries=0, filesize=83 B; new WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 2018-05-24 15:25:08,325 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C37499%2C1527146699007 2018-05-24 15:25:08,325 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:08,326 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,326 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:08,326 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:08,326 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,326 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK], DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK]] 2018-05-24 15:25:08,326 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,327 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(663): Archiving hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 2018-05-24 15:25:08,332 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:08,333 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK], DatanodeInfoWithStorage[127.0.0.1:45001,DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4,DISK]] 2018-05-24 15:25:08,333 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45001,DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-85003ea0-aa94-4757-8e9e-555a470316f1,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-dc755e38-4b2d-4079-9d67-5bab8270103f,DISK]] 2018-05-24 15:25:08,333 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(663): Archiving hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs/zhangduo-ubuntu%2C34061%2C1527146698952.1527146700684 2018-05-24 15:25:08,340 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(874): complete file /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146700704 not finished, retry = 0 2018-05-24 15:25:08,340 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741833_1009{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 91 2018-05-24 15:25:08,340 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741833_1009 size 91 2018-05-24 15:25:08,340 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741833_1009 size 91 2018-05-24 15:25:08,342 DEBUG [RS-EventLoopGroup-11-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88,DISK] 2018-05-24 15:25:08,342 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK] 2018-05-24 15:25:08,342 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK] 2018-05-24 15:25:08,346 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(682): Rolled WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.meta.1527146700888.meta with entries=11, filesize=3.24 KB; new WAL /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.meta.1527146708333.meta 2018-05-24 15:25:08,347 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45001,DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88,DISK], DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK]] 2018-05-24 15:25:08,353 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,353 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,354 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741834_1010{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:25:08,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:08,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:08,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:08,453 INFO [PEWorker-13] procedure2.ProcedureExecutor(1265): Finished pid=21, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 655msec 2018-05-24 15:25:08,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:08,565 INFO [PEWorker-15] procedure2.ProcedureExecutor(1265): Finished pid=23, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 664msec 2018-05-24 15:25:08,696 INFO [PEWorker-16] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=17, state=RUNNABLE:CREATE_DIR_FOR_REMOTE_WAL; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:08,696 INFO [PEWorker-16] procedure2.ProcedureExecutor(1265): Finished pid=22, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 672msec 2018-05-24 15:25:08,708 INFO [PEWorker-2] replication.TransitPeerSyncReplicationStateProcedure(134): Successfully transit current cluster state from DOWNGRADE_ACTIVE to STANDBY for sync replication peer 1 2018-05-24 15:25:08,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure in 1.4270sec 2018-05-24 15:25:09,351 INFO [zhangduo-ubuntu:39191Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C39191%2C1527146693279]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 at position: -1 2018-05-24 15:25:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:09,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:09,525 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.HMaster(3491): Client=zhangduo//127.0.0.1 transit current cluster state to ACTIVE in a synchronous replication peer id=1 2018-05-24 15:25:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] procedure2.ProcedureExecutor(884): Stored pid=17, state=RUNNABLE:PRE_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure 2018-05-24 15:25:09,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:09,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=18, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=19, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=20, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:09,672 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:09,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:09,837 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:09,838 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,46367,1527146693128 suceeded 2018-05-24 15:25:09,838 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:09,841 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:09,843 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,38897,1527146693212 suceeded 2018-05-24 15:25:09,846 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,39191,1527146693279 suceeded 2018-05-24 15:25:09,853 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=20, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:09,965 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=18, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 178msec 2018-05-24 15:25:10,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=17, state=RUNNABLE:REOPEN_ALL_REGIONS_IN_PEER; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:10,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=19, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 181msec 2018-05-24 15:25:10,096 INFO [PEWorker-10] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:10,111 INFO [PEWorker-10] procedure.MasterProcedureScheduler(640): pid=21, ppid=17, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:10,112 INFO [PEWorker-10] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:10,128 INFO [PEWorker-10] procedure.MasterProcedureScheduler(640): pid=22, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:10,128 INFO [PEWorker-10] assignment.RegionStateStore(197): pid=22 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=CLOSING, regionLocation=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,132 INFO [PEWorker-10] assignment.RegionTransitionProcedure(251): Dispatch pid=22, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:10,286 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39191] regionserver.RSRpcServices(1607): Close 12bc853c9c26f021bc64e25ae2f0bff8, moving to zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,289 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 12bc853c9c26f021bc64e25ae2f0bff8, disabling compactions & flushes 2018-05-24 15:25:10,289 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,296 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2018-05-24 15:25:10,307 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,307 WARN [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionServer(3420): Not adding moved region record: 12bc853c9c26f021bc64e25ae2f0bff8 to self. 2018-05-24 15:25:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report CLOSED seqId=-1, pid=22, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,309 DEBUG [PEWorker-14] assignment.RegionTransitionProcedure(363): Finishing pid=22, ppid=21, state=RUNNABLE:REGION_TRANSITION_FINISH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,309 INFO [PEWorker-14] assignment.RegionStateStore(197): pid=22 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=CLOSED 2018-05-24 15:25:10,309 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,517 INFO [PEWorker-14] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=21, ppid=17, state=RUNNABLE:MOVE_REGION_ASSIGN; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279; resume parent processing. 2018-05-24 15:25:10,517 INFO [PEWorker-12] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:10,517 INFO [PEWorker-14] procedure2.ProcedureExecutor(1265): Finished pid=22, ppid=21, state=SUCCESS; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279 in 203msec 2018-05-24 15:25:10,568 INFO [PEWorker-12] procedure.MasterProcedureScheduler(640): pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:10,570 INFO [PEWorker-12] assignment.AssignProcedure(218): Starting pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OFFLINE, location=zhangduo-ubuntu,39191,1527146693279; forceNewPlan=false, retain=false 2018-05-24 15:25:10,722 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 1 retained the pre-restart assignment. 2018-05-24 15:25:10,723 INFO [PEWorker-16] assignment.RegionStateStore(197): pid=23 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=OPENING 2018-05-24 15:25:10,726 INFO [PEWorker-16] assignment.RegionTransitionProcedure(251): Dispatch pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:10,878 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39191] regionserver.RSRpcServices(1983): Open SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,888 WARN [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:10,888 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1, suffix=.syncrep, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:25:10,903 DEBUG [RS-EventLoopGroup-5-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:25:10,903 DEBUG [RS-EventLoopGroup-5-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK] 2018-05-24 15:25:10,904 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK] 2018-05-24 15:25:10,926 DEBUG [RS-EventLoopGroup-5-4] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45001,DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88,DISK] 2018-05-24 15:25:10,926 DEBUG [RS-EventLoopGroup-5-7] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39253,DS-3b396433-7c05-4241-ac25-f012e6c4eb69,DISK] 2018-05-24 15:25:10,930 DEBUG [RS-EventLoopGroup-5-5] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-b37460aa-1473-46d5-826f-abc526fd58b1,DISK] 2018-05-24 15:25:10,941 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceManager(753): Start tracking logs for wal group zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1 for peer 1 2018-05-24 15:25:10,941 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:10,944 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSource(305): Starting up worker for wal group zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1 2018-05-24 15:25:10,944 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.ReplicationSourceWALReader(113): peerClusterZnode=1, ReplicationSourceWALReaderThread : 1 inited, replicationBatchSizeCapacity=102400, replicationBatchCountCapacity=25000, replicationBatchQueueCapacity=1 2018-05-24 15:25:10,947 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] wal.AbstractFSWAL(775): Create new DualAsyncFSWALForTest writer with pipeline: [] 2018-05-24 15:25:10,948 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(7105): Opening region: {ENCODED => 12bc853c9c26f021bc64e25ae2f0bff8, NAME => 'SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:10,948 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table SyncRep 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:10,948 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(828): Instantiated SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:10,953 DEBUG [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/cf 2018-05-24 15:25:10,953 DEBUG [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8/cf 2018-05-24 15:25:10,953 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] hfile.CacheConfig(239): Created cacheConfig for cf: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:10,953 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:10,955 INFO [StoreOpener-12bc853c9c26f021bc64e25ae2f0bff8-1] regionserver.HStore(327): Store=cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:10,957 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/default/SyncRep/12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:10,960 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(976): Opened 12bc853c9c26f021bc64e25ae2f0bff8; next sequenceid=5 2018-05-24 15:25:10,962 INFO [PostOpenDeployTasks:12bc853c9c26f021bc64e25ae2f0bff8] regionserver.HRegionServer(2188): Post open deploy tasks for SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=5, pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,964 DEBUG [PEWorker-1] assignment.RegionTransitionProcedure(363): Finishing pid=23, ppid=21, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279; rit=OPENING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,964 DEBUG [PostOpenDeployTasks:12bc853c9c26f021bc64e25ae2f0bff8] regionserver.HRegionServer(2212): Finished post open deploy task for SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:10,964 INFO [PEWorker-1] assignment.RegionStateStore(197): pid=23 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=OPEN, repBarrier=5, openSeqNum=5, regionLocation=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,966 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1] handler.OpenRegionHandler(128): Opened SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. on zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:10,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=21, ppid=17, state=RUNNABLE; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279; resume parent processing. 2018-05-24 15:25:10,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=23, ppid=21, state=SUCCESS; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, target=zhangduo-ubuntu,39191,1527146693279 in 452msec 2018-05-24 15:25:11,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=17, state=RUNNABLE:TRANSIT_PEER_NEW_SYNC_REPLICATION_STATE; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:11,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1265): Finished pid=21, ppid=17, state=SUCCESS; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279 in 895msec 2018-05-24 15:25:11,024 INFO [PEWorker-6] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=25, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=26, ppid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:11,187 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:11,187 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:11,187 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:11,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,39191,1527146693279 suceeded 2018-05-24 15:25:11,188 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,46367,1527146693128 suceeded 2018-05-24 15:25:11,189 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,38897,1527146693212 suceeded 2018-05-24 15:25:11,216 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=26, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 167msec 2018-05-24 15:25:11,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=25, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:11,234 INFO [PEWorker-9] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=17, state=RUNNABLE:POST_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:11,234 INFO [PEWorker-11] replication.TransitPeerSyncReplicationStateProcedure(134): Successfully transit current cluster state from DOWNGRADE_ACTIVE to ACTIVE for sync replication peer 1 2018-05-24 15:25:11,234 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=24, ppid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:11,246 INFO [PEWorker-11] procedure2.ProcedureExecutor(1265): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure in 1.7090sec 2018-05-24 15:25:11,670 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:25:11,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=17 2018-05-24 15:25:11,803 ERROR [Time-limited test] hbase.HBaseTestingUtility(2395): No region info for row SyncRep 2018-05-24 15:25:11,803 INFO [Time-limited test] hbase.HBaseTestingUtility(2401): getMetaTableRows: row -> SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.{ENCODED => 12bc853c9c26f021bc64e25ae2f0bff8, NAME => 'SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:11,803 ERROR [Time-limited test] hbase.HBaseTestingUtility(2395): No region info for row hbase:namespace 2018-05-24 15:25:11,803 DEBUG [Time-limited test] hbase.HBaseTestingUtility(2443): Found 1 rows for table SyncRep 2018-05-24 15:25:11,803 DEBUG [Time-limited test] hbase.HBaseTestingUtility(2446): FirstRow=SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:11,804 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(139): Connect 0x5b4f3f72 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:11,814 DEBUG [ReadOnlyZKClient-localhost:59029@0x5b4f3f72] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51837697, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:11,827 DEBUG [Time-limited test] client.AsyncMetaRegionLocator(61): Start fetching meta region location from registry. 2018-05-24 15:25:11,829 DEBUG [ReadOnlyZKClient-localhost:59029@0x5b4f3f72] client.AsyncMetaRegionLocator(74): The fetched meta region location is region=hbase:meta,,1.1588230740, hostname=zhangduo-ubuntu,39191,1527146693279, seqNum=-1 2018-05-24 15:25:11,840 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:25:11,840 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 34868 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:11,848 DEBUG [Default-IPC-NioEventLoopGroup-7-5] client.AsyncNonMetaRegionLocator(274): The fetched location of 'SyncRep', row='\x00\x00\x00\x01', locateType=CURRENT is [region=SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8., hostname=zhangduo-ubuntu,39191,1527146693279, seqNum=5] 2018-05-24 15:25:11,865 WARN [AsyncFSWAL-0] wal.AsyncFSWAL(290): sync failed java.util.concurrent.CompletionException: java.io.IOException: Inject error at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) at java.util.concurrent.CompletableFuture.biRelay(CompletableFuture.java:1286) at java.util.concurrent.CompletableFuture$BiRelay.tryFire(CompletableFuture.java:1270) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.completed(FanOutOneBlockAsyncDFSOutput.java:201) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.access$2(FanOutOneBlockAsyncDFSOutput.java:183) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput$AckHandler.channelRead0(FanOutOneBlockAsyncDFSOutput.java:279) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput$AckHandler.channelRead0(FanOutOneBlockAsyncDFSOutput.java:1) at org.apache.hbase.thirdparty.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:284) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:801) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:404) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:304) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: Inject error at org.apache.hadoop.hbase.replication.DualAsyncFSWALForTest$MyCombinedAsyncWriter.sync(DualAsyncFSWALForTest.java:82) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.sync(AsyncFSWAL.java:350) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:533) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more 2018-05-24 15:25:11,867 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(178): WAL roll requested 2018-05-24 15:25:11,872 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:25:11,873 DEBUG [RS-EventLoopGroup-5-6] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK] 2018-05-24 15:25:11,873 DEBUG [RS-EventLoopGroup-5-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK] 2018-05-24 15:25:11,897 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(682): Rolled WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 with entries=2, filesize=591 B; new WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 2018-05-24 15:25:11,897 DEBUG [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK], DatanodeInfoWithStorage[127.0.0.1:45859,DS-e0952bf6-c8a5-4968-a264-e4885ae83da0,DISK], DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK]] 2018-05-24 15:25:11,897 INFO [regionserver/zhangduo-ubuntu:0.logRoller] wal.AbstractFSWAL(663): Archiving hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 2018-05-24 15:25:11,902 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:11,917 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:11,921 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741831_1007{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:14,351 INFO [zhangduo-ubuntu:39191Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C39191%2C1527146693279]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 at position: -1 walGroup [zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep at position: -1 2018-05-24 15:25:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:14,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:16,874 INFO [Time-limited test] replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting(97): Expected error: java.util.concurrent.ExecutionException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions: Thu May 24 15:25:16 CST 2018, , java.io.IOException: Call to zhangduo-ubuntu/127.0.1.1:39191 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=1, waitTime=5017, rpcTimeout=5000 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.hbase.replication.TestSyncReplicationMoreLogsInLocalGiveUpSplitting.testSplitLog(TestSyncReplicationMoreLogsInLocalGiveUpSplitting.java:93) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions: Thu May 24 15:25:16 CST 2018, , java.io.IOException: Call to zhangduo-ubuntu/127.0.1.1:39191 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=1, waitTime=5017, rpcTimeout=5000 at org.apache.hadoop.hbase.client.AsyncRpcRetryingCaller.completeExceptionally(AsyncRpcRetryingCaller.java:96) at org.apache.hadoop.hbase.client.AsyncRpcRetryingCaller.onError(AsyncRpcRetryingCaller.java:130) at org.apache.hadoop.hbase.client.AsyncSingleRequestRpcRetryingCaller.lambda$2(AsyncSingleRequestRpcRetryingCaller.java:79) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) at org.apache.hadoop.hbase.client.RawAsyncTableImpl$1.run(RawAsyncTableImpl.java:150) at org.apache.hbase.thirdparty.com.google.protobuf.RpcUtil$1.run(RpcUtil.java:82) at org.apache.hbase.thirdparty.com.google.protobuf.RpcUtil$1.run(RpcUtil.java:73) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:392) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$3(AbstractRpcClient.java:375) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:1) at org.apache.hadoop.hbase.ipc.Call.setTimeout(Call.java:96) at org.apache.hadoop.hbase.ipc.RpcConnection$1.run(RpcConnection.java:199) at org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:663) at org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:738) at org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:466) ... 1 more Caused by: java.io.IOException: Call to zhangduo-ubuntu/127.0.1.1:39191 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=1, waitTime=5017, rpcTimeout=5000 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:180) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:390) ... 9 more Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=1, waitTime=5017, rpcTimeout=5000 at org.apache.hadoop.hbase.ipc.RpcConnection$1.run(RpcConnection.java:201) ... 4 more 2018-05-24 15:25:16,881 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:16,882 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x5b4f3f72 to localhost:59029 2018-05-24 15:25:16,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.HMaster(3491): Client=zhangduo//127.0.0.1 transit current cluster state to DOWNGRADE_ACTIVE in a synchronous replication peer id=1 2018-05-24 15:25:16,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] procedure2.ProcedureExecutor(884): Stored pid=24, state=RUNNABLE:PRE_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure 2018-05-24 15:25:17,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=24 2018-05-24 15:25:17,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=26, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=27, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:17,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=24 2018-05-24 15:25:17,185 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,185 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,185 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:17,186 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:17,188 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:17,203 INFO [PEWorker-6] procedure2.ProcedureExecutor(1265): Finished pid=25, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 167msec 2018-05-24 15:25:17,203 INFO [PEWorker-7] procedure2.ProcedureExecutor(1265): Finished pid=26, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 167msec 2018-05-24 15:25:17,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=24 2018-05-24 15:25:17,335 INFO [PEWorker-9] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=24, state=RUNNABLE:REPLAY_REMOTE_WAL_IN_PEER; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:17,335 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=27, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 169msec 2018-05-24 15:25:17,336 INFO [PEWorker-8] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=28, ppid=24, state=RUNNABLE:RENAME_SYNC_REPLICATION_WALS_DIR; org.apache.hadoop.hbase.master.replication.RecoverStandbyProcedure}] 2018-05-24 15:25:17,351 INFO [PEWorker-8] replication.ReplaySyncReplicationWALManager(82): Renamed dir from hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs/1 to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs/1-replay for peer id=1 2018-05-24 15:25:17,378 INFO [PEWorker-8] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.ReplaySyncReplicationWALProcedure}] 2018-05-24 15:25:17,546 INFO [RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplaySyncReplicationWALCallable(82): Received a replay sync replication wal remoteWALs/1-replay/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep event, peerId=1 2018-05-24 15:25:17,562 DEBUG [RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSink(239): Started replicating mutations. 2018-05-24 15:25:17,562 INFO [RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0-0] zookeeper.ReadOnlyZKClient(139): Connect 0x6cea8634 to localhost:59029 with session timeout=90000ms, retries 1, retry interval 10ms, keepAlive=60000ms 2018-05-24 15:25:17,566 DEBUG [RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0-0] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@47a1570e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2018-05-24 15:25:17,569 INFO [RS-EventLoopGroup-11-7] ipc.ServerRpcConnection(528): Auth successful for zhangduo.hfs.3 (auth:SIMPLE) 2018-05-24 15:25:17,569 INFO [RS-EventLoopGroup-11-7] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46484 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:25:17,580 DEBUG [RS_REPLAY_SYNC_REPLICATION_WAL-regionserver/zhangduo-ubuntu:0-0] regionserver.ReplicationSink(243): Finished replicating mutations. 2018-05-24 15:25:17,582 WARN [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.ReplaySyncReplicationWALProcedure(108): Replay sync replication wal remoteWALs/1-replay/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep on zhangduo-ubuntu,34061,1527146698952 suceeded for peer id=1 2018-05-24 15:25:17,606 INFO [PEWorker-12] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=28, ppid=24, state=RUNNABLE:SNAPSHOT_SYNC_REPLICATION_WALS_DIR; org.apache.hadoop.hbase.master.replication.RecoverStandbyProcedure; resume parent processing. 2018-05-24 15:25:17,606 INFO [PEWorker-12] procedure2.ProcedureExecutor(1265): Finished pid=29, ppid=28, state=SUCCESS; org.apache.hadoop.hbase.master.replication.ReplaySyncReplicationWALProcedure in 206msec 2018-05-24 15:25:17,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=24 2018-05-24 15:25:17,609 INFO [PEWorker-14] replication.ReplaySyncReplicationWALManager(82): Renamed dir from hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs/1-replay to hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/remoteWALs/1-snapshot for peer id=1 2018-05-24 15:25:17,631 INFO [PEWorker-14] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=24, state=RUNNABLE:TRANSIT_PEER_NEW_SYNC_REPLICATION_STATE; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:17,631 INFO [PEWorker-14] procedure2.ProcedureExecutor(1265): Finished pid=28, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RecoverStandbyProcedure in 274msec 2018-05-24 15:25:17,643 INFO [PEWorker-13] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=30, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=31, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=32, ppid=24, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:17,806 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,806 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,806 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:17,807 INFO [RpcServer.default.FPBQ.Fifo.handler=3,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,42271,1527146699039 suceeded 2018-05-24 15:25:17,809 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,37499,1527146699007 suceeded 2018-05-24 15:25:17,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,34061,1527146698952 suceeded 2018-05-24 15:25:17,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1265): Finished pid=30, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:17,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=31, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:17,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=24, state=RUNNABLE:POST_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:17,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=32, ppid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 168msec 2018-05-24 15:25:17,834 INFO [PEWorker-4] replication.TransitPeerSyncReplicationStateProcedure(134): Successfully transit current cluster state from STANDBY to DOWNGRADE_ACTIVE for sync replication peer 1 2018-05-24 15:25:17,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1265): Finished pid=24, state=SUCCESS; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure in 950msec 2018-05-24 15:25:18,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39993] master.MasterRpcServices(1143): Checking to see if procedure is done pid=24 2018-05-24 15:25:18,122 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,122 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,123 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,126 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.HMaster(3491): Client=zhangduo//127.0.0.1 transit current cluster state to STANDBY in a synchronous replication peer id=1 2018-05-24 15:25:18,129 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,129 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741838_1014{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,130 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741838_1014 size 543 2018-05-24 15:25:18,137 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741843_1019{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:18,137 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741843_1019{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:18,137 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741843_1019{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:25:18,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39191] ipc.CallRunner(142): callId: 1 service: ClientService methodName: Mutate size: 131 connection: 127.0.0.1:34868 deadline: 1527146716861, exception=java.io.IOException: WAL has been closed 2018-05-24 15:25:18,148 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741833_1009{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:18,152 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741833_1009 size 4953 2018-05-24 15:25:18,152 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741833_1009 size 4953 2018-05-24 15:25:18,155 ERROR [regionserver/zhangduo-ubuntu:0.logRoller] helpers.MarkerIgnoringBase(159): ***** ABORTING region server zhangduo-ubuntu,39191,1527146693279: IOE in log roller ***** java.io.IOException: WAL broken at org.apache.hadoop.hbase.replication.DualAsyncFSWALForTest.createWriterInstance(DualAsyncFSWALForTest.java:124) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:1) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:769) at org.apache.hadoop.hbase.regionserver.LogRoller.run(LogRoller.java:191) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:25:18,157 ERROR [regionserver/zhangduo-ubuntu:0.logRoller] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2018-05-24 15:25:18,163 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.HRegionServer(2372): Dump of metrics as JSON on abort: { "beans" : [ { "name" : "java.lang:type=Memory", "modelerType" : "sun.management.MemoryImpl", "Verbose" : false, "ObjectPendingFinalizationCount" : 0, "HeapMemoryUsage" : { "committed" : 833617920, "init" : 132120576, "max" : 1854930944, "used" : 286997248 }, "NonHeapMemoryUsage" : { "committed" : 122683392, "init" : 2555904, "max" : -1, "used" : 120279904 }, "ObjectName" : "java.lang:type=Memory" } ], "beans" : [ ], "beans" : [ ], "beans" : [ ] } 2018-05-24 15:25:18,169 ERROR [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(510): Region server zhangduo-ubuntu,39191,1527146693279 reported a fatal error: ***** ABORTING region server zhangduo-ubuntu,39191,1527146693279: IOE in log roller ***** Cause: java.io.IOException: WAL broken at org.apache.hadoop.hbase.replication.DualAsyncFSWALForTest.createWriterInstance(DualAsyncFSWALForTest.java:124) at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:1) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:769) at org.apache.hadoop.hbase.regionserver.LogRoller.run(LogRoller.java:191) at java.lang.Thread.run(Thread.java:748) 2018-05-24 15:25:18,171 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,39191,1527146693279' ***** 2018-05-24 15:25:18,171 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.HRegionServer(2163): STOPPED: IOE in log roller 2018-05-24 15:25:18,171 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:25:18,171 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:25:18,172 INFO [SplitLogWorker-zhangduo-ubuntu:39191] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:25:18,172 INFO [RS:2;zhangduo-ubuntu:39191] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager abruptly. 2018-05-24 15:25:18,172 INFO [RS:2;zhangduo-ubuntu:39191] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager abruptly. 2018-05-24 15:25:18,172 INFO [SplitLogWorker-zhangduo-ubuntu:39191] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,39191,1527146693279 exiting 2018-05-24 15:25:18,172 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:25:18,173 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1066): aborting server zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,173 DEBUG [RS:2;zhangduo-ubuntu:39191] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:25:18,175 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1515): Closing 12bc853c9c26f021bc64e25ae2f0bff8, disabling compactions & flushes 2018-05-24 15:25:18,175 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:18,175 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:25:18,175 INFO [RS:2;zhangduo-ubuntu:39191] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x12185cae to localhost:59029 2018-05-24 15:25:18,175 DEBUG [RS:2;zhangduo-ubuntu:39191] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:18,175 ERROR [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1656): Memstore data size is 32 2018-05-24 15:25:18,175 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:25:18,176 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:25:18,177 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:25:18,177 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1669): Closed SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:18,178 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] handler.CloseRegionHandler(124): Closed SyncRep,,1527146702830.12bc853c9c26f021bc64e25ae2f0bff8. 2018-05-24 15:25:18,178 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1400): Waiting on 1 regions to close 2018-05-24 15:25:18,178 DEBUG [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1404): Online Regions={1588230740=hbase:meta,,1.1588230740} 2018-05-24 15:25:18,186 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 1588230740, disabling compactions & flushes 2018-05-24 15:25:18,187 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region hbase:meta,,1.1588230740 2018-05-24 15:25:18,187 ERROR [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1656): Memstore data size is 3985 2018-05-24 15:25:18,187 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(288): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-24 15:25:18,189 INFO [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed hbase:meta,,1.1588230740 2018-05-24 15:25:18,189 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed hbase:meta,,1.1588230740 2018-05-24 15:25:18,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] procedure2.ProcedureExecutor(884): Stored pid=27, state=RUNNABLE:PRE_PEER_SYNC_REPLICATION_STATE_TRANSITION; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure 2018-05-24 15:25:18,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:18,260 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] hbase.ScheduledChore(180): Chore: MemstoreFlusherChore was stopped 2018-05-24 15:25:18,266 INFO [PEWorker-13] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=29, ppid=27, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}, {pid=30, ppid=27, state=RUNNABLE; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure}] 2018-05-24 15:25:18,266 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:25:18,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:18,379 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,39191,1527146693279; all regions closed. 2018-05-24 15:25:18,379 DEBUG [RS:2;zhangduo-ubuntu:39191] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:18,379 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.Leases(149): Closed leases 2018-05-24 15:25:18,380 INFO [RS:2;zhangduo-ubuntu:39191] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,39191,1527146693279 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:25:18,380 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:25:18,380 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:25:18,381 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C39191%2C1527146693279,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:18,385 WARN [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1.replicationSource.wal-reader.zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:25:18,387 INFO [RS:2;zhangduo-ubuntu:39191] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x0d9c3221 to localhost:59029 2018-05-24 15:25:18,387 DEBUG [RS:2;zhangduo-ubuntu:39191] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:25:18,387 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C39191%2C1527146693279,1 terminated 2018-05-24 15:25:18,387 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-1.replicationSource.shipperzhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1,1 terminated 2018-05-24 15:25:18,389 INFO [RS:2;zhangduo-ubuntu:39191] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:39191 2018-05-24 15:25:18,404 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,404 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,404 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,404 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,404 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:39191-0x16391092ecc0003, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:25:18,404 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,39191,1527146693279] 2018-05-24 15:25:18,407 INFO [Time-limited test-EventThread] master.ServerManager(596): Processing expiration of zhangduo-ubuntu,39191,1527146693279 on zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:25:18,415 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:18,415 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:18,415 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,415 INFO [RS:2;zhangduo-ubuntu:39191] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,39191,1527146693279; zookeeper connection closed. 2018-05-24 15:25:18,416 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,416 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74d7a780] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74d7a780 2018-05-24 15:25:18,418 INFO [Time-limited test-EventThread] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(122): /cluster1/rs/zhangduo-ubuntu,39191,1527146693279 znode expired, triggering replicatorRemoved event 2018-05-24 15:25:18,418 INFO [Time-limited test-EventThread] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(122): /cluster1/rs/zhangduo-ubuntu,39191,1527146693279 znode expired, triggering replicatorRemoved event 2018-05-24 15:25:18,420 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:25:18,420 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:25:18,421 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:18,421 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:18,421 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,421 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,440 DEBUG [RSProcedureDispatcher-pool4-t18] master.ServerManager(779): New admin connection to zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,443 DEBUG [RS-EventLoopGroup-5-5] ipc.FailedServers(56): Added failed server with address zhangduo-ubuntu/127.0.1.1:39191 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: 拒绝连接: zhangduo-ubuntu/127.0.1.1:39191 2018-05-24 15:25:18,444 WARN [RSProcedureDispatcher-pool4-t18] procedure.RSProcedureDispatcher$AbstractRSRemoteCall(209): Failed dispatch to server=zhangduo-ubuntu,39191,1527146693279 try=0 java.io.IOException: Call to zhangduo-ubuntu/127.0.1.1:39191 failed on local exception: java.nio.channels.ClosedChannelException at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:180) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:390) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$3(AbstractRpcClient.java:375) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:1) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$4.operationComplete(NettyRpcConnection.java:292) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$4.operationComplete(NettyRpcConnection.java:1) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:507) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:481) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:420) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:163) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.addListener(DefaultChannelPromise.java:93) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.addListener(DefaultChannelPromise.java:28) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.write(NettyRpcConnection.java:284) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$11(NettyRpcConnection.java:283) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$6$1.run(NettyRpcConnection.java:344) at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) at java.lang.Thread.run(Thread.java:748) Caused by: java.nio.channels.ClosedChannelException at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.write(...)(Unknown Source) 2018-05-24 15:25:18,444 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:18,447 WARN [RSProcedureDispatcher-pool4-t18] replication.RefreshPeerProcedure(144): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,39191,1527146693279 failed java.io.IOException: Call to zhangduo-ubuntu/127.0.1.1:39191 failed on local exception: java.nio.channels.ClosedChannelException at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:180) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:390) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$3(AbstractRpcClient.java:375) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:1) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$4.operationComplete(NettyRpcConnection.java:292) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$4.operationComplete(NettyRpcConnection.java:1) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:507) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:481) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:420) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:163) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.addListener(DefaultChannelPromise.java:93) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.addListener(DefaultChannelPromise.java:28) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.write(NettyRpcConnection.java:284) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$11(NettyRpcConnection.java:283) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$6$1.run(NettyRpcConnection.java:344) at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) at java.lang.Thread.run(Thread.java:748) Caused by: java.nio.channels.ClosedChannelException at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.write(...)(Unknown Source) 2018-05-24 15:25:18,448 INFO [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-0] regionserver.RefreshPeerCallable(55): Received a peer change event, peerId=1, type=TRANSIT_SYNC_REPLICATION_STATE 2018-05-24 15:25:18,448 INFO [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,46367,1527146693128 suceeded 2018-05-24 15:25:18,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] replication.RefreshPeerProcedure(147): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,38897,1527146693212 suceeded 2018-05-24 15:25:18,528 INFO [PEWorker-12] procedure2.ProcedureExecutor(1265): Finished pid=28, ppid=27, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 188msec 2018-05-24 15:25:18,528 INFO [PEWorker-16] procedure2.ProcedureExecutor(1265): Finished pid=30, ppid=27, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 188msec 2018-05-24 15:25:18,529 DEBUG [Time-limited test-EventThread] procedure2.ProcedureExecutor(884): Stored pid=31, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true 2018-05-24 15:25:18,529 DEBUG [Time-limited test-EventThread] assignment.AssignmentManager(1405): Added=zhangduo-ubuntu,39191,1527146693279 to dead servers, submitted shutdown handler to be executed meta=true 2018-05-24 15:25:18,532 WARN [Time-limited test-EventThread] replication.RefreshPeerProcedure(144): Refresh peer 1 for TRANSIT_SYNC_REPLICATION_STATE on zhangduo-ubuntu,39191,1527146693279 failed org.apache.hadoop.hbase.DoNotRetryIOException: server not online zhangduo-ubuntu,39191,1527146693279 at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher.abortPendingOperations(RSProcedureDispatcher.java:127) at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher.abortPendingOperations(RSProcedureDispatcher.java:1) at org.apache.hadoop.hbase.procedure2.RemoteProcedureDispatcher$BufferNode.abortOperationsInQueue(RemoteProcedureDispatcher.java:379) at org.apache.hadoop.hbase.procedure2.RemoteProcedureDispatcher.removeNode(RemoteProcedureDispatcher.java:192) at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher.serverRemoved(RSProcedureDispatcher.java:140) at org.apache.hadoop.hbase.master.ServerManager.expireServer(ServerManager.java:602) at org.apache.hadoop.hbase.master.RegionServerTracker.nodeDeleted(RegionServerTracker.java:141) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:502) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2018-05-24 15:25:18,532 INFO [PEWorker-2] procedure.ServerCrashProcedure(119): Start pid=31, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true 2018-05-24 15:25:18,532 INFO [PEWorker-6] replication.RefreshPeerProcedure(183): Can not add remote operation for refreshing peer 1 for TRANSIT_SYNC_REPLICATION_STATE to zhangduo-ubuntu,39191,1527146693279, this usually because the server is already dead, give up and mark the procedure as complete 2018-05-24 15:25:18,532 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:25:18,533 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:18,534 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,547 DEBUG [PEWorker-3] procedure.ServerCrashProcedure(204): pid=31, state=RUNNABLE:SERVER_CRASH_PROCESS_META; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true; processing hbase:meta 2018-05-24 15:25:18,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:RECOVER_META_PREPARE; RecoverMetaProcedure failedMetaServer=zhangduo-ubuntu,39191,1527146693279, splitWal=true}] 2018-05-24 15:25:18,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:18,559 INFO [PEWorker-6] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=27, state=RUNNABLE:REMOVE_ALL_REPLICATION_QUEUES_IN_PEER; org.apache.hadoop.hbase.master.replication.TransitPeerSyncReplicationStateProcedure; resume parent processing. 2018-05-24 15:25:18,559 INFO [PEWorker-6] procedure2.ProcedureExecutor(1265): Finished pid=29, ppid=27, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure in 266msec 2018-05-24 15:25:18,561 DEBUG [PEWorker-3] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/replication/rs/zhangduo-ubuntu,38897,1527146693212/1/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 2018-05-24 15:25:18,563 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,38897,1527146693212/1/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 2018-05-24 15:25:18,563 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,38897,1527146693212/1 2018-05-24 15:25:18,563 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,38897,1527146693212/1 2018-05-24 15:25:18,565 DEBUG [PEWorker-3] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/replication/rs/zhangduo-ubuntu,46367,1527146693128/1/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 2018-05-24 15:25:18,567 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,46367,1527146693128/1/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 2018-05-24 15:25:18,567 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,46367,1527146693128/1 2018-05-24 15:25:18,567 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,46367,1527146693128/1 2018-05-24 15:25:18,568 DEBUG [PEWorker-3] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:18,569 DEBUG [PEWorker-3] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 2018-05-24 15:25:18,569 DEBUG [PEWorker-3] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 2018-05-24 15:25:18,571 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 2018-05-24 15:25:18,571 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1 2018-05-24 15:25:18,571 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279.1527146695406 2018-05-24 15:25:18,572 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:18,572 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279/1 2018-05-24 15:25:18,592 INFO [PEWorker-4] procedure.RecoverMetaProcedure(125): Start pid=32, ppid=31, state=RUNNABLE:RECOVER_META_SPLIT_LOGS; RecoverMetaProcedure failedMetaServer=zhangduo-ubuntu,39191,1527146693279, splitWal=true 2018-05-24 15:25:18,597 DEBUG [PEWorker-3] ipc.AbstractRpcClient(349): Not trying to connect to zhangduo-ubuntu/127.0.1.1:39191 this server is in the failed servers list 2018-05-24 15:25:18,604 DEBUG [PEWorker-4] master.MasterWalManager(257): Renamed region directory: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting 2018-05-24 15:25:18,605 INFO [PEWorker-4] master.SplitLogManager(461): dead splitlog workers [zhangduo-ubuntu,39191,1527146693279] 2018-05-24 15:25:18,606 INFO [PEWorker-4] master.SplitLogManager(241): Started splitting 1 logs in [hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting] for [zhangduo-ubuntu,39191,1527146693279] 2018-05-24 15:25:18,613 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:18,613 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:18,614 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(331): Put up splitlog task at znode /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,617 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(363): Task not yet acquired /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta, ver=0 2018-05-24 15:25:18,618 DEBUG [SplitLogWorker-zhangduo-ubuntu:46367] coordination.ZkSplitLogWorkerCoordination(436): Current region server zhangduo-ubuntu,46367,1527146693128 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-24 15:25:18,618 DEBUG [SplitLogWorker-zhangduo-ubuntu:38897] coordination.ZkSplitLogWorkerCoordination(436): Current region server zhangduo-ubuntu,38897,1527146693212 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-24 15:25:18,620 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,620 INFO [SplitLogWorker-zhangduo-ubuntu:46367] coordination.ZkSplitLogWorkerCoordination(258): worker zhangduo-ubuntu,46367,1527146693128 acquired task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,624 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(453): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta acquired by zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,650 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(250): Splitting WAL=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta, length=4953 2018-05-24 15:25:18,651 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,651 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,651 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,658 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta after 7ms 2018-05-24 15:25:18,674 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(283): DLS Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 3 } store_sequence_id { family_name: "rep_barrier" sequence_id: 11 } store_sequence_id { family_name: "table" sequence_id: 4 } 2018-05-24 15:25:18,677 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(335): Finishing writing output logs and closing down 2018-05-24 15:25:18,677 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter$OutputSink(1161): Waiting for split writer threads to finish 2018-05-24 15:25:18,685 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0-Writer-1] wal.WALSplitter$LogRecoveredEditsOutputSink(1501): Creating writer path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta.temp 2018-05-24 15:25:18,689 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter$OutputSink(1185): 3 split writers finished; closing. 2018-05-24 15:25:18,708 DEBUG [PEWorker-3] ipc.AbstractRpcClient(349): Not trying to connect to zhangduo-ubuntu/127.0.1.1:39191 this server is in the failed servers list 2018-05-24 15:25:18,710 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:25:18,710 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:25:18,710 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:25:18,711 DEBUG [split-log-closeStream-1] wal.WALSplitter$LogRecoveredEditsOutputSink(1378): Closed wap hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta.temp (wrote 14 edits, skipped 0 edits in 13ms 2018-05-24 15:25:18,713 INFO [split-log-closeStream-1] wal.WALSplitter$LogRecoveredEditsOutputSink(1404): Rename hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000004-zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta.temp to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000017 2018-05-24 15:25:18,713 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(356): Processed 14 edits across 1 regions; edits skipped=1; log file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta, length=4953, corrupted=false, progress failed=false 2018-05-24 15:25:18,714 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,714 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,714 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] coordination.ZkSplitLogWorkerCoordination(574): successfully transitioned task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta to final state DONE zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,714 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] handler.WALSplitterHandler(99): Worker zhangduo-ubuntu,46367,1527146693128 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@2b5c6dce in 88ms. Status = DONE 2018-05-24 15:25:18,715 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(371): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta entered state=DONE zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:18,721 INFO [Time-limited test-EventThread] wal.WALSplitter(448): Archived processed log hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs/zhangduo-ubuntu%2C39191%2C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,722 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(414): Done splitting /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,723 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,724 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,724 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination$DeleteAsyncCallback(694): Deleted /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.meta.1527146695766.meta 2018-05-24 15:25:18,724 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:18,724 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:18,730 WARN [PEWorker-4] master.SplitLogManager(279): Returning success without actually splitting and deleting all the log files in path hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting: [FileStatus{path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep; isDirectory=false; length=543; replication=3; blocksize=268435456; modification_time=1527146718130; access_time=1527146710889; owner=zhangduo.hfs.2; group=supergroup; permission=rw-r--r--; isSymlink=false}, FileStatus{path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867; isDirectory=false; length=91; replication=3; blocksize=268435456; modification_time=1527146718123; access_time=1527146711869; owner=zhangduo.hfs.2; group=supergroup; permission=rw-r--r--; isSymlink=false}] org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:84) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:3676) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:953) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:623) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2217) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2213) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2213) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1413) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy28.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:545) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy29.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:372) at com.sun.proxy.$Proxy30.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2044) at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:707) at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:703) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:714) at org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:273) at org.apache.hadoop.hbase.master.MasterWalManager.splitLog(MasterWalManager.java:293) at org.apache.hadoop.hbase.master.MasterWalManager.splitMetaLog(MasterWalManager.java:232) at org.apache.hadoop.hbase.master.MasterWalManager.splitMetaLog(MasterWalManager.java:224) at org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure.executeFromState(RecoverMetaProcedure.java:129) at org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure.executeFromState(RecoverMetaProcedure.java:1) at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:184) at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:850) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1472) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1240) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$6(ProcedureExecutor.java:1178) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1760) 2018-05-24 15:25:18,730 INFO [PEWorker-4] master.SplitLogManager(293): finished splitting (more than or equal to) 4953 bytes in 1 log files in [hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting] in 123ms 2018-05-24 15:25:18,842 INFO [PEWorker-4] procedure.RecoverMetaProcedure(151): pid=32, ppid=31, state=RUNNABLE:RECOVER_META_ASSIGN_REGIONS; RecoverMetaProcedure failedMetaServer=zhangduo-ubuntu,39191,1527146693279, splitWal=true; Assigning meta with new plan; previous server=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:18,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740}] 2018-05-24 15:25:18,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:18,910 DEBUG [PEWorker-3] ipc.AbstractRpcClient(349): Not trying to connect to zhangduo-ubuntu/127.0.1.1:39191 this server is in the failed servers list 2018-05-24 15:25:18,954 INFO [PEWorker-4] procedure.MasterProcedureScheduler(640): pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740 checking lock on 1588230740 2018-05-24 15:25:18,955 INFO [PEWorker-4] assignment.AssignProcedure(218): Starting pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:meta, region=1588230740; rit=OFFLINE, location=zhangduo-ubuntu,39191,1527146693279; forceNewPlan=false, retain=true 2018-05-24 15:25:19,109 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 1 regions. 0 retained the pre-restart assignment. 1 regions were assigned to random hosts, since the old hosts for these regions are no longer present in the cluster. These hosts were: 2018-05-24 15:25:19,110 INFO [PEWorker-5] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,111 INFO [PEWorker-5] assignment.RegionTransitionProcedure(251): Dispatch pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,215 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46367] ipc.CallRunner(142): callId: 61 service: ClientService methodName: Get size: 82 connection: 127.0.0.1:42314 deadline: 1527146779214, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,263 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46367] regionserver.RSRpcServices(1983): Open hbase:meta,,1.1588230740 2018-05-24 15:25:19,263 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.WALFactory(136): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2018-05-24 15:25:19,266 WARN [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(419): 'hbase.regionserver.maxlogs' was deprecated. 2018-05-24 15:25:19,266 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(424): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=zhangduo-ubuntu%2C46367%2C1527146693128.meta, suffix=.meta, logDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128, archiveDir=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:25:19,272 DEBUG [RS-EventLoopGroup-11-8] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK] 2018-05-24 15:25:19,273 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK] 2018-05-24 15:25:19,272 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(737): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK] 2018-05-24 15:25:19,278 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(686): New WAL /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.meta.1527146719267.meta 2018-05-24 15:25:19,278 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.AbstractFSWAL(775): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45859,DS-77a0454e-e42a-47c6-abf9-5d05341de1b8,DISK], DatanodeInfoWithStorage[127.0.0.1:34749,DS-2a788e78-421e-43b8-b8a8-c19fa49f729a,DISK], DatanodeInfoWithStorage[127.0.0.1:40385,DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd,DISK]] 2018-05-24 15:25:19,278 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:25:19,279 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(200): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-24 15:25:19,279 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(8081): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-24 15:25:19,279 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.RegionCoprocessorHost(394): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-24 15:25:19,279 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-24 15:25:19,279 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:25:19,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info 2018-05-24 15:25:19,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info 2018-05-24 15:25:19,284 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:19,284 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:19,285 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:19,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:25:19,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier 2018-05-24 15:25:19,287 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for rep_barrier: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:19,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:19,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:19,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table 2018-05-24 15:25:19,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table 2018-05-24 15:25:19,290 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(239): Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=531.68 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=531.68 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:25:19,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:25:19,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(327): Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:25:19,295 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 1 recovered edits file(s) under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740 2018-05-24 15:25:19,296 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4583): Replaying edits from hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000017 2018-05-24 15:25:19,307 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4771): Applied 38, skipped 0, firstSequenceIdInLog=4, maxSequenceIdInLog=17, path=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000017 2018-05-24 15:25:19,308 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(2572): Flushing 3/3 column families, dataSize=3.89 KB heapSize=6.70 KB 2018-05-24 15:25:19,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:19,359 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741842_1018{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:25:19,360 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741842_1018{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:25:19,361 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741842_1018 size 8372 2018-05-24 15:25:19,361 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=3.51 KB at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/info/4a25380daf3340dba63593933787393e 2018-05-24 15:25:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:19,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:19,415 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741843_1019{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 4996 2018-05-24 15:25:19,415 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741843_1019 size 4996 2018-05-24 15:25:19,415 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741843_1019 size 4996 2018-05-24 15:25:19,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:19,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:19,750 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46367] ipc.CallRunner(142): callId: 63 service: ClientService methodName: Get size: 82 connection: 127.0.0.1:42314 deadline: 1527146779750, exception=org.apache.hadoop.hbase.exceptions.RegionOpeningException: Region hbase:meta,,1 is opening on zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,816 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=222 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/rep_barrier/715e74ea7a1e4e3ea513d834b189ccf0 2018-05-24 15:25:19,841 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:19,841 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:25:19,842 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741844_1020 size 4824 2018-05-24 15:25:19,842 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=172 B at sequenceid=17 (bloomFilter=false), to=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/table/2c3ccd0dcd524720afcb3c995b73e70c 2018-05-24 15:25:19,850 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/info/4a25380daf3340dba63593933787393e as hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info/4a25380daf3340dba63593933787393e 2018-05-24 15:25:19,861 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HStore(1070): Added hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info/4a25380daf3340dba63593933787393e, entries=32, sequenceid=17, filesize=8.2 K 2018-05-24 15:25:19,867 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/rep_barrier/715e74ea7a1e4e3ea513d834b189ccf0 as hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier/715e74ea7a1e4e3ea513d834b189ccf0 2018-05-24 15:25:19,877 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HStore(1070): Added hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/rep_barrier/715e74ea7a1e4e3ea513d834b189ccf0, entries=2, sequenceid=17, filesize=4.9 K 2018-05-24 15:25:19,879 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/table/2c3ccd0dcd524720afcb3c995b73e70c as hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table/2c3ccd0dcd524720afcb3c995b73e70c 2018-05-24 15:25:19,888 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HStore(1070): Added hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/table/2c3ccd0dcd524720afcb3c995b73e70c, entries=4, sequenceid=17, filesize=4.7 K 2018-05-24 15:25:19,889 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(2781): Finished flush of dataSize ~3.89 KB/3985, heapSize ~7.33 KB/7504, currentSize=0 B/0 for 1588230740 in 581ms, sequenceid=17, compaction requested=false; wal=null 2018-05-24 15:25:19,890 INFO [IPC Server handler 8 on 41639] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:40385 127.0.0.1:34749 127.0.0.1:45859 2018-05-24 15:25:19,891 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4563): Deleted recovered.edits file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/0000000000000000017 2018-05-24 15:25:19,892 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.FlushLargeStoresPolicy(61): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7M)) instead. 2018-05-24 15:25:19,896 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=1 2018-05-24 15:25:19,897 INFO [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 1588230740; next sequenceid=18 2018-05-24 15:25:19,899 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-24 15:25:19,903 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=46811] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=18, pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,904 DEBUG [PEWorker-9] assignment.RegionTransitionProcedure(363): Finishing pid=33, ppid=32, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:meta, region=1588230740; rit=OPENING, location=zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,904 INFO [PEWorker-9] zookeeper.MetaTableLocator(452): Setting hbase:meta (replicaId=0) location in ZooKeeper as zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:19,904 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-24 15:25:19,906 DEBUG [RS_OPEN_META-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:meta,,1.1588230740 on zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:20,133 INFO [PEWorker-9] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=32, ppid=31, state=RUNNABLE; RecoverMetaProcedure failedMetaServer=zhangduo-ubuntu,39191,1527146693279, splitWal=true; resume parent processing. 2018-05-24 15:25:20,133 INFO [PEWorker-9] procedure2.ProcedureExecutor(1265): Finished pid=33, ppid=32, state=SUCCESS; AssignProcedure table=hbase:meta, region=1588230740 in 1.0640sec 2018-05-24 15:25:20,183 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:45859 to delete [blk_1073741840_1016] 2018-05-24 15:25:20,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:20,357 INFO [PEWorker-11] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=31, state=RUNNABLE:SERVER_CRASH_GET_REGIONS; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true; resume parent processing. 2018-05-24 15:25:20,357 INFO [PEWorker-11] procedure2.ProcedureExecutor(1265): Finished pid=32, ppid=31, state=SUCCESS; RecoverMetaProcedure failedMetaServer=zhangduo-ubuntu,39191,1527146693279, splitWal=true in 1.5850sec 2018-05-24 15:25:20,490 DEBUG [PEWorker-10] procedure.ServerCrashProcedure(229): Splitting WALs pid=31, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true 2018-05-24 15:25:20,491 INFO [PEWorker-10] master.SplitLogManager(461): dead splitlog workers [zhangduo-ubuntu,39191,1527146693279] 2018-05-24 15:25:20,493 INFO [PEWorker-10] master.SplitLogManager(241): Started splitting 2 logs in [hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting] for [zhangduo-ubuntu,39191,1527146693279] 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(331): Put up splitlog task at znode /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(331): Put up splitlog task at znode /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(363): Task not yet acquired /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep, ver=0 2018-05-24 15:25:20,515 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(363): Task not yet acquired /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867, ver=0 2018-05-24 15:25:20,516 DEBUG [SplitLogWorker-zhangduo-ubuntu:46367] coordination.ZkSplitLogWorkerCoordination(436): Current region server zhangduo-ubuntu,46367,1527146693128 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-24 15:25:20,518 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,518 INFO [SplitLogWorker-zhangduo-ubuntu:46367] coordination.ZkSplitLogWorkerCoordination(258): worker zhangduo-ubuntu,46367,1527146693128 acquired task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,518 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(453): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep acquired by zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:20,522 WARN [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-1] regionserver.SplitLogWorker(147): Giveup splitting zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep since it has been replayed in the remote cluster and the content will be replicated back 2018-05-24 15:25:20,540 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,540 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-1] coordination.ZkSplitLogWorkerCoordination(574): successfully transitioned task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep to final state DONE zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:20,540 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,540 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-1] handler.WALSplitterHandler(99): Worker zhangduo-ubuntu,46367,1527146693128 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@484d378f in 22ms. Status = DONE 2018-05-24 15:25:20,540 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(371): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep entered state=DONE zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:25:20,545 INFO [Time-limited test-EventThread] wal.WALSplitter(448): Archived processed log hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs/zhangduo-ubuntu%2C39191%2C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,545 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(414): Done splitting /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,547 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,547 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,547 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination$DeleteAsyncCallback(694): Deleted /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279-1527146710886-1.1527146710888.syncrep 2018-05-24 15:25:20,548 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:20,627 DEBUG [SplitLogWorker-zhangduo-ubuntu:38897] coordination.ZkSplitLogWorkerCoordination(436): Current region server zhangduo-ubuntu,38897,1527146693212 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-24 15:25:20,697 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,697 INFO [SplitLogWorker-zhangduo-ubuntu:38897] coordination.ZkSplitLogWorkerCoordination(258): worker zhangduo-ubuntu,38897,1527146693212 acquired task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,697 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(453): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 acquired by zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:20,715 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(250): Splitting WAL=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867, length=91 2018-05-24 15:25:20,754 INFO [master/zhangduo-ubuntu:0.splitLogManager..Chore.1] master.SplitLogManager$TimeoutMonitor(591): total=1, unassigned=0, tasks={/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867=last_update = 1527146720697 last_version = 1 cur_worker_name = zhangduo-ubuntu,38897,1527146693212 status = in_progress incarnation = 0 resubmits = 0 batch = installed = 2 done = 1 error = 0} 2018-05-24 15:25:20,755 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,755 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,755 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] util.FSHDFSUtils(195): Recover lease on dfs file hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 2018-05-24 15:25:20,758 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] util.FSHDFSUtils(284): Recovered lease, attempt=0 on file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 after 3ms 2018-05-24 15:25:20,770 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(335): Finishing writing output logs and closing down 2018-05-24 15:25:20,772 DEBUG [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter$OutputSink(1161): Waiting for split writer threads to finish 2018-05-24 15:25:20,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=34, ppid=27, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:20,775 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter$OutputSink(1185): 3 split writers finished; closing. 2018-05-24 15:25:20,775 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(356): Processed 0 edits across 0 regions; edits skipped=0; log file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867, length=91, corrupted=false, progress failed=false 2018-05-24 15:25:20,803 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,803 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,803 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] coordination.ZkSplitLogWorkerCoordination(574): successfully transitioned task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 to final state DONE zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:20,803 INFO [RS_LOG_REPLAY_OPS-regionserver/zhangduo-ubuntu:0-0] handler.WALSplitterHandler(99): Worker zhangduo-ubuntu,38897,1527146693212 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@641d921d in 106ms. Status = DONE 2018-05-24 15:25:20,803 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(371): Task /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 entered state=DONE zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:25:20,808 INFO [Time-limited test-EventThread] wal.WALSplitter(448): Archived processed log hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 to hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs/zhangduo-ubuntu%2C39191%2C1527146693279.1527146711867 2018-05-24 15:25:20,809 INFO [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination(414): Done splitting /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,811 INFO [PEWorker-10] master.SplitLogManager(293): finished splitting (more than or equal to) 634 bytes in 2 log files in [hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,39191,1527146693279-splitting] in 318ms 2018-05-24 15:25:20,812 DEBUG [PEWorker-10] procedure.ServerCrashProcedure(237): Done splitting WALs pid=31, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS; ServerCrashProcedure server=zhangduo-ubuntu,39191,1527146693279, splitWal=true, meta=true 2018-05-24 15:25:20,822 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,822 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,822 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/splitWAL 2018-05-24 15:25:20,822 DEBUG [Time-limited test-EventThread] coordination.ZKSplitLogManagerCoordination$DeleteAsyncCallback(694): Deleted /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 2018-05-24 15:25:20,838 INFO [PEWorker-13] procedure.MasterProcedureScheduler(640): pid=34, ppid=27, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=12bc853c9c26f021bc64e25ae2f0bff8, source=zhangduo-ubuntu,39191,1527146693279, destination=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:20,838 INFO [PEWorker-13] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279}] 2018-05-24 15:25:20,839 INFO [PEWorker-14] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=36, ppid=31, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8}] 2018-05-24 15:25:20,869 INFO [PEWorker-13] procedure.MasterProcedureScheduler(640): pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:20,869 INFO [PEWorker-12] procedure.MasterProcedureScheduler(640): pid=36, ppid=31, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 checking lock on 12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:20,869 INFO [PEWorker-13] assignment.RegionStateStore(197): pid=35 updating hbase:meta row=12bc853c9c26f021bc64e25ae2f0bff8, regionState=CLOSING 2018-05-24 15:25:20,869 DEBUG [PEWorker-12] assignment.RegionTransitionProcedure(441): LOCK_EVENT_WAIT pid=36 serverLocks={}, namespaceLocks={}, tableLocks={}, regionLocks={{12bc853c9c26f021bc64e25ae2f0bff8=exclusiveLockOwner=34, sharedLockCount=0, waitingProcCount=1}}, peerLocks={{1=exclusiveLockOwner=27, sharedLockCount=0, waitingProcCount=0}} 2018-05-24 15:25:20,869 DEBUG [PEWorker-12] procedure2.ProcedureExecutor(1249): LOCK_EVENT_WAIT pid=36, ppid=31, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:25:20,872 INFO [PEWorker-13] assignment.RegionTransitionProcedure(251): Dispatch pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:20,872 WARN [PEWorker-13] assignment.RegionTransitionProcedure(225): Remote call failed pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279; exception=pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279 to zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:20,872 WARN [PEWorker-13] assignment.UnassignProcedure(281): Expiring server pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279; rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, exception=org.apache.hadoop.hbase.master.assignment.FailedRemoteDispatchException: pid=35, ppid=34, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8, server=zhangduo-ubuntu,39191,1527146693279 to zhangduo-ubuntu,39191,1527146693279 2018-05-24 15:25:20,873 WARN [PEWorker-13] master.ServerManager(580): Expiration of zhangduo-ubuntu,39191,1527146693279 but server shutdown already in progress 2018-05-24 15:25:21,297 DEBUG [SplitLogWorker-zhangduo-ubuntu:46367] coordination.ZkSplitLogWorkerCoordination(436): Current region server zhangduo-ubuntu,46367,1527146693128 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-24 15:25:21,298 DEBUG [SplitLogWorker-zhangduo-ubuntu:46367] zookeeper.ZKUtil(704): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Unable to get data of znode /cluster1/splitWAL/WALs%2Fzhangduo-ubuntu%2C39191%2C1527146693279-splitting%2Fzhangduo-ubuntu%252C39191%252C1527146693279.1527146711867 because node does not exist (not necessarily an error) 2018-05-24 15:25:21,335 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(176): Node /cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279 already deleted, retry=false 2018-05-24 15:25:21,548 DEBUG [ReplicationExecutor-0] zookeeper.RecoverableZooKeeper(176): Node /cluster1/replication/rs/zhangduo-ubuntu,39191,1527146693279 already deleted, retry=false 2018-05-24 15:25:22,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:23,184 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:34749 to delete [blk_1073741840_1016] 2018-05-24 15:25:23,680 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:25:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:24,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:24,544 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:25:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:26,185 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:40385 to delete [blk_1073741840_1016] 2018-05-24 15:25:26,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:29,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:36,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:46,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:49,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:54,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:25:56,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:25:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:25:59,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:25:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:25:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:25:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:25:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:04,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:04,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:04,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:04,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:06,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:26:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:14,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:21,070 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:24,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:26,071 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:26,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:26:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:29,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:29,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:31,071 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:36,072 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:39,374 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:41,073 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:44,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:46,074 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:46,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:26:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:51,076 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:26:56,077 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:26:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:26:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:26:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:26:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:26:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:26:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:01,078 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:06,079 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:06,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:27:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:09,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:09,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:11,079 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:14,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:16,081 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:19,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:19,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:21,082 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:23,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:27:23,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:27:23,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:27:23,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:27:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:27:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:27:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:27:23,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: MemstoreFlusherChore missed its start time 2018-05-24 15:27:23,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:27:23,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(176): Chore: CompactionChecker missed its start time 2018-05-24 15:27:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:24,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:26,083 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:26,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:27:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:29,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:29,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:31,083 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:34,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:36,084 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:41,085 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:44,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:44,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:46,085 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:46,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:27:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:51,086 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:54,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:27:56,088 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:27:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:27:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:27:59,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:27:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:27:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:27:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:01,089 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:04,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:06,090 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:06,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:28:09,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:11,092 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:14,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:16,093 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:19,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:21,094 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:24,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:26,096 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:26,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:28:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:31,097 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:34,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:34,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:36,098 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:39,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:41,099 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:44,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:46,100 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:46,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:28:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:51,102 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:54,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:28:56,102 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:28:59,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:28:59,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:28:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:28:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:28:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:28:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:01,102 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:04,672 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:06,103 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:06,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:29:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:11,105 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:16,106 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:19,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:19,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:19,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:21,107 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:24,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:24,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:26,108 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:26,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:29:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:29,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:31,109 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:36,109 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:39,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:41,110 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:44,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:46,111 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:46,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:29:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:51,111 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:53,378 DEBUG [Thread-157-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(427): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-24 15:29:53,379 DEBUG [Thread-157-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(427): data stats (chunk size=2097152): current pool size=2, created chunk count=13, reused chunk count=1, reuseRatio=7.14% 2018-05-24 15:29:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:56,113 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:29:56,605 INFO [RS-EventLoopGroup-3-4] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:29:56,605 INFO [RS-EventLoopGroup-3-4] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 42970 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:29:56,609 INFO [master/zhangduo-ubuntu:0.Chore.1] master.HMaster(1423): Not running balancer because 1 region(s) in transition: [rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8] 2018-05-24 15:29:56,609 WARN [master/zhangduo-ubuntu:0.Chore.1] master.CatalogJanitor(121): CatalogJanitor is disabled! Enabled=true, maintenanceMode=false, am=org.apache.hadoop.hbase.master.assignment.AssignmentManager@70b690c7, failoverCleanupDone=true, hasRIT=true 2018-05-24 15:29:57,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 237221ms 2018-05-24 15:29:57,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154801ms 2018-05-24 15:29:57,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227353ms 2018-05-24 15:29:57,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111338ms 2018-05-24 15:29:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168160ms 2018-05-24 15:29:57,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292838ms 2018-05-24 15:29:57,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150581ms 2018-05-24 15:29:57,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7856ms 2018-05-24 15:29:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299407ms 2018-05-24 15:29:58,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71550ms 2018-05-24 15:29:58,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 195977ms 2018-05-24 15:29:58,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264346ms 2018-05-24 15:29:58,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11728ms 2018-05-24 15:29:58,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104420ms 2018-05-24 15:29:58,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295897ms 2018-05-24 15:29:58,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281451ms 2018-05-24 15:29:58,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 217536ms 2018-05-24 15:29:58,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197970ms 2018-05-24 15:29:59,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16658ms 2018-05-24 15:29:59,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198475ms 2018-05-24 15:29:59,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154679ms 2018-05-24 15:29:59,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26279ms 2018-05-24 15:29:59,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:29:59,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:29:59,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46968ms 2018-05-24 15:29:59,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119275ms 2018-05-24 15:29:59,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224355ms 2018-05-24 15:29:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:29:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:29:59,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:29:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:29:59,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116632ms 2018-05-24 15:29:59,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95883ms 2018-05-24 15:29:59,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46150ms 2018-05-24 15:30:00,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50660ms 2018-05-24 15:30:00,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 223485ms 2018-05-24 15:30:00,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78293ms 2018-05-24 15:30:00,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255970ms 2018-05-24 15:30:00,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238337ms 2018-05-24 15:30:00,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5708ms 2018-05-24 15:30:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184883ms 2018-05-24 15:30:00,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87894ms 2018-05-24 15:30:00,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 171302ms 2018-05-24 15:30:00,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109539ms 2018-05-24 15:30:01,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123933ms 2018-05-24 15:30:01,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152326ms 2018-05-24 15:30:01,113 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:01,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48891ms 2018-05-24 15:30:01,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32926ms 2018-05-24 15:30:01,337 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:30:01,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8115ms 2018-05-24 15:30:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 110537ms 2018-05-24 15:30:01,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12290ms 2018-05-24 15:30:01,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118153ms 2018-05-24 15:30:01,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74885ms 2018-05-24 15:30:01,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277292ms 2018-05-24 15:30:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235948ms 2018-05-24 15:30:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78448ms 2018-05-24 15:30:02,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70655ms 2018-05-24 15:30:02,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289935ms 2018-05-24 15:30:02,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207634ms 2018-05-24 15:30:02,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251288ms 2018-05-24 15:30:02,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252048ms 2018-05-24 15:30:02,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276525ms 2018-05-24 15:30:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120073ms 2018-05-24 15:30:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87123ms 2018-05-24 15:30:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114838ms 2018-05-24 15:30:02,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224217ms 2018-05-24 15:30:02,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229059ms 2018-05-24 15:30:02,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 216784ms 2018-05-24 15:30:02,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290248ms 2018-05-24 15:30:02,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87843ms 2018-05-24 15:30:02,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 182274ms 2018-05-24 15:30:02,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252526ms 2018-05-24 15:30:02,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151584ms 2018-05-24 15:30:02,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 37370ms 2018-05-24 15:30:02,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75927ms 2018-05-24 15:30:02,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103372ms 2018-05-24 15:30:02,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 195458ms 2018-05-24 15:30:02,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273516ms 2018-05-24 15:30:02,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108928ms 2018-05-24 15:30:02,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 274295ms 2018-05-24 15:30:02,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251469ms 2018-05-24 15:30:03,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63497ms 2018-05-24 15:30:03,016 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 31331ms 2018-05-24 15:30:03,016 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221275ms 2018-05-24 15:30:03,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51164ms 2018-05-24 15:30:03,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 128294ms 2018-05-24 15:30:03,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203623ms 2018-05-24 15:30:03,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 77686ms 2018-05-24 15:30:03,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 207673ms 2018-05-24 15:30:03,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118813ms 2018-05-24 15:30:03,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207151ms 2018-05-24 15:30:03,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 144329ms 2018-05-24 15:30:03,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140288ms 2018-05-24 15:30:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 209425ms 2018-05-24 15:30:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194355ms 2018-05-24 15:30:03,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176937ms 2018-05-24 15:30:03,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 189996ms 2018-05-24 15:30:03,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284591ms 2018-05-24 15:30:03,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101884ms 2018-05-24 15:30:03,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205906ms 2018-05-24 15:30:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 18528ms 2018-05-24 15:30:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241936ms 2018-05-24 15:30:03,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 137660ms 2018-05-24 15:30:03,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125978ms 2018-05-24 15:30:03,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167924ms 2018-05-24 15:30:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128955ms 2018-05-24 15:30:03,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 205832ms 2018-05-24 15:30:03,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168995ms 2018-05-24 15:30:03,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 257529ms 2018-05-24 15:30:03,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31399ms 2018-05-24 15:30:03,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263828ms 2018-05-24 15:30:04,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 248234ms 2018-05-24 15:30:04,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173003ms 2018-05-24 15:30:04,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293118ms 2018-05-24 15:30:04,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 84361ms 2018-05-24 15:30:04,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11517ms 2018-05-24 15:30:04,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103890ms 2018-05-24 15:30:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285477ms 2018-05-24 15:30:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 98109ms 2018-05-24 15:30:04,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75370ms 2018-05-24 15:30:04,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249301ms 2018-05-24 15:30:04,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 79737ms 2018-05-24 15:30:04,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170063ms 2018-05-24 15:30:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:04,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87602ms 2018-05-24 15:30:04,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 272764ms 2018-05-24 15:30:04,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195771ms 2018-05-24 15:30:04,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 94069ms 2018-05-24 15:30:04,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7132ms 2018-05-24 15:30:04,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1216ms 2018-05-24 15:30:04,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111852ms 2018-05-24 15:30:04,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 57220ms 2018-05-24 15:30:04,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227750ms 2018-05-24 15:30:04,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:04,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200049ms 2018-05-24 15:30:04,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 100812ms 2018-05-24 15:30:04,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8003ms 2018-05-24 15:30:04,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 36406ms 2018-05-24 15:30:04,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182691ms 2018-05-24 15:30:04,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290587ms 2018-05-24 15:30:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187884ms 2018-05-24 15:30:04,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 260302ms 2018-05-24 15:30:04,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136982ms 2018-05-24 15:30:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238234ms 2018-05-24 15:30:05,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 74697ms 2018-05-24 15:30:05,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258430ms 2018-05-24 15:30:05,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262817ms 2018-05-24 15:30:05,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 162572ms 2018-05-24 15:30:05,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99687ms 2018-05-24 15:30:05,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 141460ms 2018-05-24 15:30:05,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268599ms 2018-05-24 15:30:05,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184635ms 2018-05-24 15:30:05,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 159897ms 2018-05-24 15:30:05,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294478ms 2018-05-24 15:30:05,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274981ms 2018-05-24 15:30:05,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 105287ms 2018-05-24 15:30:05,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213292ms 2018-05-24 15:30:05,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 153552ms 2018-05-24 15:30:05,463 DEBUG [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(295): RegionReplicaHostCostFunction not needed 2018-05-24 15:30:05,463 DEBUG [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(295): RegionReplicaRackCostFunction not needed 2018-05-24 15:30:05,463 INFO [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(375): start StochasticLoadBalancer.balancer, initCost=535.0, functionCost=RegionCountSkewCostFunction : (500.0, 1.0); PrimaryRegionCountSkewCostFunction : (500.0, 0.0); MoveCostFunction : (7.0, 0.0); ServerLocalityCostFunction : (25.0, 0.0); RackLocalityCostFunction : (15.0, 0.0); TableSkewCostFunction : (35.0, 1.0); RegionReplicaHostCostFunction : (100000.0, 0.0); RegionReplicaRackCostFunction : (10000.0, 0.0); ReadRequestCostFunction : (5.0, 0.0); WriteRequestCostFunction : (5.0, 0.0); MemStoreSizeCostFunction : (5.0, 0.0); StoreFileCostFunction : (5.0, 0.0); 2018-05-24 15:30:05,504 DEBUG [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(435): Finished computing new load balance plan. Computation took 41ms to try 7200 different iterations. Found a solution that moves 2 regions; Going from a computed cost of 535.0 to a new cost of 39.666666666666664 2018-05-24 15:30:05,504 INFO [master/zhangduo-ubuntu:0.Chore.1] master.HMaster(1468): Balancer plans size is 2, the balance interval is 150000 ms, and the max number regions in transition is 3 2018-05-24 15:30:05,504 INFO [master/zhangduo-ubuntu:0.Chore.1] master.HMaster(1473): balance hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:05,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141623ms 2018-05-24 15:30:05,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 193137ms 2018-05-24 15:30:05,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108770ms 2018-05-24 15:30:05,506 INFO [RS-EventLoopGroup-11-7] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:30:05,506 INFO [RS-EventLoopGroup-11-7] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46690 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:30:05,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 254737ms 2018-05-24 15:30:05,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169317ms 2018-05-24 15:30:05,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290324ms 2018-05-24 15:30:05,622 DEBUG [master/zhangduo-ubuntu:0.Chore.1] procedure2.ProcedureExecutor(884): Stored pid=33, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:05,623 INFO [PEWorker-6] procedure.MasterProcedureScheduler(640): pid=33, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952 checking lock on d77868aa490028a29e5134871d432554 2018-05-24 15:30:05,624 INFO [PEWorker-6] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039}] 2018-05-24 15:30:05,624 INFO [master/zhangduo-ubuntu:0.Chore.1] master.HMaster(1473): balance hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:05,635 INFO [PEWorker-6] procedure.MasterProcedureScheduler(640): pid=34, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039 checking lock on d77868aa490028a29e5134871d432554 2018-05-24 15:30:05,635 INFO [PEWorker-6] assignment.RegionStateStore(197): pid=34 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=CLOSING, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,639 INFO [PEWorker-6] assignment.RegionTransitionProcedure(251): Dispatch pid=34, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,654 DEBUG [master/zhangduo-ubuntu:0.Chore.1] procedure2.ProcedureExecutor(884): Stored pid=35, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:05,655 INFO [PEWorker-9] procedure.MasterProcedureScheduler(640): pid=35, state=RUNNABLE:MOVE_REGION_UNASSIGN; MoveRegionProcedure hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007 checking lock on 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:30:05,656 INFO [PEWorker-9] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039}] 2018-05-24 15:30:05,679 INFO [PEWorker-9] procedure.MasterProcedureScheduler(640): pid=36, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039 checking lock on 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:30:05,679 INFO [PEWorker-9] assignment.RegionStateStore(197): pid=36 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=CLOSING, regionLocation=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,682 INFO [PEWorker-9] assignment.RegionTransitionProcedure(251): Dispatch pid=36, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150254ms 2018-05-24 15:30:05,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because info has an old edit so flush to free WALs after random delay 18576ms 2018-05-24 15:30:05,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98862ms 2018-05-24 15:30:05,792 INFO [RS-EventLoopGroup-11-8] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:30:05,792 INFO [RS-EventLoopGroup-11-8] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46692 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:30:05,792 INFO [RpcServer.priority.FPBQ.Fifo.handler=4,queue=0,port=42271] regionserver.RSRpcServices(1607): Close 338f611b3d7ef43c4ac40748d46eac23, moving to zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:05,793 INFO [RpcServer.priority.FPBQ.Fifo.handler=4,queue=0,port=42271] regionserver.RSRpcServices(1607): Close d77868aa490028a29e5134871d432554, moving to zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:05,794 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 338f611b3d7ef43c4ac40748d46eac23, disabling compactions & flushes 2018-05-24 15:30:05,794 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:05,795 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(2572): Flushing 1/1 column families, dataSize=32 B heapSize=104 B 2018-05-24 15:30:05,795 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1515): Closing d77868aa490028a29e5134871d432554, disabling compactions & flushes 2018-05-24 15:30:05,796 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1555): Updates disabled for region hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:05,796 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(2572): Flushing 1/1 column families, dataSize=78 B heapSize=232 B 2018-05-24 15:30:05,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191867ms 2018-05-24 15:30:05,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86571ms 2018-05-24 15:30:05,847 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:30:05,847 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:30:05,847 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741844_1020{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:30:05,848 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/.tmp/info/8077440a6f6a4575a2a31e39205d1caf 2018-05-24 15:30:05,849 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:30:05,849 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:30:05,849 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:30:05,852 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=32 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/.tmp/cf/db4a147978e745caa467db4386523585 2018-05-24 15:30:05,869 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/.tmp/info/8077440a6f6a4575a2a31e39205d1caf as hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info/8077440a6f6a4575a2a31e39205d1caf 2018-05-24 15:30:05,869 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/.tmp/cf/db4a147978e745caa467db4386523585 as hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf/db4a147978e745caa467db4386523585 2018-05-24 15:30:05,877 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HStore(1070): Added hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf/db4a147978e745caa467db4386523585, entries=1, sequenceid=5, filesize=4.7 K 2018-05-24 15:30:05,877 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HStore(1070): Added hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info/8077440a6f6a4575a2a31e39205d1caf, entries=2, sequenceid=6, filesize=4.8 K 2018-05-24 15:30:05,880 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(2781): Finished flush of dataSize ~32 B/32, heapSize ~320 B/320, currentSize=0 B/0 for 338f611b3d7ef43c4ac40748d46eac23 in 84ms, sequenceid=5, compaction requested=false 2018-05-24 15:30:05,880 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(2781): Finished flush of dataSize ~78 B/78, heapSize ~448 B/448, currentSize=0 B/0 for d77868aa490028a29e5134871d432554 in 83ms, sequenceid=6, compaction requested=false 2018-05-24 15:30:05,902 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2018-05-24 15:30:05,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145156ms 2018-05-24 15:30:05,905 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegion(1669): Closed hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:05,905 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2018-05-24 15:30:05,905 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] regionserver.HRegionServer(3423): Adding d77868aa490028a29e5134871d432554 move to zhangduo-ubuntu,34061,1527146698952 record at close sequenceid=6 2018-05-24 15:30:05,907 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:05,908 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegionServer(3423): Adding 338f611b3d7ef43c4ac40748d46eac23 move to zhangduo-ubuntu,37499,1527146699007 record at close sequenceid=5 2018-05-24 15:30:05,908 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report CLOSED seqId=-1, pid=34, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report CLOSED seqId=-1, pid=36, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,910 DEBUG [PEWorker-8] assignment.RegionTransitionProcedure(363): Finishing pid=36, ppid=35, state=RUNNABLE:REGION_TRANSITION_FINISH; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,910 DEBUG [PEWorker-10] assignment.RegionTransitionProcedure(363): Finishing pid=34, ppid=33, state=RUNNABLE:REGION_TRANSITION_FINISH; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039; rit=CLOSING, location=zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:30:05,910 INFO [PEWorker-8] assignment.RegionStateStore(197): pid=36 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=CLOSED 2018-05-24 15:30:05,910 INFO [PEWorker-10] assignment.RegionStateStore(197): pid=34 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=CLOSED 2018-05-24 15:30:05,910 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-1] handler.CloseRegionHandler(124): Closed hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:05,910 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:05,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145570ms 2018-05-24 15:30:06,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68384ms 2018-05-24 15:30:06,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272888ms 2018-05-24 15:30:06,041 INFO [PEWorker-10] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=33, state=RUNNABLE:MOVE_REGION_ASSIGN; MoveRegionProcedure hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952; resume parent processing. 2018-05-24 15:30:06,041 INFO [PEWorker-12] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952}] 2018-05-24 15:30:06,041 INFO [PEWorker-10] procedure2.ProcedureExecutor(1265): Finished pid=34, ppid=33, state=SUCCESS; UnassignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, server=zhangduo-ubuntu,42271,1527146699039 in 293msec 2018-05-24 15:30:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44720ms 2018-05-24 15:30:06,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183085ms 2018-05-24 15:30:06,114 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:06,153 INFO [PEWorker-8] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=35, state=RUNNABLE:MOVE_REGION_ASSIGN; MoveRegionProcedure hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007; resume parent processing. 2018-05-24 15:30:06,153 INFO [PEWorker-14] procedure.MasterProcedureScheduler(640): pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952 checking lock on d77868aa490028a29e5134871d432554 2018-05-24 15:30:06,153 INFO [PEWorker-13] procedure2.ProcedureExecutor(1515): Initialized subprocedures=[{pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007}] 2018-05-24 15:30:06,153 INFO [PEWorker-8] procedure2.ProcedureExecutor(1265): Finished pid=36, ppid=35, state=SUCCESS; UnassignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, server=zhangduo-ubuntu,42271,1527146699039 in 261msec 2018-05-24 15:30:06,155 INFO [PEWorker-14] assignment.AssignProcedure(218): Starting pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952; rit=OFFLINE, location=zhangduo-ubuntu,34061,1527146698952; forceNewPlan=false, retain=false 2018-05-24 15:30:06,166 INFO [PEWorker-14] procedure.MasterProcedureScheduler(640): pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007 checking lock on 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:30:06,168 INFO [PEWorker-14] assignment.AssignProcedure(218): Starting pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_QUEUE; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007; rit=OFFLINE, location=zhangduo-ubuntu,37499,1527146699007; forceNewPlan=false, retain=false 2018-05-24 15:30:06,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39914ms 2018-05-24 15:30:06,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229652ms 2018-05-24 15:30:06,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82357ms 2018-05-24 15:30:06,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53187ms 2018-05-24 15:30:06,313 INFO [master/zhangduo-ubuntu:0] balancer.BaseLoadBalancer(1489): Reassigned 2 regions. 2 retained the pre-restart assignment. 2018-05-24 15:30:06,313 INFO [PEWorker-2] assignment.RegionStateStore(197): pid=38 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=OPENING, regionLocation=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,313 INFO [PEWorker-15] assignment.RegionStateStore(197): pid=37 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=OPENING, regionLocation=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,316 INFO [PEWorker-2] assignment.RegionTransitionProcedure(251): Dispatch pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007; rit=OPENING, location=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,317 INFO [PEWorker-15] assignment.RegionTransitionProcedure(251): Dispatch pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952; rit=OPENING, location=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:30:06,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31159ms 2018-05-24 15:30:06,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85778ms 2018-05-24 15:30:06,469 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:30:06,470 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 44452 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:30:06,469 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:30:06,470 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 39496 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:30:06,471 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=34061] regionserver.RSRpcServices(1983): Open hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:06,471 INFO [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=37499] regionserver.RSRpcServices(1983): Open SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:06,481 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => 338f611b3d7ef43c4ac40748d46eac23, NAME => 'SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:30:06,481 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table SyncRep 338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:30:06,481 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:30:06,482 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(7105): Opening region: {ENCODED => d77868aa490028a29e5134871d432554, NAME => 'hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.', STARTKEY => '', ENDKEY => ''} 2018-05-24 15:30:06,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.MetricsRegionSourceImpl(75): Creating new MetricsRegionSourceImpl for table namespace d77868aa490028a29e5134871d432554 2018-05-24 15:30:06,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(828): Instantiated hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2018-05-24 15:30:06,489 DEBUG [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf 2018-05-24 15:30:06,489 DEBUG [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf 2018-05-24 15:30:06,490 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] hfile.CacheConfig(239): Created cacheConfig for cf: blockCache=LruBlockCache{blockCount=1, currentSize=532.46 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=532.46 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:30:06,490 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:30:06,490 DEBUG [StoreOpener-d77868aa490028a29e5134871d432554-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info 2018-05-24 15:30:06,490 DEBUG [StoreOpener-d77868aa490028a29e5134871d432554-1] util.CommonFSUtils(565): Set storagePolicy=HOT for path=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info 2018-05-24 15:30:06,491 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] hfile.CacheConfig(239): Created cacheConfig for info: blockCache=LruBlockCache{blockCount=1, currentSize=532.46 KB, freeSize=707.08 MB, maxSize=707.60 MB, heapSize=532.46 KB, minSize=672.22 MB, minFactor=0.95, multiSize=336.11 MB, multiFactor=0.5, singleSize=168.06 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-24 15:30:06,491 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] compactions.CompactionConfiguration(147): size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-24 15:30:06,500 DEBUG [StoreOpener-d77868aa490028a29e5134871d432554-1] regionserver.HStore(581): loaded hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/info/8077440a6f6a4575a2a31e39205d1caf 2018-05-24 15:30:06,500 INFO [StoreOpener-d77868aa490028a29e5134871d432554-1] regionserver.HStore(327): Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:30:06,502 DEBUG [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] regionserver.HStore(581): loaded hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/cf/db4a147978e745caa467db4386523585 2018-05-24 15:30:06,503 INFO [StoreOpener-338f611b3d7ef43c4ac40748d46eac23-1] regionserver.HStore(327): Store=cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50 2018-05-24 15:30:06,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554 2018-05-24 15:30:06,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173922ms 2018-05-24 15:30:06,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51274ms 2018-05-24 15:30:06,507 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(4486): Found 0 recovered edits file(s) under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23 2018-05-24 15:30:06,508 INFO [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened d77868aa490028a29e5134871d432554; next sequenceid=10 2018-05-24 15:30:06,510 INFO [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(976): Opened 338f611b3d7ef43c4ac40748d46eac23; next sequenceid=9 2018-05-24 15:30:06,510 INFO [PostOpenDeployTasks:d77868aa490028a29e5134871d432554] regionserver.HRegionServer(2188): Post open deploy tasks for hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:06,511 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=10, pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952; rit=OPENING, location=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,511 DEBUG [PEWorker-3] assignment.RegionTransitionProcedure(363): Finishing pid=37, ppid=33, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952; rit=OPENING, location=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,511 DEBUG [PostOpenDeployTasks:d77868aa490028a29e5134871d432554] regionserver.HRegionServer(2212): Finished post open deploy task for hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:30:06,511 INFO [PEWorker-3] assignment.RegionStateStore(197): pid=37 updating hbase:meta row=d77868aa490028a29e5134871d432554, regionState=OPEN, openSeqNum=10, regionLocation=zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. on zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:30:06,516 INFO [PostOpenDeployTasks:338f611b3d7ef43c4ac40748d46eac23] regionserver.HRegionServer(2188): Post open deploy tasks for SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:06,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39993] assignment.RegionTransitionProcedure(273): Received report OPENED seqId=9, pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007; rit=OPENING, location=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,517 DEBUG [PEWorker-5] assignment.RegionTransitionProcedure(363): Finishing pid=38, ppid=35, state=RUNNABLE:REGION_TRANSITION_FINISH; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007; rit=OPENING, location=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,517 DEBUG [PostOpenDeployTasks:338f611b3d7ef43c4ac40748d46eac23] regionserver.HRegionServer(2212): Finished post open deploy task for SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:30:06,517 INFO [PEWorker-5] assignment.RegionStateStore(197): pid=38 updating hbase:meta row=338f611b3d7ef43c4ac40748d46eac23, regionState=OPEN, repBarrier=9, openSeqNum=9, regionLocation=zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,519 DEBUG [RS_OPEN_REGION-regionserver/zhangduo-ubuntu:0-0] handler.OpenRegionHandler(128): Opened SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. on zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:30:06,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=33, state=RUNNABLE; MoveRegionProcedure hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952; resume parent processing. 2018-05-24 15:30:06,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1265): Finished pid=37, ppid=33, state=SUCCESS; AssignProcedure table=hbase:namespace, region=d77868aa490028a29e5134871d432554, target=zhangduo-ubuntu,34061,1527146698952 in 479msec 2018-05-24 15:30:06,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1634): Finished subprocedure(s) of pid=35, state=RUNNABLE; MoveRegionProcedure hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007; resume parent processing. 2018-05-24 15:30:06,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1265): Finished pid=38, ppid=35, state=SUCCESS; AssignProcedure table=SyncRep, region=338f611b3d7ef43c4ac40748d46eac23, target=zhangduo-ubuntu,37499,1527146699007 in 369msec 2018-05-24 15:30:06,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148277ms 2018-05-24 15:30:06,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172121ms 2018-05-24 15:30:06,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1265): Finished pid=35, state=SUCCESS; MoveRegionProcedure hri=338f611b3d7ef43c4ac40748d46eac23, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,37499,1527146699007 in 925msec 2018-05-24 15:30:06,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1265): Finished pid=33, state=SUCCESS; MoveRegionProcedure hri=d77868aa490028a29e5134871d432554, source=zhangduo-ubuntu,42271,1527146699039, destination=zhangduo-ubuntu,34061,1527146698952 in 1.0430sec 2018-05-24 15:30:06,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296711ms 2018-05-24 15:30:06,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146527ms 2018-05-24 15:30:06,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183243ms 2018-05-24 15:30:06,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233691ms 2018-05-24 15:30:06,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230311ms 2018-05-24 15:30:06,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127078ms 2018-05-24 15:30:07,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216148ms 2018-05-24 15:30:07,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58992ms 2018-05-24 15:30:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66252ms 2018-05-24 15:30:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255889ms 2018-05-24 15:30:07,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97259ms 2018-05-24 15:30:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140302ms 2018-05-24 15:30:07,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87156ms 2018-05-24 15:30:07,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155884ms 2018-05-24 15:30:07,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51266ms 2018-05-24 15:30:07,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183655ms 2018-05-24 15:30:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201257ms 2018-05-24 15:30:07,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224515ms 2018-05-24 15:30:07,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288108ms 2018-05-24 15:30:07,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142943ms 2018-05-24 15:30:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115054ms 2018-05-24 15:30:07,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287185ms 2018-05-24 15:30:07,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173691ms 2018-05-24 15:30:07,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107209ms 2018-05-24 15:30:07,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205397ms 2018-05-24 15:30:07,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288870ms 2018-05-24 15:30:08,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20451ms 2018-05-24 15:30:08,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9565ms 2018-05-24 15:30:08,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177517ms 2018-05-24 15:30:08,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47315ms 2018-05-24 15:30:08,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210846ms 2018-05-24 15:30:08,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296312ms 2018-05-24 15:30:08,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259385ms 2018-05-24 15:30:08,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262933ms 2018-05-24 15:30:08,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152457ms 2018-05-24 15:30:08,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158159ms 2018-05-24 15:30:08,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79068ms 2018-05-24 15:30:08,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207932ms 2018-05-24 15:30:08,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291883ms 2018-05-24 15:30:08,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262961ms 2018-05-24 15:30:08,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100656ms 2018-05-24 15:30:08,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114072ms 2018-05-24 15:30:08,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89973ms 2018-05-24 15:30:08,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122265ms 2018-05-24 15:30:08,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70070ms 2018-05-24 15:30:08,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5919ms 2018-05-24 15:30:09,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86981ms 2018-05-24 15:30:09,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 33453ms 2018-05-24 15:30:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197768ms 2018-05-24 15:30:09,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122460ms 2018-05-24 15:30:09,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251717ms 2018-05-24 15:30:09,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257814ms 2018-05-24 15:30:09,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245963ms 2018-05-24 15:30:09,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243159ms 2018-05-24 15:30:09,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:09,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:09,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225872ms 2018-05-24 15:30:09,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280220ms 2018-05-24 15:30:09,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132096ms 2018-05-24 15:30:09,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57661ms 2018-05-24 15:30:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28949ms 2018-05-24 15:30:09,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 96701ms 2018-05-24 15:30:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:09,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291608ms 2018-05-24 15:30:09,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262828ms 2018-05-24 15:30:09,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 69139ms 2018-05-24 15:30:09,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248169ms 2018-05-24 15:30:09,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 130343ms 2018-05-24 15:30:09,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36381ms 2018-05-24 15:30:10,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249989ms 2018-05-24 15:30:10,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180157ms 2018-05-24 15:30:10,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250642ms 2018-05-24 15:30:10,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 80047ms 2018-05-24 15:30:10,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55319ms 2018-05-24 15:30:10,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287738ms 2018-05-24 15:30:10,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273315ms 2018-05-24 15:30:10,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276172ms 2018-05-24 15:30:10,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19958ms 2018-05-24 15:30:10,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138370ms 2018-05-24 15:30:10,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21659ms 2018-05-24 15:30:10,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127066ms 2018-05-24 15:30:10,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297223ms 2018-05-24 15:30:10,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73327ms 2018-05-24 15:30:10,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 40583ms 2018-05-24 15:30:10,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191776ms 2018-05-24 15:30:10,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 139725ms 2018-05-24 15:30:10,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275216ms 2018-05-24 15:30:10,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142571ms 2018-05-24 15:30:10,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54002ms 2018-05-24 15:30:11,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96718ms 2018-05-24 15:30:11,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53120ms 2018-05-24 15:30:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208858ms 2018-05-24 15:30:11,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294108ms 2018-05-24 15:30:11,115 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240847ms 2018-05-24 15:30:11,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277348ms 2018-05-24 15:30:11,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194952ms 2018-05-24 15:30:11,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155271ms 2018-05-24 15:30:11,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73499ms 2018-05-24 15:30:11,408 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:30:11,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273537ms 2018-05-24 15:30:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149879ms 2018-05-24 15:30:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298538ms 2018-05-24 15:30:11,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189699ms 2018-05-24 15:30:11,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119032ms 2018-05-24 15:30:11,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97805ms 2018-05-24 15:30:11,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81168ms 2018-05-24 15:30:11,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37375ms 2018-05-24 15:30:11,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 217152ms 2018-05-24 15:30:11,834 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:30:11,835 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(51): Creating new MetricsTableSourceImpl for table 2018-05-24 15:30:11,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247623ms 2018-05-24 15:30:11,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81570ms 2018-05-24 15:30:12,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120818ms 2018-05-24 15:30:12,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202590ms 2018-05-24 15:30:12,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284230ms 2018-05-24 15:30:12,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192018ms 2018-05-24 15:30:12,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 22572ms 2018-05-24 15:30:12,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35394ms 2018-05-24 15:30:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91624ms 2018-05-24 15:30:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260643ms 2018-05-24 15:30:12,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281354ms 2018-05-24 15:30:12,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10113ms 2018-05-24 15:30:12,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150066ms 2018-05-24 15:30:12,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281111ms 2018-05-24 15:30:12,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132600ms 2018-05-24 15:30:12,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72427ms 2018-05-24 15:30:12,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140137ms 2018-05-24 15:30:12,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241591ms 2018-05-24 15:30:12,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119798ms 2018-05-24 15:30:12,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19337ms 2018-05-24 15:30:12,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 143744ms 2018-05-24 15:30:12,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19225ms 2018-05-24 15:30:13,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165688ms 2018-05-24 15:30:13,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87541ms 2018-05-24 15:30:13,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95947ms 2018-05-24 15:30:13,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148177ms 2018-05-24 15:30:13,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206567ms 2018-05-24 15:30:13,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176693ms 2018-05-24 15:30:13,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105042ms 2018-05-24 15:30:13,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272758ms 2018-05-24 15:30:13,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109349ms 2018-05-24 15:30:13,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96597ms 2018-05-24 15:30:13,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140129ms 2018-05-24 15:30:13,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186735ms 2018-05-24 15:30:13,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290478ms 2018-05-24 15:30:13,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66976ms 2018-05-24 15:30:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260220ms 2018-05-24 15:30:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102682ms 2018-05-24 15:30:13,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233369ms 2018-05-24 15:30:13,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94139ms 2018-05-24 15:30:13,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222608ms 2018-05-24 15:30:13,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75417ms 2018-05-24 15:30:14,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146846ms 2018-05-24 15:30:14,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266046ms 2018-05-24 15:30:14,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122725ms 2018-05-24 15:30:14,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156058ms 2018-05-24 15:30:14,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267250ms 2018-05-24 15:30:14,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201360ms 2018-05-24 15:30:14,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150639ms 2018-05-24 15:30:14,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252962ms 2018-05-24 15:30:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:14,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193006ms 2018-05-24 15:30:14,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55902ms 2018-05-24 15:30:14,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133476ms 2018-05-24 15:30:14,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299669ms 2018-05-24 15:30:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8174ms 2018-05-24 15:30:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157015ms 2018-05-24 15:30:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:14,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:14,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216520ms 2018-05-24 15:30:14,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276260ms 2018-05-24 15:30:14,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67061ms 2018-05-24 15:30:14,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 743ms 2018-05-24 15:30:14,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44867ms 2018-05-24 15:30:14,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258995ms 2018-05-24 15:30:15,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289133ms 2018-05-24 15:30:15,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267598ms 2018-05-24 15:30:15,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44468ms 2018-05-24 15:30:15,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115526ms 2018-05-24 15:30:15,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100044ms 2018-05-24 15:30:15,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40924ms 2018-05-24 15:30:15,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264608ms 2018-05-24 15:30:15,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106567ms 2018-05-24 15:30:15,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236338ms 2018-05-24 15:30:15,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209996ms 2018-05-24 15:30:15,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190371ms 2018-05-24 15:30:15,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105847ms 2018-05-24 15:30:15,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5679ms 2018-05-24 15:30:15,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58298ms 2018-05-24 15:30:15,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270278ms 2018-05-24 15:30:15,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33167ms 2018-05-24 15:30:15,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279330ms 2018-05-24 15:30:15,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220546ms 2018-05-24 15:30:15,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271857ms 2018-05-24 15:30:15,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269681ms 2018-05-24 15:30:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38555ms 2018-05-24 15:30:16,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251735ms 2018-05-24 15:30:16,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191832ms 2018-05-24 15:30:16,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137808ms 2018-05-24 15:30:16,116 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:16,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116130ms 2018-05-24 15:30:16,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282524ms 2018-05-24 15:30:16,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201585ms 2018-05-24 15:30:16,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132344ms 2018-05-24 15:30:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45233ms 2018-05-24 15:30:16,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212258ms 2018-05-24 15:30:16,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286182ms 2018-05-24 15:30:16,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252092ms 2018-05-24 15:30:16,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85596ms 2018-05-24 15:30:16,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75455ms 2018-05-24 15:30:16,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83238ms 2018-05-24 15:30:16,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93499ms 2018-05-24 15:30:16,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276817ms 2018-05-24 15:30:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213991ms 2018-05-24 15:30:16,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297526ms 2018-05-24 15:30:16,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267565ms 2018-05-24 15:30:17,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251066ms 2018-05-24 15:30:17,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194378ms 2018-05-24 15:30:17,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259236ms 2018-05-24 15:30:17,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129807ms 2018-05-24 15:30:17,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276128ms 2018-05-24 15:30:17,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205322ms 2018-05-24 15:30:17,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129116ms 2018-05-24 15:30:17,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208361ms 2018-05-24 15:30:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175433ms 2018-05-24 15:30:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125559ms 2018-05-24 15:30:17,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278387ms 2018-05-24 15:30:17,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286681ms 2018-05-24 15:30:17,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32258ms 2018-05-24 15:30:17,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298216ms 2018-05-24 15:30:17,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182817ms 2018-05-24 15:30:17,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25854ms 2018-05-24 15:30:17,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148439ms 2018-05-24 15:30:17,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258264ms 2018-05-24 15:30:17,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191340ms 2018-05-24 15:30:17,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19394ms 2018-05-24 15:30:18,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95679ms 2018-05-24 15:30:18,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272731ms 2018-05-24 15:30:18,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178239ms 2018-05-24 15:30:18,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1828ms 2018-05-24 15:30:18,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288373ms 2018-05-24 15:30:18,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284892ms 2018-05-24 15:30:18,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95033ms 2018-05-24 15:30:18,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155202ms 2018-05-24 15:30:18,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32193ms 2018-05-24 15:30:18,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82580ms 2018-05-24 15:30:18,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27938ms 2018-05-24 15:30:18,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198368ms 2018-05-24 15:30:18,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220182ms 2018-05-24 15:30:18,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272553ms 2018-05-24 15:30:18,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12248ms 2018-05-24 15:30:18,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84663ms 2018-05-24 15:30:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213889ms 2018-05-24 15:30:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24372ms 2018-05-24 15:30:18,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229064ms 2018-05-24 15:30:18,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291389ms 2018-05-24 15:30:19,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71181ms 2018-05-24 15:30:19,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132289ms 2018-05-24 15:30:19,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212089ms 2018-05-24 15:30:19,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213964ms 2018-05-24 15:30:19,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93957ms 2018-05-24 15:30:19,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245062ms 2018-05-24 15:30:19,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240034ms 2018-05-24 15:30:19,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79890ms 2018-05-24 15:30:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:19,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203314ms 2018-05-24 15:30:19,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113311ms 2018-05-24 15:30:19,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173083ms 2018-05-24 15:30:19,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162613ms 2018-05-24 15:30:19,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230595ms 2018-05-24 15:30:19,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148357ms 2018-05-24 15:30:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:19,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88528ms 2018-05-24 15:30:19,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24224ms 2018-05-24 15:30:19,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44893ms 2018-05-24 15:30:19,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87032ms 2018-05-24 15:30:19,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100370ms 2018-05-24 15:30:19,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19119ms 2018-05-24 15:30:20,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147361ms 2018-05-24 15:30:20,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131128ms 2018-05-24 15:30:20,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15752ms 2018-05-24 15:30:20,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114579ms 2018-05-24 15:30:20,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289385ms 2018-05-24 15:30:20,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267965ms 2018-05-24 15:30:20,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123908ms 2018-05-24 15:30:20,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128962ms 2018-05-24 15:30:20,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118481ms 2018-05-24 15:30:20,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101683ms 2018-05-24 15:30:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168656ms 2018-05-24 15:30:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246206ms 2018-05-24 15:30:20,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50578ms 2018-05-24 15:30:20,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264693ms 2018-05-24 15:30:20,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 90630ms 2018-05-24 15:30:20,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223936ms 2018-05-24 15:30:20,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211593ms 2018-05-24 15:30:20,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212101ms 2018-05-24 15:30:20,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194847ms 2018-05-24 15:30:20,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168865ms 2018-05-24 15:30:20,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172919ms 2018-05-24 15:30:21,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198053ms 2018-05-24 15:30:21,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67139ms 2018-05-24 15:30:21,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73989ms 2018-05-24 15:30:21,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189922ms 2018-05-24 15:30:21,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280789ms 2018-05-24 15:30:21,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279807ms 2018-05-24 15:30:21,116 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:21,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45380ms 2018-05-24 15:30:21,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17400ms 2018-05-24 15:30:21,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243305ms 2018-05-24 15:30:21,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68181ms 2018-05-24 15:30:21,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236595ms 2018-05-24 15:30:21,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184662ms 2018-05-24 15:30:21,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133510ms 2018-05-24 15:30:21,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294061ms 2018-05-24 15:30:21,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203291ms 2018-05-24 15:30:21,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172120ms 2018-05-24 15:30:21,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80633ms 2018-05-24 15:30:21,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221769ms 2018-05-24 15:30:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88996ms 2018-05-24 15:30:21,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284762ms 2018-05-24 15:30:21,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42549ms 2018-05-24 15:30:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167735ms 2018-05-24 15:30:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170273ms 2018-05-24 15:30:21,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172507ms 2018-05-24 15:30:21,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83079ms 2018-05-24 15:30:21,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 169279ms 2018-05-24 15:30:21,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293576ms 2018-05-24 15:30:21,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148371ms 2018-05-24 15:30:21,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202871ms 2018-05-24 15:30:21,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100988ms 2018-05-24 15:30:22,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279903ms 2018-05-24 15:30:22,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233417ms 2018-05-24 15:30:22,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70205ms 2018-05-24 15:30:22,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266888ms 2018-05-24 15:30:22,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74502ms 2018-05-24 15:30:22,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148286ms 2018-05-24 15:30:22,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38878ms 2018-05-24 15:30:22,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77519ms 2018-05-24 15:30:22,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275268ms 2018-05-24 15:30:22,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227209ms 2018-05-24 15:30:22,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240802ms 2018-05-24 15:30:22,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146726ms 2018-05-24 15:30:22,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280460ms 2018-05-24 15:30:22,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17405ms 2018-05-24 15:30:22,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8947ms 2018-05-24 15:30:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8052ms 2018-05-24 15:30:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93227ms 2018-05-24 15:30:22,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2342ms 2018-05-24 15:30:22,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209011ms 2018-05-24 15:30:22,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211438ms 2018-05-24 15:30:22,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230161ms 2018-05-24 15:30:22,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218994ms 2018-05-24 15:30:22,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134714ms 2018-05-24 15:30:22,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12193ms 2018-05-24 15:30:22,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19994ms 2018-05-24 15:30:22,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204557ms 2018-05-24 15:30:22,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109227ms 2018-05-24 15:30:22,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 239912ms 2018-05-24 15:30:22,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183288ms 2018-05-24 15:30:22,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111333ms 2018-05-24 15:30:23,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116594ms 2018-05-24 15:30:23,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284862ms 2018-05-24 15:30:23,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290687ms 2018-05-24 15:30:23,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112269ms 2018-05-24 15:30:23,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289533ms 2018-05-24 15:30:23,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182285ms 2018-05-24 15:30:23,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210156ms 2018-05-24 15:30:23,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184220ms 2018-05-24 15:30:23,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9588ms 2018-05-24 15:30:23,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9061ms 2018-05-24 15:30:23,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49523ms 2018-05-24 15:30:23,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295317ms 2018-05-24 15:30:23,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 918ms 2018-05-24 15:30:23,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293192ms 2018-05-24 15:30:23,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1988ms 2018-05-24 15:30:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178401ms 2018-05-24 15:30:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295810ms 2018-05-24 15:30:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98129ms 2018-05-24 15:30:23,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273944ms 2018-05-24 15:30:23,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100856ms 2018-05-24 15:30:23,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113086ms 2018-05-24 15:30:23,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104886ms 2018-05-24 15:30:23,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115070ms 2018-05-24 15:30:23,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230847ms 2018-05-24 15:30:23,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42615ms 2018-05-24 15:30:23,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94291ms 2018-05-24 15:30:23,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146140ms 2018-05-24 15:30:23,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138572ms 2018-05-24 15:30:23,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195829ms 2018-05-24 15:30:23,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146789ms 2018-05-24 15:30:24,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263428ms 2018-05-24 15:30:24,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101157ms 2018-05-24 15:30:24,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29258ms 2018-05-24 15:30:24,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63368ms 2018-05-24 15:30:24,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76278ms 2018-05-24 15:30:24,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41894ms 2018-05-24 15:30:24,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81336ms 2018-05-24 15:30:24,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257624ms 2018-05-24 15:30:24,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27564ms 2018-05-24 15:30:24,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18880ms 2018-05-24 15:30:24,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237196ms 2018-05-24 15:30:24,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180611ms 2018-05-24 15:30:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:24,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:24,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132006ms 2018-05-24 15:30:24,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251999ms 2018-05-24 15:30:24,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99451ms 2018-05-24 15:30:24,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151360ms 2018-05-24 15:30:24,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84145ms 2018-05-24 15:30:24,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166596ms 2018-05-24 15:30:24,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226551ms 2018-05-24 15:30:24,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91193ms 2018-05-24 15:30:24,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149302ms 2018-05-24 15:30:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:24,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100818ms 2018-05-24 15:30:24,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102701ms 2018-05-24 15:30:24,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81348ms 2018-05-24 15:30:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21053ms 2018-05-24 15:30:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12356ms 2018-05-24 15:30:24,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192511ms 2018-05-24 15:30:24,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243216ms 2018-05-24 15:30:24,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191773ms 2018-05-24 15:30:24,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98939ms 2018-05-24 15:30:25,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 256281ms 2018-05-24 15:30:25,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141434ms 2018-05-24 15:30:25,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106433ms 2018-05-24 15:30:25,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125237ms 2018-05-24 15:30:25,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52946ms 2018-05-24 15:30:25,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167294ms 2018-05-24 15:30:25,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173944ms 2018-05-24 15:30:25,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72344ms 2018-05-24 15:30:25,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224993ms 2018-05-24 15:30:25,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207243ms 2018-05-24 15:30:25,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49743ms 2018-05-24 15:30:25,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76056ms 2018-05-24 15:30:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118009ms 2018-05-24 15:30:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152656ms 2018-05-24 15:30:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96879ms 2018-05-24 15:30:25,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211947ms 2018-05-24 15:30:25,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 170787ms 2018-05-24 15:30:25,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295250ms 2018-05-24 15:30:25,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177641ms 2018-05-24 15:30:25,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107019ms 2018-05-24 15:30:25,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71702ms 2018-05-24 15:30:25,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274271ms 2018-05-24 15:30:25,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125529ms 2018-05-24 15:30:25,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1270ms 2018-05-24 15:30:25,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54550ms 2018-05-24 15:30:25,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133309ms 2018-05-24 15:30:25,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173348ms 2018-05-24 15:30:25,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288645ms 2018-05-24 15:30:25,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43590ms 2018-05-24 15:30:25,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85820ms 2018-05-24 15:30:26,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230958ms 2018-05-24 15:30:26,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83550ms 2018-05-24 15:30:26,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73387ms 2018-05-24 15:30:26,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270634ms 2018-05-24 15:30:26,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 228513ms 2018-05-24 15:30:26,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208347ms 2018-05-24 15:30:26,116 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:26,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 135358ms 2018-05-24 15:30:26,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183173ms 2018-05-24 15:30:26,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82424ms 2018-05-24 15:30:26,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253992ms 2018-05-24 15:30:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60333ms 2018-05-24 15:30:26,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243723ms 2018-05-24 15:30:26,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:30:26,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69350ms 2018-05-24 15:30:26,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37451ms 2018-05-24 15:30:26,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76080ms 2018-05-24 15:30:26,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 14637ms 2018-05-24 15:30:26,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291654ms 2018-05-24 15:30:26,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18399ms 2018-05-24 15:30:26,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260035ms 2018-05-24 15:30:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253538ms 2018-05-24 15:30:26,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178560ms 2018-05-24 15:30:26,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143641ms 2018-05-24 15:30:26,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68421ms 2018-05-24 15:30:26,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19927ms 2018-05-24 15:30:26,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48020ms 2018-05-24 15:30:26,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147147ms 2018-05-24 15:30:26,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85195ms 2018-05-24 15:30:26,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43173ms 2018-05-24 15:30:26,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157798ms 2018-05-24 15:30:26,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60006ms 2018-05-24 15:30:27,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12865ms 2018-05-24 15:30:27,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295707ms 2018-05-24 15:30:27,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39174ms 2018-05-24 15:30:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164794ms 2018-05-24 15:30:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135710ms 2018-05-24 15:30:27,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168954ms 2018-05-24 15:30:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 131546ms 2018-05-24 15:30:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115641ms 2018-05-24 15:30:27,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233795ms 2018-05-24 15:30:27,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217056ms 2018-05-24 15:30:27,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251915ms 2018-05-24 15:30:27,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113818ms 2018-05-24 15:30:27,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102705ms 2018-05-24 15:30:27,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38491ms 2018-05-24 15:30:27,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190089ms 2018-05-24 15:30:27,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36698ms 2018-05-24 15:30:27,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178084ms 2018-05-24 15:30:27,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208351ms 2018-05-24 15:30:27,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132668ms 2018-05-24 15:30:27,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59247ms 2018-05-24 15:30:27,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178748ms 2018-05-24 15:30:27,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83603ms 2018-05-24 15:30:27,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163624ms 2018-05-24 15:30:27,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27089ms 2018-05-24 15:30:27,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150805ms 2018-05-24 15:30:27,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48742ms 2018-05-24 15:30:27,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89083ms 2018-05-24 15:30:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102707ms 2018-05-24 15:30:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201825ms 2018-05-24 15:30:27,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116095ms 2018-05-24 15:30:28,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83831ms 2018-05-24 15:30:28,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291627ms 2018-05-24 15:30:28,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224611ms 2018-05-24 15:30:28,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76274ms 2018-05-24 15:30:28,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186263ms 2018-05-24 15:30:28,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70386ms 2018-05-24 15:30:28,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101896ms 2018-05-24 15:30:28,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137198ms 2018-05-24 15:30:28,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108991ms 2018-05-24 15:30:28,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24181ms 2018-05-24 15:30:28,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198516ms 2018-05-24 15:30:28,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60403ms 2018-05-24 15:30:28,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159428ms 2018-05-24 15:30:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132529ms 2018-05-24 15:30:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59519ms 2018-05-24 15:30:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109505ms 2018-05-24 15:30:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121237ms 2018-05-24 15:30:28,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298494ms 2018-05-24 15:30:28,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131081ms 2018-05-24 15:30:28,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67723ms 2018-05-24 15:30:28,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140773ms 2018-05-24 15:30:28,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63753ms 2018-05-24 15:30:28,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255099ms 2018-05-24 15:30:28,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9995ms 2018-05-24 15:30:28,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207574ms 2018-05-24 15:30:28,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274617ms 2018-05-24 15:30:28,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281340ms 2018-05-24 15:30:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225103ms 2018-05-24 15:30:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153604ms 2018-05-24 15:30:28,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36978ms 2018-05-24 15:30:29,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10924ms 2018-05-24 15:30:29,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74321ms 2018-05-24 15:30:29,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72235ms 2018-05-24 15:30:29,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278328ms 2018-05-24 15:30:29,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213601ms 2018-05-24 15:30:29,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228324ms 2018-05-24 15:30:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12021ms 2018-05-24 15:30:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8987ms 2018-05-24 15:30:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60715ms 2018-05-24 15:30:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121610ms 2018-05-24 15:30:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70244ms 2018-05-24 15:30:29,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90449ms 2018-05-24 15:30:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:29,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295974ms 2018-05-24 15:30:29,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79778ms 2018-05-24 15:30:29,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74873ms 2018-05-24 15:30:29,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268114ms 2018-05-24 15:30:29,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188204ms 2018-05-24 15:30:29,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243231ms 2018-05-24 15:30:29,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236702ms 2018-05-24 15:30:29,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249181ms 2018-05-24 15:30:29,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133908ms 2018-05-24 15:30:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:29,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192852ms 2018-05-24 15:30:29,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82582ms 2018-05-24 15:30:29,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206855ms 2018-05-24 15:30:29,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162555ms 2018-05-24 15:30:29,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277932ms 2018-05-24 15:30:29,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26367ms 2018-05-24 15:30:29,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 144147ms 2018-05-24 15:30:29,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51181ms 2018-05-24 15:30:29,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172054ms 2018-05-24 15:30:30,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 250113ms 2018-05-24 15:30:30,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271968ms 2018-05-24 15:30:30,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68045ms 2018-05-24 15:30:30,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89437ms 2018-05-24 15:30:30,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13334ms 2018-05-24 15:30:30,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275185ms 2018-05-24 15:30:30,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71118ms 2018-05-24 15:30:30,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135285ms 2018-05-24 15:30:30,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257046ms 2018-05-24 15:30:30,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118729ms 2018-05-24 15:30:30,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92365ms 2018-05-24 15:30:30,316 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215505ms 2018-05-24 15:30:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78077ms 2018-05-24 15:30:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80851ms 2018-05-24 15:30:30,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25068ms 2018-05-24 15:30:30,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21234ms 2018-05-24 15:30:30,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245211ms 2018-05-24 15:30:30,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229280ms 2018-05-24 15:30:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239930ms 2018-05-24 15:30:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57516ms 2018-05-24 15:30:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267865ms 2018-05-24 15:30:30,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257177ms 2018-05-24 15:30:30,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160504ms 2018-05-24 15:30:30,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219423ms 2018-05-24 15:30:30,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145091ms 2018-05-24 15:30:30,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140221ms 2018-05-24 15:30:30,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71875ms 2018-05-24 15:30:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89466ms 2018-05-24 15:30:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2486ms 2018-05-24 15:30:30,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111397ms 2018-05-24 15:30:31,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151293ms 2018-05-24 15:30:31,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37151ms 2018-05-24 15:30:31,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63431ms 2018-05-24 15:30:31,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235688ms 2018-05-24 15:30:31,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288913ms 2018-05-24 15:30:31,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296264ms 2018-05-24 15:30:31,118 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:31,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266317ms 2018-05-24 15:30:31,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117626ms 2018-05-24 15:30:31,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159230ms 2018-05-24 15:30:31,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 136778ms 2018-05-24 15:30:31,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259852ms 2018-05-24 15:30:31,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234447ms 2018-05-24 15:30:31,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118864ms 2018-05-24 15:30:31,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10696ms 2018-05-24 15:30:31,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171807ms 2018-05-24 15:30:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67390ms 2018-05-24 15:30:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207686ms 2018-05-24 15:30:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224218ms 2018-05-24 15:30:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51105ms 2018-05-24 15:30:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109792ms 2018-05-24 15:30:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64723ms 2018-05-24 15:30:31,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295126ms 2018-05-24 15:30:31,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149464ms 2018-05-24 15:30:31,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27416ms 2018-05-24 15:30:31,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117002ms 2018-05-24 15:30:31,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74222ms 2018-05-24 15:30:31,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216863ms 2018-05-24 15:30:31,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30892ms 2018-05-24 15:30:31,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112423ms 2018-05-24 15:30:31,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271035ms 2018-05-24 15:30:32,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166895ms 2018-05-24 15:30:32,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246610ms 2018-05-24 15:30:32,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278271ms 2018-05-24 15:30:32,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222223ms 2018-05-24 15:30:32,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260009ms 2018-05-24 15:30:32,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100166ms 2018-05-24 15:30:32,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166835ms 2018-05-24 15:30:32,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191829ms 2018-05-24 15:30:32,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61666ms 2018-05-24 15:30:32,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25655ms 2018-05-24 15:30:32,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286086ms 2018-05-24 15:30:32,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165061ms 2018-05-24 15:30:32,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192907ms 2018-05-24 15:30:32,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187554ms 2018-05-24 15:30:32,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193145ms 2018-05-24 15:30:32,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36755ms 2018-05-24 15:30:32,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236252ms 2018-05-24 15:30:32,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202677ms 2018-05-24 15:30:32,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18629ms 2018-05-24 15:30:32,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85570ms 2018-05-24 15:30:32,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169053ms 2018-05-24 15:30:32,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9174ms 2018-05-24 15:30:32,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188853ms 2018-05-24 15:30:32,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138966ms 2018-05-24 15:30:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52081ms 2018-05-24 15:30:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265276ms 2018-05-24 15:30:32,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210621ms 2018-05-24 15:30:32,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197159ms 2018-05-24 15:30:32,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273759ms 2018-05-24 15:30:32,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96891ms 2018-05-24 15:30:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13466ms 2018-05-24 15:30:33,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105426ms 2018-05-24 15:30:33,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214046ms 2018-05-24 15:30:33,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296253ms 2018-05-24 15:30:33,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200328ms 2018-05-24 15:30:33,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231433ms 2018-05-24 15:30:33,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211196ms 2018-05-24 15:30:33,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85708ms 2018-05-24 15:30:33,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155418ms 2018-05-24 15:30:33,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185162ms 2018-05-24 15:30:33,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12043ms 2018-05-24 15:30:33,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230252ms 2018-05-24 15:30:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282169ms 2018-05-24 15:30:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288077ms 2018-05-24 15:30:33,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146697ms 2018-05-24 15:30:33,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 139077ms 2018-05-24 15:30:33,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197372ms 2018-05-24 15:30:33,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235606ms 2018-05-24 15:30:33,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7370ms 2018-05-24 15:30:33,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241886ms 2018-05-24 15:30:33,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245793ms 2018-05-24 15:30:33,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295307ms 2018-05-24 15:30:33,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220484ms 2018-05-24 15:30:33,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196069ms 2018-05-24 15:30:33,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103589ms 2018-05-24 15:30:33,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93536ms 2018-05-24 15:30:33,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283287ms 2018-05-24 15:30:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68203ms 2018-05-24 15:30:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112453ms 2018-05-24 15:30:33,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240782ms 2018-05-24 15:30:34,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284695ms 2018-05-24 15:30:34,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114796ms 2018-05-24 15:30:34,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181778ms 2018-05-24 15:30:34,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147970ms 2018-05-24 15:30:34,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26359ms 2018-05-24 15:30:34,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158668ms 2018-05-24 15:30:34,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168651ms 2018-05-24 15:30:34,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166897ms 2018-05-24 15:30:34,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149204ms 2018-05-24 15:30:34,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133789ms 2018-05-24 15:30:34,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190297ms 2018-05-24 15:30:34,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262985ms 2018-05-24 15:30:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:34,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157083ms 2018-05-24 15:30:34,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83901ms 2018-05-24 15:30:34,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121228ms 2018-05-24 15:30:34,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284547ms 2018-05-24 15:30:34,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289176ms 2018-05-24 15:30:34,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57628ms 2018-05-24 15:30:34,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55085ms 2018-05-24 15:30:34,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238421ms 2018-05-24 15:30:34,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23676ms 2018-05-24 15:30:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:34,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201056ms 2018-05-24 15:30:34,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158340ms 2018-05-24 15:30:34,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62268ms 2018-05-24 15:30:34,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89866ms 2018-05-24 15:30:34,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125265ms 2018-05-24 15:30:34,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189753ms 2018-05-24 15:30:34,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288054ms 2018-05-24 15:30:34,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55262ms 2018-05-24 15:30:34,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56008ms 2018-05-24 15:30:35,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111927ms 2018-05-24 15:30:35,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70885ms 2018-05-24 15:30:35,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281946ms 2018-05-24 15:30:35,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298211ms 2018-05-24 15:30:35,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110817ms 2018-05-24 15:30:35,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3376ms 2018-05-24 15:30:35,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227983ms 2018-05-24 15:30:35,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19394ms 2018-05-24 15:30:35,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107164ms 2018-05-24 15:30:35,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177195ms 2018-05-24 15:30:35,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208292ms 2018-05-24 15:30:35,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17470ms 2018-05-24 15:30:35,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37606ms 2018-05-24 15:30:35,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289879ms 2018-05-24 15:30:35,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287718ms 2018-05-24 15:30:35,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109646ms 2018-05-24 15:30:35,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74866ms 2018-05-24 15:30:35,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289197ms 2018-05-24 15:30:35,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36780ms 2018-05-24 15:30:35,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269197ms 2018-05-24 15:30:35,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24608ms 2018-05-24 15:30:35,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12435ms 2018-05-24 15:30:35,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77862ms 2018-05-24 15:30:35,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244083ms 2018-05-24 15:30:35,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79672ms 2018-05-24 15:30:35,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222577ms 2018-05-24 15:30:35,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119074ms 2018-05-24 15:30:35,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13727ms 2018-05-24 15:30:35,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7427ms 2018-05-24 15:30:35,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124733ms 2018-05-24 15:30:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272026ms 2018-05-24 15:30:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77910ms 2018-05-24 15:30:36,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116103ms 2018-05-24 15:30:36,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277330ms 2018-05-24 15:30:36,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297565ms 2018-05-24 15:30:36,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37989ms 2018-05-24 15:30:36,118 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:36,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123069ms 2018-05-24 15:30:36,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6911ms 2018-05-24 15:30:36,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115320ms 2018-05-24 15:30:36,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113155ms 2018-05-24 15:30:36,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51440ms 2018-05-24 15:30:36,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266012ms 2018-05-24 15:30:36,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96769ms 2018-05-24 15:30:36,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132818ms 2018-05-24 15:30:36,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270963ms 2018-05-24 15:30:36,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277176ms 2018-05-24 15:30:36,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284288ms 2018-05-24 15:30:36,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268868ms 2018-05-24 15:30:36,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279104ms 2018-05-24 15:30:36,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253678ms 2018-05-24 15:30:36,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268123ms 2018-05-24 15:30:36,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206905ms 2018-05-24 15:30:36,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169481ms 2018-05-24 15:30:36,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161013ms 2018-05-24 15:30:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119868ms 2018-05-24 15:30:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20166ms 2018-05-24 15:30:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38909ms 2018-05-24 15:30:36,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189814ms 2018-05-24 15:30:36,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67009ms 2018-05-24 15:30:36,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252050ms 2018-05-24 15:30:37,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102265ms 2018-05-24 15:30:37,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255353ms 2018-05-24 15:30:37,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166783ms 2018-05-24 15:30:37,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21787ms 2018-05-24 15:30:37,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60775ms 2018-05-24 15:30:37,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102296ms 2018-05-24 15:30:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147926ms 2018-05-24 15:30:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95156ms 2018-05-24 15:30:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207480ms 2018-05-24 15:30:37,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98933ms 2018-05-24 15:30:37,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53320ms 2018-05-24 15:30:37,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76339ms 2018-05-24 15:30:37,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43994ms 2018-05-24 15:30:37,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208391ms 2018-05-24 15:30:37,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7039ms 2018-05-24 15:30:37,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65854ms 2018-05-24 15:30:37,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33487ms 2018-05-24 15:30:37,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 726ms 2018-05-24 15:30:37,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68766ms 2018-05-24 15:30:37,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149345ms 2018-05-24 15:30:37,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201896ms 2018-05-24 15:30:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79498ms 2018-05-24 15:30:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118423ms 2018-05-24 15:30:37,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153511ms 2018-05-24 15:30:37,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242076ms 2018-05-24 15:30:37,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 124447ms 2018-05-24 15:30:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105426ms 2018-05-24 15:30:37,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81243ms 2018-05-24 15:30:37,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205698ms 2018-05-24 15:30:37,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17912ms 2018-05-24 15:30:38,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196410ms 2018-05-24 15:30:38,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178703ms 2018-05-24 15:30:38,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287789ms 2018-05-24 15:30:38,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155661ms 2018-05-24 15:30:38,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107938ms 2018-05-24 15:30:38,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20282ms 2018-05-24 15:30:38,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177101ms 2018-05-24 15:30:38,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47931ms 2018-05-24 15:30:38,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204242ms 2018-05-24 15:30:38,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223161ms 2018-05-24 15:30:38,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95719ms 2018-05-24 15:30:38,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1876ms 2018-05-24 15:30:38,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244754ms 2018-05-24 15:30:38,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262613ms 2018-05-24 15:30:38,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182510ms 2018-05-24 15:30:38,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141585ms 2018-05-24 15:30:38,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287281ms 2018-05-24 15:30:38,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224005ms 2018-05-24 15:30:38,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270273ms 2018-05-24 15:30:38,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283970ms 2018-05-24 15:30:38,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87122ms 2018-05-24 15:30:38,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122986ms 2018-05-24 15:30:38,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20737ms 2018-05-24 15:30:38,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115717ms 2018-05-24 15:30:38,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145556ms 2018-05-24 15:30:38,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200216ms 2018-05-24 15:30:38,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42348ms 2018-05-24 15:30:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268597ms 2018-05-24 15:30:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14301ms 2018-05-24 15:30:38,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237301ms 2018-05-24 15:30:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206235ms 2018-05-24 15:30:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206842ms 2018-05-24 15:30:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58626ms 2018-05-24 15:30:39,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285914ms 2018-05-24 15:30:39,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61876ms 2018-05-24 15:30:39,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128734ms 2018-05-24 15:30:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257109ms 2018-05-24 15:30:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291830ms 2018-05-24 15:30:39,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24749ms 2018-05-24 15:30:39,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214016ms 2018-05-24 15:30:39,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148108ms 2018-05-24 15:30:39,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216626ms 2018-05-24 15:30:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:39,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229758ms 2018-05-24 15:30:39,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225185ms 2018-05-24 15:30:39,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99850ms 2018-05-24 15:30:39,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130799ms 2018-05-24 15:30:39,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222561ms 2018-05-24 15:30:39,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63516ms 2018-05-24 15:30:39,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251180ms 2018-05-24 15:30:39,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72012ms 2018-05-24 15:30:39,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186313ms 2018-05-24 15:30:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:39,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289459ms 2018-05-24 15:30:39,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289458ms 2018-05-24 15:30:39,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223843ms 2018-05-24 15:30:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52156ms 2018-05-24 15:30:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110404ms 2018-05-24 15:30:39,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131559ms 2018-05-24 15:30:39,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14579ms 2018-05-24 15:30:39,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273423ms 2018-05-24 15:30:39,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108858ms 2018-05-24 15:30:40,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48591ms 2018-05-24 15:30:40,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134712ms 2018-05-24 15:30:40,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88284ms 2018-05-24 15:30:40,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173952ms 2018-05-24 15:30:40,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221933ms 2018-05-24 15:30:40,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6582ms 2018-05-24 15:30:40,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299234ms 2018-05-24 15:30:40,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120624ms 2018-05-24 15:30:40,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59342ms 2018-05-24 15:30:40,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211253ms 2018-05-24 15:30:40,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11386ms 2018-05-24 15:30:40,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35146ms 2018-05-24 15:30:40,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290581ms 2018-05-24 15:30:40,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33681ms 2018-05-24 15:30:40,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50214ms 2018-05-24 15:30:40,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 40000ms 2018-05-24 15:30:40,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62564ms 2018-05-24 15:30:40,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95876ms 2018-05-24 15:30:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282311ms 2018-05-24 15:30:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269412ms 2018-05-24 15:30:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5838ms 2018-05-24 15:30:40,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268822ms 2018-05-24 15:30:40,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181634ms 2018-05-24 15:30:40,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150695ms 2018-05-24 15:30:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240273ms 2018-05-24 15:30:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261201ms 2018-05-24 15:30:40,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158608ms 2018-05-24 15:30:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12394ms 2018-05-24 15:30:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122842ms 2018-05-24 15:30:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151972ms 2018-05-24 15:30:41,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 139607ms 2018-05-24 15:30:41,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3732ms 2018-05-24 15:30:41,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164254ms 2018-05-24 15:30:41,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125640ms 2018-05-24 15:30:41,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185563ms 2018-05-24 15:30:41,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298639ms 2018-05-24 15:30:41,120 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:41,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50638ms 2018-05-24 15:30:41,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34728ms 2018-05-24 15:30:41,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143467ms 2018-05-24 15:30:41,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117799ms 2018-05-24 15:30:41,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121792ms 2018-05-24 15:30:41,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182554ms 2018-05-24 15:30:41,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247880ms 2018-05-24 15:30:41,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229693ms 2018-05-24 15:30:41,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94531ms 2018-05-24 15:30:41,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 256569ms 2018-05-24 15:30:41,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230837ms 2018-05-24 15:30:41,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96948ms 2018-05-24 15:30:41,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171796ms 2018-05-24 15:30:41,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34008ms 2018-05-24 15:30:41,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89138ms 2018-05-24 15:30:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98250ms 2018-05-24 15:30:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111756ms 2018-05-24 15:30:41,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174344ms 2018-05-24 15:30:41,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117536ms 2018-05-24 15:30:41,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143234ms 2018-05-24 15:30:41,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175555ms 2018-05-24 15:30:41,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205782ms 2018-05-24 15:30:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290894ms 2018-05-24 15:30:41,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126812ms 2018-05-24 15:30:42,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298879ms 2018-05-24 15:30:42,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86897ms 2018-05-24 15:30:42,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10426ms 2018-05-24 15:30:42,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16421ms 2018-05-24 15:30:42,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53757ms 2018-05-24 15:30:42,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196969ms 2018-05-24 15:30:42,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38345ms 2018-05-24 15:30:42,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103401ms 2018-05-24 15:30:42,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158555ms 2018-05-24 15:30:42,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4947ms 2018-05-24 15:30:42,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177027ms 2018-05-24 15:30:42,316 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273223ms 2018-05-24 15:30:42,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173663ms 2018-05-24 15:30:42,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6697ms 2018-05-24 15:30:42,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153356ms 2018-05-24 15:30:42,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 231934ms 2018-05-24 15:30:42,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132008ms 2018-05-24 15:30:42,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6542ms 2018-05-24 15:30:42,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294587ms 2018-05-24 15:30:42,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249731ms 2018-05-24 15:30:42,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193711ms 2018-05-24 15:30:42,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105423ms 2018-05-24 15:30:42,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291769ms 2018-05-24 15:30:42,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107413ms 2018-05-24 15:30:42,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 221913ms 2018-05-24 15:30:42,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289893ms 2018-05-24 15:30:42,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145751ms 2018-05-24 15:30:42,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292167ms 2018-05-24 15:30:42,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175548ms 2018-05-24 15:30:42,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207255ms 2018-05-24 15:30:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122444ms 2018-05-24 15:30:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135356ms 2018-05-24 15:30:43,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57323ms 2018-05-24 15:30:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54122ms 2018-05-24 15:30:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215218ms 2018-05-24 15:30:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79325ms 2018-05-24 15:30:43,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290880ms 2018-05-24 15:30:43,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216927ms 2018-05-24 15:30:43,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23452ms 2018-05-24 15:30:43,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173492ms 2018-05-24 15:30:43,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62309ms 2018-05-24 15:30:43,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62012ms 2018-05-24 15:30:43,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190750ms 2018-05-24 15:30:43,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277747ms 2018-05-24 15:30:43,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196383ms 2018-05-24 15:30:43,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2534ms 2018-05-24 15:30:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97849ms 2018-05-24 15:30:43,517 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235951ms 2018-05-24 15:30:43,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 171512ms 2018-05-24 15:30:43,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220106ms 2018-05-24 15:30:43,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33306ms 2018-05-24 15:30:43,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49264ms 2018-05-24 15:30:43,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 221704ms 2018-05-24 15:30:43,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143885ms 2018-05-24 15:30:43,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96077ms 2018-05-24 15:30:43,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150769ms 2018-05-24 15:30:43,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295774ms 2018-05-24 15:30:43,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270386ms 2018-05-24 15:30:43,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79227ms 2018-05-24 15:30:43,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257404ms 2018-05-24 15:30:44,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264208ms 2018-05-24 15:30:44,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88633ms 2018-05-24 15:30:44,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153725ms 2018-05-24 15:30:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155888ms 2018-05-24 15:30:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146109ms 2018-05-24 15:30:44,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2113ms 2018-05-24 15:30:44,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42844ms 2018-05-24 15:30:44,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89086ms 2018-05-24 15:30:44,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228539ms 2018-05-24 15:30:44,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292174ms 2018-05-24 15:30:44,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260583ms 2018-05-24 15:30:44,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212948ms 2018-05-24 15:30:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:44,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61859ms 2018-05-24 15:30:44,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218406ms 2018-05-24 15:30:44,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245744ms 2018-05-24 15:30:44,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63920ms 2018-05-24 15:30:44,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236917ms 2018-05-24 15:30:44,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157301ms 2018-05-24 15:30:44,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278467ms 2018-05-24 15:30:44,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271767ms 2018-05-24 15:30:44,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18792ms 2018-05-24 15:30:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:44,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24560ms 2018-05-24 15:30:44,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36420ms 2018-05-24 15:30:44,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134398ms 2018-05-24 15:30:44,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251250ms 2018-05-24 15:30:44,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296726ms 2018-05-24 15:30:44,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153828ms 2018-05-24 15:30:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166724ms 2018-05-24 15:30:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88625ms 2018-05-24 15:30:44,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1043ms 2018-05-24 15:30:45,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224288ms 2018-05-24 15:30:45,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107811ms 2018-05-24 15:30:45,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95412ms 2018-05-24 15:30:45,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35486ms 2018-05-24 15:30:45,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94038ms 2018-05-24 15:30:45,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32187ms 2018-05-24 15:30:45,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152233ms 2018-05-24 15:30:45,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168866ms 2018-05-24 15:30:45,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241764ms 2018-05-24 15:30:45,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238511ms 2018-05-24 15:30:45,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260643ms 2018-05-24 15:30:45,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22458ms 2018-05-24 15:30:45,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206015ms 2018-05-24 15:30:45,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2731ms 2018-05-24 15:30:45,416 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218951ms 2018-05-24 15:30:45,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218357ms 2018-05-24 15:30:45,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53101ms 2018-05-24 15:30:45,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153218ms 2018-05-24 15:30:45,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174963ms 2018-05-24 15:30:45,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293786ms 2018-05-24 15:30:45,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63967ms 2018-05-24 15:30:45,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13367ms 2018-05-24 15:30:45,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83820ms 2018-05-24 15:30:45,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150917ms 2018-05-24 15:30:45,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220111ms 2018-05-24 15:30:45,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224017ms 2018-05-24 15:30:45,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285923ms 2018-05-24 15:30:45,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35246ms 2018-05-24 15:30:45,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205906ms 2018-05-24 15:30:45,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245266ms 2018-05-24 15:30:46,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176740ms 2018-05-24 15:30:46,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131371ms 2018-05-24 15:30:46,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283289ms 2018-05-24 15:30:46,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93344ms 2018-05-24 15:30:46,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278426ms 2018-05-24 15:30:46,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113004ms 2018-05-24 15:30:46,121 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:46,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158730ms 2018-05-24 15:30:46,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13954ms 2018-05-24 15:30:46,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291330ms 2018-05-24 15:30:46,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81636ms 2018-05-24 15:30:46,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169878ms 2018-05-24 15:30:46,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161415ms 2018-05-24 15:30:46,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:30:46,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84138ms 2018-05-24 15:30:46,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20455ms 2018-05-24 15:30:46,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259127ms 2018-05-24 15:30:46,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233631ms 2018-05-24 15:30:46,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46438ms 2018-05-24 15:30:46,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244527ms 2018-05-24 15:30:46,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264200ms 2018-05-24 15:30:46,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35693ms 2018-05-24 15:30:46,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120463ms 2018-05-24 15:30:46,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3545ms 2018-05-24 15:30:46,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194849ms 2018-05-24 15:30:46,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29652ms 2018-05-24 15:30:46,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117656ms 2018-05-24 15:30:46,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 41100ms 2018-05-24 15:30:46,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43085ms 2018-05-24 15:30:46,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16815ms 2018-05-24 15:30:46,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269231ms 2018-05-24 15:30:46,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230137ms 2018-05-24 15:30:47,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178473ms 2018-05-24 15:30:47,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147645ms 2018-05-24 15:30:47,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 747ms 2018-05-24 15:30:47,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273662ms 2018-05-24 15:30:47,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191612ms 2018-05-24 15:30:47,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2265ms 2018-05-24 15:30:47,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108376ms 2018-05-24 15:30:47,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147045ms 2018-05-24 15:30:47,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214862ms 2018-05-24 15:30:47,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 99688ms 2018-05-24 15:30:47,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63645ms 2018-05-24 15:30:47,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291370ms 2018-05-24 15:30:47,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279334ms 2018-05-24 15:30:47,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232587ms 2018-05-24 15:30:47,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125094ms 2018-05-24 15:30:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243641ms 2018-05-24 15:30:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288996ms 2018-05-24 15:30:47,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19252ms 2018-05-24 15:30:47,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262835ms 2018-05-24 15:30:47,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25526ms 2018-05-24 15:30:47,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175063ms 2018-05-24 15:30:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43989ms 2018-05-24 15:30:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150524ms 2018-05-24 15:30:47,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294902ms 2018-05-24 15:30:47,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11611ms 2018-05-24 15:30:47,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40243ms 2018-05-24 15:30:47,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110079ms 2018-05-24 15:30:47,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44266ms 2018-05-24 15:30:47,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298515ms 2018-05-24 15:30:47,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185114ms 2018-05-24 15:30:48,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213032ms 2018-05-24 15:30:48,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129980ms 2018-05-24 15:30:48,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135520ms 2018-05-24 15:30:48,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133675ms 2018-05-24 15:30:48,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259611ms 2018-05-24 15:30:48,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189585ms 2018-05-24 15:30:48,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254075ms 2018-05-24 15:30:48,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118224ms 2018-05-24 15:30:48,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54209ms 2018-05-24 15:30:48,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212911ms 2018-05-24 15:30:48,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56757ms 2018-05-24 15:30:48,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86161ms 2018-05-24 15:30:48,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121549ms 2018-05-24 15:30:48,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163672ms 2018-05-24 15:30:48,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153608ms 2018-05-24 15:30:48,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280062ms 2018-05-24 15:30:48,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234154ms 2018-05-24 15:30:48,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89461ms 2018-05-24 15:30:48,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 41112ms 2018-05-24 15:30:48,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87532ms 2018-05-24 15:30:48,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157731ms 2018-05-24 15:30:48,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 6222ms 2018-05-24 15:30:48,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157885ms 2018-05-24 15:30:48,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110476ms 2018-05-24 15:30:48,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62190ms 2018-05-24 15:30:48,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123349ms 2018-05-24 15:30:48,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209604ms 2018-05-24 15:30:48,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10424ms 2018-05-24 15:30:48,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271574ms 2018-05-24 15:30:48,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225826ms 2018-05-24 15:30:49,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 124662ms 2018-05-24 15:30:49,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101975ms 2018-05-24 15:30:49,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137315ms 2018-05-24 15:30:49,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188409ms 2018-05-24 15:30:49,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280552ms 2018-05-24 15:30:49,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95ms 2018-05-24 15:30:49,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4616ms 2018-05-24 15:30:49,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126824ms 2018-05-24 15:30:49,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299340ms 2018-05-24 15:30:49,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46091ms 2018-05-24 15:30:49,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149769ms 2018-05-24 15:30:49,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71756ms 2018-05-24 15:30:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:49,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146355ms 2018-05-24 15:30:49,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115361ms 2018-05-24 15:30:49,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210567ms 2018-05-24 15:30:49,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164660ms 2018-05-24 15:30:49,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244335ms 2018-05-24 15:30:49,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234886ms 2018-05-24 15:30:49,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193194ms 2018-05-24 15:30:49,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122653ms 2018-05-24 15:30:49,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147818ms 2018-05-24 15:30:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:49,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168717ms 2018-05-24 15:30:49,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120554ms 2018-05-24 15:30:49,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200636ms 2018-05-24 15:30:49,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5820ms 2018-05-24 15:30:49,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139690ms 2018-05-24 15:30:49,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175321ms 2018-05-24 15:30:49,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273210ms 2018-05-24 15:30:49,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105677ms 2018-05-24 15:30:49,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100005ms 2018-05-24 15:30:50,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 28912ms 2018-05-24 15:30:50,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45465ms 2018-05-24 15:30:50,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47080ms 2018-05-24 15:30:50,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232714ms 2018-05-24 15:30:50,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73845ms 2018-05-24 15:30:50,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296245ms 2018-05-24 15:30:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253047ms 2018-05-24 15:30:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139134ms 2018-05-24 15:30:50,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2214ms 2018-05-24 15:30:50,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111110ms 2018-05-24 15:30:50,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170209ms 2018-05-24 15:30:50,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101164ms 2018-05-24 15:30:50,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275077ms 2018-05-24 15:30:50,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183906ms 2018-05-24 15:30:50,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85341ms 2018-05-24 15:30:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76671ms 2018-05-24 15:30:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9789ms 2018-05-24 15:30:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86719ms 2018-05-24 15:30:50,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274161ms 2018-05-24 15:30:50,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63365ms 2018-05-24 15:30:50,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127834ms 2018-05-24 15:30:50,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263990ms 2018-05-24 15:30:50,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115084ms 2018-05-24 15:30:50,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109018ms 2018-05-24 15:30:50,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282075ms 2018-05-24 15:30:50,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158563ms 2018-05-24 15:30:50,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17724ms 2018-05-24 15:30:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 130976ms 2018-05-24 15:30:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273330ms 2018-05-24 15:30:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134281ms 2018-05-24 15:30:51,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194956ms 2018-05-24 15:30:51,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73344ms 2018-05-24 15:30:51,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19554ms 2018-05-24 15:30:51,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 33394ms 2018-05-24 15:30:51,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10647ms 2018-05-24 15:30:51,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52094ms 2018-05-24 15:30:51,123 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126449ms 2018-05-24 15:30:51,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 144052ms 2018-05-24 15:30:51,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37569ms 2018-05-24 15:30:51,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291786ms 2018-05-24 15:30:51,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93096ms 2018-05-24 15:30:51,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35472ms 2018-05-24 15:30:51,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77199ms 2018-05-24 15:30:51,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189143ms 2018-05-24 15:30:51,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142599ms 2018-05-24 15:30:51,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135220ms 2018-05-24 15:30:51,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 217478ms 2018-05-24 15:30:51,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172519ms 2018-05-24 15:30:51,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12489ms 2018-05-24 15:30:51,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57887ms 2018-05-24 15:30:51,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180129ms 2018-05-24 15:30:51,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189056ms 2018-05-24 15:30:51,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94671ms 2018-05-24 15:30:51,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78468ms 2018-05-24 15:30:51,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267730ms 2018-05-24 15:30:51,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217207ms 2018-05-24 15:30:51,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153867ms 2018-05-24 15:30:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298440ms 2018-05-24 15:30:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165118ms 2018-05-24 15:30:51,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61923ms 2018-05-24 15:30:52,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292139ms 2018-05-24 15:30:52,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147974ms 2018-05-24 15:30:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272244ms 2018-05-24 15:30:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257612ms 2018-05-24 15:30:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183296ms 2018-05-24 15:30:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51954ms 2018-05-24 15:30:52,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 126444ms 2018-05-24 15:30:52,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273473ms 2018-05-24 15:30:52,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15307ms 2018-05-24 15:30:52,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138715ms 2018-05-24 15:30:52,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182105ms 2018-05-24 15:30:52,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223177ms 2018-05-24 15:30:52,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140259ms 2018-05-24 15:30:52,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141353ms 2018-05-24 15:30:52,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159082ms 2018-05-24 15:30:52,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78418ms 2018-05-24 15:30:52,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190085ms 2018-05-24 15:30:52,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22117ms 2018-05-24 15:30:52,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279074ms 2018-05-24 15:30:52,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193862ms 2018-05-24 15:30:52,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184248ms 2018-05-24 15:30:52,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93016ms 2018-05-24 15:30:52,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39442ms 2018-05-24 15:30:52,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129947ms 2018-05-24 15:30:52,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 41659ms 2018-05-24 15:30:52,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157612ms 2018-05-24 15:30:52,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36400ms 2018-05-24 15:30:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 69609ms 2018-05-24 15:30:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193070ms 2018-05-24 15:30:52,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252046ms 2018-05-24 15:30:53,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150071ms 2018-05-24 15:30:53,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294966ms 2018-05-24 15:30:53,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228762ms 2018-05-24 15:30:53,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266677ms 2018-05-24 15:30:53,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143546ms 2018-05-24 15:30:53,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280461ms 2018-05-24 15:30:53,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154622ms 2018-05-24 15:30:53,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239101ms 2018-05-24 15:30:53,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13734ms 2018-05-24 15:30:53,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 136718ms 2018-05-24 15:30:53,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30711ms 2018-05-24 15:30:53,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285036ms 2018-05-24 15:30:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118387ms 2018-05-24 15:30:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289642ms 2018-05-24 15:30:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241695ms 2018-05-24 15:30:53,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211414ms 2018-05-24 15:30:53,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137510ms 2018-05-24 15:30:53,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246751ms 2018-05-24 15:30:53,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43793ms 2018-05-24 15:30:53,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51547ms 2018-05-24 15:30:53,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112358ms 2018-05-24 15:30:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202651ms 2018-05-24 15:30:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1409ms 2018-05-24 15:30:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279501ms 2018-05-24 15:30:53,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233881ms 2018-05-24 15:30:53,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192666ms 2018-05-24 15:30:53,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296052ms 2018-05-24 15:30:53,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 250288ms 2018-05-24 15:30:53,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1083ms 2018-05-24 15:30:53,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78835ms 2018-05-24 15:30:54,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268887ms 2018-05-24 15:30:54,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193690ms 2018-05-24 15:30:54,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210907ms 2018-05-24 15:30:54,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273502ms 2018-05-24 15:30:54,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52818ms 2018-05-24 15:30:54,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197083ms 2018-05-24 15:30:54,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249393ms 2018-05-24 15:30:54,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276072ms 2018-05-24 15:30:54,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232175ms 2018-05-24 15:30:54,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98687ms 2018-05-24 15:30:54,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 169942ms 2018-05-24 15:30:54,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144160ms 2018-05-24 15:30:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:54,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230569ms 2018-05-24 15:30:54,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88652ms 2018-05-24 15:30:54,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271300ms 2018-05-24 15:30:54,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221966ms 2018-05-24 15:30:54,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83283ms 2018-05-24 15:30:54,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270554ms 2018-05-24 15:30:54,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145911ms 2018-05-24 15:30:54,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24067ms 2018-05-24 15:30:54,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22881ms 2018-05-24 15:30:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:54,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183257ms 2018-05-24 15:30:54,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147110ms 2018-05-24 15:30:54,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27916ms 2018-05-24 15:30:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48791ms 2018-05-24 15:30:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119267ms 2018-05-24 15:30:54,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149418ms 2018-05-24 15:30:54,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265536ms 2018-05-24 15:30:54,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54413ms 2018-05-24 15:30:54,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224117ms 2018-05-24 15:30:55,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261927ms 2018-05-24 15:30:55,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41049ms 2018-05-24 15:30:55,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236155ms 2018-05-24 15:30:55,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164880ms 2018-05-24 15:30:55,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133085ms 2018-05-24 15:30:55,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43263ms 2018-05-24 15:30:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164711ms 2018-05-24 15:30:55,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24026ms 2018-05-24 15:30:55,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280174ms 2018-05-24 15:30:55,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213984ms 2018-05-24 15:30:55,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169064ms 2018-05-24 15:30:55,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16513ms 2018-05-24 15:30:55,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111981ms 2018-05-24 15:30:55,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288028ms 2018-05-24 15:30:55,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118453ms 2018-05-24 15:30:55,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240320ms 2018-05-24 15:30:55,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268383ms 2018-05-24 15:30:55,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75388ms 2018-05-24 15:30:55,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72463ms 2018-05-24 15:30:55,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102394ms 2018-05-24 15:30:55,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152465ms 2018-05-24 15:30:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 287618ms 2018-05-24 15:30:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95944ms 2018-05-24 15:30:55,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185122ms 2018-05-24 15:30:55,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157781ms 2018-05-24 15:30:55,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52348ms 2018-05-24 15:30:55,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141263ms 2018-05-24 15:30:55,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172605ms 2018-05-24 15:30:55,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79898ms 2018-05-24 15:30:55,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183122ms 2018-05-24 15:30:56,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 271258ms 2018-05-24 15:30:56,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273504ms 2018-05-24 15:30:56,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215654ms 2018-05-24 15:30:56,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112383ms 2018-05-24 15:30:56,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243342ms 2018-05-24 15:30:56,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32531ms 2018-05-24 15:30:56,124 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:30:56,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247091ms 2018-05-24 15:30:56,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44157ms 2018-05-24 15:30:56,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76877ms 2018-05-24 15:30:56,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36535ms 2018-05-24 15:30:56,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88804ms 2018-05-24 15:30:56,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285625ms 2018-05-24 15:30:56,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138396ms 2018-05-24 15:30:56,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92899ms 2018-05-24 15:30:56,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162883ms 2018-05-24 15:30:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106181ms 2018-05-24 15:30:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152330ms 2018-05-24 15:30:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283632ms 2018-05-24 15:30:56,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107608ms 2018-05-24 15:30:56,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120716ms 2018-05-24 15:30:56,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114197ms 2018-05-24 15:30:56,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2905ms 2018-05-24 15:30:56,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257351ms 2018-05-24 15:30:56,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207968ms 2018-05-24 15:30:56,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15195ms 2018-05-24 15:30:56,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258055ms 2018-05-24 15:30:56,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30780ms 2018-05-24 15:30:56,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294383ms 2018-05-24 15:30:56,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246589ms 2018-05-24 15:30:56,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192864ms 2018-05-24 15:30:57,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131323ms 2018-05-24 15:30:57,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293396ms 2018-05-24 15:30:57,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162351ms 2018-05-24 15:30:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240019ms 2018-05-24 15:30:57,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 241038ms 2018-05-24 15:30:57,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61994ms 2018-05-24 15:30:57,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49507ms 2018-05-24 15:30:57,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191720ms 2018-05-24 15:30:57,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284080ms 2018-05-24 15:30:57,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272892ms 2018-05-24 15:30:57,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76280ms 2018-05-24 15:30:57,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97910ms 2018-05-24 15:30:57,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40679ms 2018-05-24 15:30:57,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62679ms 2018-05-24 15:30:57,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70592ms 2018-05-24 15:30:57,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82240ms 2018-05-24 15:30:57,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25172ms 2018-05-24 15:30:57,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200001ms 2018-05-24 15:30:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266925ms 2018-05-24 15:30:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243492ms 2018-05-24 15:30:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80079ms 2018-05-24 15:30:57,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 153154ms 2018-05-24 15:30:57,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251351ms 2018-05-24 15:30:57,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216796ms 2018-05-24 15:30:57,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100431ms 2018-05-24 15:30:57,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194528ms 2018-05-24 15:30:57,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99020ms 2018-05-24 15:30:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214090ms 2018-05-24 15:30:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31146ms 2018-05-24 15:30:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136304ms 2018-05-24 15:30:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 196244ms 2018-05-24 15:30:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177455ms 2018-05-24 15:30:58,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299394ms 2018-05-24 15:30:58,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59914ms 2018-05-24 15:30:58,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143104ms 2018-05-24 15:30:58,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48596ms 2018-05-24 15:30:58,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177395ms 2018-05-24 15:30:58,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 241693ms 2018-05-24 15:30:58,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224751ms 2018-05-24 15:30:58,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54802ms 2018-05-24 15:30:58,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149351ms 2018-05-24 15:30:58,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219839ms 2018-05-24 15:30:58,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175388ms 2018-05-24 15:30:58,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38140ms 2018-05-24 15:30:58,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81100ms 2018-05-24 15:30:58,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74783ms 2018-05-24 15:30:58,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280392ms 2018-05-24 15:30:58,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165435ms 2018-05-24 15:30:58,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116277ms 2018-05-24 15:30:58,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178322ms 2018-05-24 15:30:58,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125023ms 2018-05-24 15:30:58,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177524ms 2018-05-24 15:30:58,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194998ms 2018-05-24 15:30:58,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115395ms 2018-05-24 15:30:58,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27050ms 2018-05-24 15:30:58,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77787ms 2018-05-24 15:30:58,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263878ms 2018-05-24 15:30:58,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224616ms 2018-05-24 15:30:58,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94064ms 2018-05-24 15:30:58,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34832ms 2018-05-24 15:30:59,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144837ms 2018-05-24 15:30:59,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100944ms 2018-05-24 15:30:59,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158729ms 2018-05-24 15:30:59,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162543ms 2018-05-24 15:30:59,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45762ms 2018-05-24 15:30:59,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166616ms 2018-05-24 15:30:59,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147041ms 2018-05-24 15:30:59,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121477ms 2018-05-24 15:30:59,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292008ms 2018-05-24 15:30:59,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10204ms 2018-05-24 15:30:59,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225030ms 2018-05-24 15:30:59,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83189ms 2018-05-24 15:30:59,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:30:59,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:30:59,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269934ms 2018-05-24 15:30:59,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89259ms 2018-05-24 15:30:59,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175214ms 2018-05-24 15:30:59,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253867ms 2018-05-24 15:30:59,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39974ms 2018-05-24 15:30:59,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182964ms 2018-05-24 15:30:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185767ms 2018-05-24 15:30:59,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297145ms 2018-05-24 15:30:59,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296987ms 2018-05-24 15:30:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:30:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:30:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:30:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:30:59,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254781ms 2018-05-24 15:30:59,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236988ms 2018-05-24 15:30:59,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168603ms 2018-05-24 15:30:59,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188131ms 2018-05-24 15:30:59,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81618ms 2018-05-24 15:30:59,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48129ms 2018-05-24 15:30:59,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46300ms 2018-05-24 15:30:59,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50465ms 2018-05-24 15:30:59,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10426ms 2018-05-24 15:31:00,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220284ms 2018-05-24 15:31:00,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99226ms 2018-05-24 15:31:00,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119474ms 2018-05-24 15:31:00,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46629ms 2018-05-24 15:31:00,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192048ms 2018-05-24 15:31:00,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115812ms 2018-05-24 15:31:00,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163889ms 2018-05-24 15:31:00,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145057ms 2018-05-24 15:31:00,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228423ms 2018-05-24 15:31:00,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242572ms 2018-05-24 15:31:00,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156929ms 2018-05-24 15:31:00,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28716ms 2018-05-24 15:31:00,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268699ms 2018-05-24 15:31:00,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21847ms 2018-05-24 15:31:00,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63767ms 2018-05-24 15:31:00,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162948ms 2018-05-24 15:31:00,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86017ms 2018-05-24 15:31:00,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99880ms 2018-05-24 15:31:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1162ms 2018-05-24 15:31:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150394ms 2018-05-24 15:31:00,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214642ms 2018-05-24 15:31:00,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36317ms 2018-05-24 15:31:00,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182616ms 2018-05-24 15:31:00,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73093ms 2018-05-24 15:31:00,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190968ms 2018-05-24 15:31:00,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74570ms 2018-05-24 15:31:00,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224094ms 2018-05-24 15:31:00,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161683ms 2018-05-24 15:31:00,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78465ms 2018-05-24 15:31:00,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84753ms 2018-05-24 15:31:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245715ms 2018-05-24 15:31:01,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209274ms 2018-05-24 15:31:01,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108099ms 2018-05-24 15:31:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296820ms 2018-05-24 15:31:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294946ms 2018-05-24 15:31:01,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185677ms 2018-05-24 15:31:01,125 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154908ms 2018-05-24 15:31:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171025ms 2018-05-24 15:31:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145506ms 2018-05-24 15:31:01,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64010ms 2018-05-24 15:31:01,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81413ms 2018-05-24 15:31:01,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214027ms 2018-05-24 15:31:01,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34835ms 2018-05-24 15:31:01,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9168ms 2018-05-24 15:31:01,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220131ms 2018-05-24 15:31:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27385ms 2018-05-24 15:31:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246519ms 2018-05-24 15:31:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30894ms 2018-05-24 15:31:01,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278313ms 2018-05-24 15:31:01,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53560ms 2018-05-24 15:31:01,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261931ms 2018-05-24 15:31:01,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294422ms 2018-05-24 15:31:01,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17981ms 2018-05-24 15:31:01,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103884ms 2018-05-24 15:31:01,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240161ms 2018-05-24 15:31:01,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118448ms 2018-05-24 15:31:01,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265925ms 2018-05-24 15:31:01,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2564ms 2018-05-24 15:31:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145660ms 2018-05-24 15:31:01,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116395ms 2018-05-24 15:31:02,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166254ms 2018-05-24 15:31:02,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148762ms 2018-05-24 15:31:02,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117734ms 2018-05-24 15:31:02,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175534ms 2018-05-24 15:31:02,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224185ms 2018-05-24 15:31:02,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125082ms 2018-05-24 15:31:02,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3281ms 2018-05-24 15:31:02,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243149ms 2018-05-24 15:31:02,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211555ms 2018-05-24 15:31:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164442ms 2018-05-24 15:31:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236680ms 2018-05-24 15:31:02,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98103ms 2018-05-24 15:31:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188687ms 2018-05-24 15:31:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148744ms 2018-05-24 15:31:02,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70481ms 2018-05-24 15:31:02,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250188ms 2018-05-24 15:31:02,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293297ms 2018-05-24 15:31:02,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147938ms 2018-05-24 15:31:02,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176355ms 2018-05-24 15:31:02,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179820ms 2018-05-24 15:31:02,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38714ms 2018-05-24 15:31:02,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 170845ms 2018-05-24 15:31:02,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289758ms 2018-05-24 15:31:02,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86859ms 2018-05-24 15:31:02,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 127291ms 2018-05-24 15:31:02,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147817ms 2018-05-24 15:31:02,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196906ms 2018-05-24 15:31:02,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71296ms 2018-05-24 15:31:02,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291704ms 2018-05-24 15:31:02,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159276ms 2018-05-24 15:31:03,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45455ms 2018-05-24 15:31:03,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78493ms 2018-05-24 15:31:03,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165963ms 2018-05-24 15:31:03,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20331ms 2018-05-24 15:31:03,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84558ms 2018-05-24 15:31:03,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90424ms 2018-05-24 15:31:03,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234642ms 2018-05-24 15:31:03,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257480ms 2018-05-24 15:31:03,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299004ms 2018-05-24 15:31:03,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240296ms 2018-05-24 15:31:03,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117334ms 2018-05-24 15:31:03,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127492ms 2018-05-24 15:31:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 174361ms 2018-05-24 15:31:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105996ms 2018-05-24 15:31:03,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274009ms 2018-05-24 15:31:03,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36869ms 2018-05-24 15:31:03,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44048ms 2018-05-24 15:31:03,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293061ms 2018-05-24 15:31:03,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193243ms 2018-05-24 15:31:03,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31219ms 2018-05-24 15:31:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221869ms 2018-05-24 15:31:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266979ms 2018-05-24 15:31:03,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139720ms 2018-05-24 15:31:03,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166109ms 2018-05-24 15:31:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18293ms 2018-05-24 15:31:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31773ms 2018-05-24 15:31:03,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276353ms 2018-05-24 15:31:03,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251705ms 2018-05-24 15:31:03,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 423ms 2018-05-24 15:31:03,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151034ms 2018-05-24 15:31:04,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218566ms 2018-05-24 15:31:04,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191272ms 2018-05-24 15:31:04,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241646ms 2018-05-24 15:31:04,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296734ms 2018-05-24 15:31:04,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50125ms 2018-05-24 15:31:04,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147287ms 2018-05-24 15:31:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206207ms 2018-05-24 15:31:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80670ms 2018-05-24 15:31:04,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191394ms 2018-05-24 15:31:04,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208322ms 2018-05-24 15:31:04,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34614ms 2018-05-24 15:31:04,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296994ms 2018-05-24 15:31:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:04,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194124ms 2018-05-24 15:31:04,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297651ms 2018-05-24 15:31:04,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16295ms 2018-05-24 15:31:04,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185708ms 2018-05-24 15:31:04,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166007ms 2018-05-24 15:31:04,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231880ms 2018-05-24 15:31:04,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 28195ms 2018-05-24 15:31:04,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263453ms 2018-05-24 15:31:04,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77523ms 2018-05-24 15:31:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200723ms 2018-05-24 15:31:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200682ms 2018-05-24 15:31:04,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219127ms 2018-05-24 15:31:04,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165287ms 2018-05-24 15:31:04,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298010ms 2018-05-24 15:31:04,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7975ms 2018-05-24 15:31:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46256ms 2018-05-24 15:31:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7619ms 2018-05-24 15:31:04,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297855ms 2018-05-24 15:31:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42860ms 2018-05-24 15:31:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149250ms 2018-05-24 15:31:05,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170722ms 2018-05-24 15:31:05,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166746ms 2018-05-24 15:31:05,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228234ms 2018-05-24 15:31:05,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206047ms 2018-05-24 15:31:05,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213688ms 2018-05-24 15:31:05,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13635ms 2018-05-24 15:31:05,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273581ms 2018-05-24 15:31:05,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149601ms 2018-05-24 15:31:05,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57854ms 2018-05-24 15:31:05,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26796ms 2018-05-24 15:31:05,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31891ms 2018-05-24 15:31:05,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157120ms 2018-05-24 15:31:05,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186487ms 2018-05-24 15:31:05,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103818ms 2018-05-24 15:31:05,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267783ms 2018-05-24 15:31:05,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59612ms 2018-05-24 15:31:05,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198621ms 2018-05-24 15:31:05,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128884ms 2018-05-24 15:31:05,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107006ms 2018-05-24 15:31:05,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71546ms 2018-05-24 15:31:05,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192013ms 2018-05-24 15:31:05,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141859ms 2018-05-24 15:31:05,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106605ms 2018-05-24 15:31:05,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 47564ms 2018-05-24 15:31:05,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283052ms 2018-05-24 15:31:05,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213093ms 2018-05-24 15:31:05,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299386ms 2018-05-24 15:31:05,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198569ms 2018-05-24 15:31:06,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157300ms 2018-05-24 15:31:06,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94048ms 2018-05-24 15:31:06,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169325ms 2018-05-24 15:31:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36508ms 2018-05-24 15:31:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54624ms 2018-05-24 15:31:06,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53128ms 2018-05-24 15:31:06,126 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:06,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172634ms 2018-05-24 15:31:06,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273304ms 2018-05-24 15:31:06,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227664ms 2018-05-24 15:31:06,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53042ms 2018-05-24 15:31:06,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5900ms 2018-05-24 15:31:06,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229832ms 2018-05-24 15:31:06,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:31:06,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55928ms 2018-05-24 15:31:06,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67466ms 2018-05-24 15:31:06,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50824ms 2018-05-24 15:31:06,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278692ms 2018-05-24 15:31:06,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142283ms 2018-05-24 15:31:06,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68013ms 2018-05-24 15:31:06,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181678ms 2018-05-24 15:31:06,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1984ms 2018-05-24 15:31:06,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24640ms 2018-05-24 15:31:06,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176972ms 2018-05-24 15:31:06,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216886ms 2018-05-24 15:31:06,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141311ms 2018-05-24 15:31:06,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290206ms 2018-05-24 15:31:06,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125418ms 2018-05-24 15:31:06,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123820ms 2018-05-24 15:31:06,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 241190ms 2018-05-24 15:31:06,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290570ms 2018-05-24 15:31:06,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209343ms 2018-05-24 15:31:07,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27973ms 2018-05-24 15:31:07,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167499ms 2018-05-24 15:31:07,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206889ms 2018-05-24 15:31:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103871ms 2018-05-24 15:31:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163133ms 2018-05-24 15:31:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127883ms 2018-05-24 15:31:07,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18548ms 2018-05-24 15:31:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166933ms 2018-05-24 15:31:07,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26223ms 2018-05-24 15:31:07,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183930ms 2018-05-24 15:31:07,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23992ms 2018-05-24 15:31:07,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158600ms 2018-05-24 15:31:07,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38768ms 2018-05-24 15:31:07,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232022ms 2018-05-24 15:31:07,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35942ms 2018-05-24 15:31:07,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70368ms 2018-05-24 15:31:07,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159496ms 2018-05-24 15:31:07,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177781ms 2018-05-24 15:31:07,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74014ms 2018-05-24 15:31:07,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183458ms 2018-05-24 15:31:07,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42638ms 2018-05-24 15:31:07,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212572ms 2018-05-24 15:31:07,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280370ms 2018-05-24 15:31:07,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18390ms 2018-05-24 15:31:07,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249343ms 2018-05-24 15:31:07,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269265ms 2018-05-24 15:31:07,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28762ms 2018-05-24 15:31:07,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71786ms 2018-05-24 15:31:07,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200698ms 2018-05-24 15:31:07,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241032ms 2018-05-24 15:31:08,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255381ms 2018-05-24 15:31:08,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218575ms 2018-05-24 15:31:08,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259739ms 2018-05-24 15:31:08,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 110042ms 2018-05-24 15:31:08,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266198ms 2018-05-24 15:31:08,117 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255169ms 2018-05-24 15:31:08,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4466ms 2018-05-24 15:31:08,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150964ms 2018-05-24 15:31:08,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236114ms 2018-05-24 15:31:08,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203109ms 2018-05-24 15:31:08,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45695ms 2018-05-24 15:31:08,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236844ms 2018-05-24 15:31:08,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293860ms 2018-05-24 15:31:08,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140746ms 2018-05-24 15:31:08,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242797ms 2018-05-24 15:31:08,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284398ms 2018-05-24 15:31:08,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233307ms 2018-05-24 15:31:08,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139698ms 2018-05-24 15:31:08,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281352ms 2018-05-24 15:31:08,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122708ms 2018-05-24 15:31:08,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228258ms 2018-05-24 15:31:08,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274378ms 2018-05-24 15:31:08,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90044ms 2018-05-24 15:31:08,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65428ms 2018-05-24 15:31:08,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214345ms 2018-05-24 15:31:08,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227157ms 2018-05-24 15:31:08,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122891ms 2018-05-24 15:31:08,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228723ms 2018-05-24 15:31:08,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 228309ms 2018-05-24 15:31:08,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38023ms 2018-05-24 15:31:09,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70379ms 2018-05-24 15:31:09,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241847ms 2018-05-24 15:31:09,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81921ms 2018-05-24 15:31:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100525ms 2018-05-24 15:31:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227354ms 2018-05-24 15:31:09,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279227ms 2018-05-24 15:31:09,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186350ms 2018-05-24 15:31:09,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188554ms 2018-05-24 15:31:09,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36702ms 2018-05-24 15:31:09,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76379ms 2018-05-24 15:31:09,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271919ms 2018-05-24 15:31:09,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171227ms 2018-05-24 15:31:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:09,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161981ms 2018-05-24 15:31:09,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203722ms 2018-05-24 15:31:09,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216399ms 2018-05-24 15:31:09,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207868ms 2018-05-24 15:31:09,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 96374ms 2018-05-24 15:31:09,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230005ms 2018-05-24 15:31:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35531ms 2018-05-24 15:31:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12603ms 2018-05-24 15:31:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279268ms 2018-05-24 15:31:09,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:09,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:09,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214727ms 2018-05-24 15:31:09,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150315ms 2018-05-24 15:31:09,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48555ms 2018-05-24 15:31:09,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 90572ms 2018-05-24 15:31:09,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87403ms 2018-05-24 15:31:09,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218104ms 2018-05-24 15:31:09,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27341ms 2018-05-24 15:31:09,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186032ms 2018-05-24 15:31:09,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150697ms 2018-05-24 15:31:10,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261442ms 2018-05-24 15:31:10,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27462ms 2018-05-24 15:31:10,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253010ms 2018-05-24 15:31:10,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293431ms 2018-05-24 15:31:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254018ms 2018-05-24 15:31:10,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202940ms 2018-05-24 15:31:10,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254550ms 2018-05-24 15:31:10,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123216ms 2018-05-24 15:31:10,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240774ms 2018-05-24 15:31:10,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116732ms 2018-05-24 15:31:10,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236983ms 2018-05-24 15:31:10,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283492ms 2018-05-24 15:31:10,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289341ms 2018-05-24 15:31:10,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9277ms 2018-05-24 15:31:10,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209022ms 2018-05-24 15:31:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120137ms 2018-05-24 15:31:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93628ms 2018-05-24 15:31:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95073ms 2018-05-24 15:31:10,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3457ms 2018-05-24 15:31:10,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132202ms 2018-05-24 15:31:10,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67535ms 2018-05-24 15:31:10,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193850ms 2018-05-24 15:31:10,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245941ms 2018-05-24 15:31:10,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 753ms 2018-05-24 15:31:10,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275183ms 2018-05-24 15:31:10,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217129ms 2018-05-24 15:31:10,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49425ms 2018-05-24 15:31:10,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197446ms 2018-05-24 15:31:10,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119123ms 2018-05-24 15:31:10,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174305ms 2018-05-24 15:31:11,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40290ms 2018-05-24 15:31:11,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270423ms 2018-05-24 15:31:11,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73270ms 2018-05-24 15:31:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89451ms 2018-05-24 15:31:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253796ms 2018-05-24 15:31:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29004ms 2018-05-24 15:31:11,128 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102348ms 2018-05-24 15:31:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78114ms 2018-05-24 15:31:11,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139972ms 2018-05-24 15:31:11,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63488ms 2018-05-24 15:31:11,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234258ms 2018-05-24 15:31:11,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271070ms 2018-05-24 15:31:11,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181871ms 2018-05-24 15:31:11,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119443ms 2018-05-24 15:31:11,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271282ms 2018-05-24 15:31:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273486ms 2018-05-24 15:31:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200117ms 2018-05-24 15:31:11,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143197ms 2018-05-24 15:31:11,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215502ms 2018-05-24 15:31:11,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182942ms 2018-05-24 15:31:11,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136576ms 2018-05-24 15:31:11,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235423ms 2018-05-24 15:31:11,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275309ms 2018-05-24 15:31:11,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298232ms 2018-05-24 15:31:11,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117227ms 2018-05-24 15:31:11,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 41750ms 2018-05-24 15:31:11,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282911ms 2018-05-24 15:31:11,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154311ms 2018-05-24 15:31:11,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6377ms 2018-05-24 15:31:11,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7713ms 2018-05-24 15:31:12,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94063ms 2018-05-24 15:31:12,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266551ms 2018-05-24 15:31:12,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290548ms 2018-05-24 15:31:12,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248642ms 2018-05-24 15:31:12,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227268ms 2018-05-24 15:31:12,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292569ms 2018-05-24 15:31:12,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289878ms 2018-05-24 15:31:12,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75065ms 2018-05-24 15:31:12,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120435ms 2018-05-24 15:31:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6210ms 2018-05-24 15:31:12,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119319ms 2018-05-24 15:31:12,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221580ms 2018-05-24 15:31:12,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263653ms 2018-05-24 15:31:12,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295442ms 2018-05-24 15:31:12,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15355ms 2018-05-24 15:31:12,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229835ms 2018-05-24 15:31:12,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203201ms 2018-05-24 15:31:12,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103858ms 2018-05-24 15:31:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116951ms 2018-05-24 15:31:12,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220975ms 2018-05-24 15:31:12,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96566ms 2018-05-24 15:31:12,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162550ms 2018-05-24 15:31:12,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57576ms 2018-05-24 15:31:12,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168459ms 2018-05-24 15:31:12,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24422ms 2018-05-24 15:31:12,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257571ms 2018-05-24 15:31:12,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293073ms 2018-05-24 15:31:12,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29530ms 2018-05-24 15:31:12,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274642ms 2018-05-24 15:31:12,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258954ms 2018-05-24 15:31:13,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274703ms 2018-05-24 15:31:13,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260510ms 2018-05-24 15:31:13,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10168ms 2018-05-24 15:31:13,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55122ms 2018-05-24 15:31:13,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251930ms 2018-05-24 15:31:13,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125805ms 2018-05-24 15:31:13,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269217ms 2018-05-24 15:31:13,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235156ms 2018-05-24 15:31:13,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16794ms 2018-05-24 15:31:13,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139268ms 2018-05-24 15:31:13,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181708ms 2018-05-24 15:31:13,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255392ms 2018-05-24 15:31:13,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57539ms 2018-05-24 15:31:13,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143162ms 2018-05-24 15:31:13,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206644ms 2018-05-24 15:31:13,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276381ms 2018-05-24 15:31:13,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193711ms 2018-05-24 15:31:13,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248177ms 2018-05-24 15:31:13,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167198ms 2018-05-24 15:31:13,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214797ms 2018-05-24 15:31:13,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124183ms 2018-05-24 15:31:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230340ms 2018-05-24 15:31:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179174ms 2018-05-24 15:31:13,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226958ms 2018-05-24 15:31:13,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43437ms 2018-05-24 15:31:13,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283189ms 2018-05-24 15:31:13,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34923ms 2018-05-24 15:31:13,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220989ms 2018-05-24 15:31:13,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277625ms 2018-05-24 15:31:13,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290018ms 2018-05-24 15:31:14,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233146ms 2018-05-24 15:31:14,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206966ms 2018-05-24 15:31:14,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264462ms 2018-05-24 15:31:14,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280182ms 2018-05-24 15:31:14,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249014ms 2018-05-24 15:31:14,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105398ms 2018-05-24 15:31:14,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83977ms 2018-05-24 15:31:14,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132796ms 2018-05-24 15:31:14,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181857ms 2018-05-24 15:31:14,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82145ms 2018-05-24 15:31:14,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198245ms 2018-05-24 15:31:14,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230703ms 2018-05-24 15:31:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:14,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192522ms 2018-05-24 15:31:14,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87871ms 2018-05-24 15:31:14,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31133ms 2018-05-24 15:31:14,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68780ms 2018-05-24 15:31:14,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262163ms 2018-05-24 15:31:14,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136866ms 2018-05-24 15:31:14,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152831ms 2018-05-24 15:31:14,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6025ms 2018-05-24 15:31:14,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31101ms 2018-05-24 15:31:14,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:14,672 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:14,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97923ms 2018-05-24 15:31:14,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 135081ms 2018-05-24 15:31:14,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14495ms 2018-05-24 15:31:14,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269458ms 2018-05-24 15:31:14,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172490ms 2018-05-24 15:31:14,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91716ms 2018-05-24 15:31:14,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3138ms 2018-05-24 15:31:14,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198383ms 2018-05-24 15:31:14,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249995ms 2018-05-24 15:31:15,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29433ms 2018-05-24 15:31:15,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287761ms 2018-05-24 15:31:15,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22284ms 2018-05-24 15:31:15,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70989ms 2018-05-24 15:31:15,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251028ms 2018-05-24 15:31:15,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194089ms 2018-05-24 15:31:15,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240970ms 2018-05-24 15:31:15,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34503ms 2018-05-24 15:31:15,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95828ms 2018-05-24 15:31:15,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187412ms 2018-05-24 15:31:15,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22852ms 2018-05-24 15:31:15,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206680ms 2018-05-24 15:31:15,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175435ms 2018-05-24 15:31:15,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72671ms 2018-05-24 15:31:15,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295297ms 2018-05-24 15:31:15,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84517ms 2018-05-24 15:31:15,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5912ms 2018-05-24 15:31:15,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271113ms 2018-05-24 15:31:15,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218869ms 2018-05-24 15:31:15,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100997ms 2018-05-24 15:31:15,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1471ms 2018-05-24 15:31:15,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120119ms 2018-05-24 15:31:15,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101426ms 2018-05-24 15:31:15,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131736ms 2018-05-24 15:31:15,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200834ms 2018-05-24 15:31:15,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31812ms 2018-05-24 15:31:15,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158608ms 2018-05-24 15:31:15,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112012ms 2018-05-24 15:31:15,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183902ms 2018-05-24 15:31:15,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78230ms 2018-05-24 15:31:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56806ms 2018-05-24 15:31:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264805ms 2018-05-24 15:31:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25682ms 2018-05-24 15:31:16,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15020ms 2018-05-24 15:31:16,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30934ms 2018-05-24 15:31:16,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1788ms 2018-05-24 15:31:16,129 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:16,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65619ms 2018-05-24 15:31:16,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215662ms 2018-05-24 15:31:16,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60659ms 2018-05-24 15:31:16,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41417ms 2018-05-24 15:31:16,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 47887ms 2018-05-24 15:31:16,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12760ms 2018-05-24 15:31:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274681ms 2018-05-24 15:31:16,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34944ms 2018-05-24 15:31:16,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30656ms 2018-05-24 15:31:16,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217047ms 2018-05-24 15:31:16,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207621ms 2018-05-24 15:31:16,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15381ms 2018-05-24 15:31:16,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157705ms 2018-05-24 15:31:16,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118770ms 2018-05-24 15:31:16,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193519ms 2018-05-24 15:31:16,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18539ms 2018-05-24 15:31:16,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49539ms 2018-05-24 15:31:16,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281982ms 2018-05-24 15:31:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32978ms 2018-05-24 15:31:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268880ms 2018-05-24 15:31:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265365ms 2018-05-24 15:31:16,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299383ms 2018-05-24 15:31:16,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107665ms 2018-05-24 15:31:16,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263419ms 2018-05-24 15:31:17,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224626ms 2018-05-24 15:31:17,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44020ms 2018-05-24 15:31:17,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87268ms 2018-05-24 15:31:17,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134388ms 2018-05-24 15:31:17,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151120ms 2018-05-24 15:31:17,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216693ms 2018-05-24 15:31:17,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46365ms 2018-05-24 15:31:17,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35411ms 2018-05-24 15:31:17,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166272ms 2018-05-24 15:31:17,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13113ms 2018-05-24 15:31:17,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19830ms 2018-05-24 15:31:17,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174272ms 2018-05-24 15:31:17,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 271663ms 2018-05-24 15:31:17,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288588ms 2018-05-24 15:31:17,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22488ms 2018-05-24 15:31:17,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154906ms 2018-05-24 15:31:17,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266808ms 2018-05-24 15:31:17,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32893ms 2018-05-24 15:31:17,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295114ms 2018-05-24 15:31:17,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204867ms 2018-05-24 15:31:17,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196083ms 2018-05-24 15:31:17,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159437ms 2018-05-24 15:31:17,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160917ms 2018-05-24 15:31:17,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198712ms 2018-05-24 15:31:17,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200670ms 2018-05-24 15:31:17,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293699ms 2018-05-24 15:31:17,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207984ms 2018-05-24 15:31:17,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113903ms 2018-05-24 15:31:17,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31255ms 2018-05-24 15:31:17,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122173ms 2018-05-24 15:31:18,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135788ms 2018-05-24 15:31:18,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 33753ms 2018-05-24 15:31:18,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255123ms 2018-05-24 15:31:18,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44321ms 2018-05-24 15:31:18,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13246ms 2018-05-24 15:31:18,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130262ms 2018-05-24 15:31:18,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257710ms 2018-05-24 15:31:18,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16178ms 2018-05-24 15:31:18,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16612ms 2018-05-24 15:31:18,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21320ms 2018-05-24 15:31:18,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235311ms 2018-05-24 15:31:18,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245150ms 2018-05-24 15:31:18,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 60854ms 2018-05-24 15:31:18,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170224ms 2018-05-24 15:31:18,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238919ms 2018-05-24 15:31:18,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230196ms 2018-05-24 15:31:18,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246379ms 2018-05-24 15:31:18,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140213ms 2018-05-24 15:31:18,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146567ms 2018-05-24 15:31:18,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13011ms 2018-05-24 15:31:18,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78373ms 2018-05-24 15:31:18,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288227ms 2018-05-24 15:31:18,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263611ms 2018-05-24 15:31:18,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162269ms 2018-05-24 15:31:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88346ms 2018-05-24 15:31:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1967ms 2018-05-24 15:31:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96198ms 2018-05-24 15:31:18,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236970ms 2018-05-24 15:31:18,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68095ms 2018-05-24 15:31:18,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98745ms 2018-05-24 15:31:19,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 256571ms 2018-05-24 15:31:19,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51481ms 2018-05-24 15:31:19,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204723ms 2018-05-24 15:31:19,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29482ms 2018-05-24 15:31:19,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229973ms 2018-05-24 15:31:19,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222561ms 2018-05-24 15:31:19,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31622ms 2018-05-24 15:31:19,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227229ms 2018-05-24 15:31:19,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294804ms 2018-05-24 15:31:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 242470ms 2018-05-24 15:31:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217892ms 2018-05-24 15:31:19,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133402ms 2018-05-24 15:31:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:19,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:19,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30741ms 2018-05-24 15:31:19,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84968ms 2018-05-24 15:31:19,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249442ms 2018-05-24 15:31:19,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 92957ms 2018-05-24 15:31:19,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198060ms 2018-05-24 15:31:19,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212853ms 2018-05-24 15:31:19,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210852ms 2018-05-24 15:31:19,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134230ms 2018-05-24 15:31:19,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83968ms 2018-05-24 15:31:19,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:19,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5694ms 2018-05-24 15:31:19,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244744ms 2018-05-24 15:31:19,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22153ms 2018-05-24 15:31:19,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2564ms 2018-05-24 15:31:19,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61382ms 2018-05-24 15:31:19,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130771ms 2018-05-24 15:31:19,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104533ms 2018-05-24 15:31:19,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52334ms 2018-05-24 15:31:19,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88343ms 2018-05-24 15:31:20,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 150517ms 2018-05-24 15:31:20,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94002ms 2018-05-24 15:31:20,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159029ms 2018-05-24 15:31:20,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149135ms 2018-05-24 15:31:20,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224987ms 2018-05-24 15:31:20,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293235ms 2018-05-24 15:31:20,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 47980ms 2018-05-24 15:31:20,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296664ms 2018-05-24 15:31:20,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133682ms 2018-05-24 15:31:20,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235147ms 2018-05-24 15:31:20,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240853ms 2018-05-24 15:31:20,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278326ms 2018-05-24 15:31:20,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172659ms 2018-05-24 15:31:20,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1933ms 2018-05-24 15:31:20,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130884ms 2018-05-24 15:31:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10073ms 2018-05-24 15:31:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65963ms 2018-05-24 15:31:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59087ms 2018-05-24 15:31:20,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8881ms 2018-05-24 15:31:20,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272850ms 2018-05-24 15:31:20,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246040ms 2018-05-24 15:31:20,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157408ms 2018-05-24 15:31:20,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108217ms 2018-05-24 15:31:20,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131714ms 2018-05-24 15:31:20,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72169ms 2018-05-24 15:31:20,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112777ms 2018-05-24 15:31:20,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101906ms 2018-05-24 15:31:20,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60493ms 2018-05-24 15:31:20,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210387ms 2018-05-24 15:31:20,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42957ms 2018-05-24 15:31:21,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187113ms 2018-05-24 15:31:21,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253262ms 2018-05-24 15:31:21,017 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127941ms 2018-05-24 15:31:21,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87102ms 2018-05-24 15:31:21,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289434ms 2018-05-24 15:31:21,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293572ms 2018-05-24 15:31:21,130 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:21,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274616ms 2018-05-24 15:31:21,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129963ms 2018-05-24 15:31:21,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237752ms 2018-05-24 15:31:21,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268074ms 2018-05-24 15:31:21,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80148ms 2018-05-24 15:31:21,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158086ms 2018-05-24 15:31:21,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128997ms 2018-05-24 15:31:21,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87653ms 2018-05-24 15:31:21,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86403ms 2018-05-24 15:31:21,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154980ms 2018-05-24 15:31:21,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153328ms 2018-05-24 15:31:21,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183478ms 2018-05-24 15:31:21,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76592ms 2018-05-24 15:31:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227294ms 2018-05-24 15:31:21,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144555ms 2018-05-24 15:31:21,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192431ms 2018-05-24 15:31:21,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297786ms 2018-05-24 15:31:21,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84856ms 2018-05-24 15:31:21,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216388ms 2018-05-24 15:31:21,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173666ms 2018-05-24 15:31:21,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10683ms 2018-05-24 15:31:21,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61287ms 2018-05-24 15:31:21,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44442ms 2018-05-24 15:31:21,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205941ms 2018-05-24 15:31:22,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 75183ms 2018-05-24 15:31:22,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143996ms 2018-05-24 15:31:22,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187724ms 2018-05-24 15:31:22,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 60754ms 2018-05-24 15:31:22,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16132ms 2018-05-24 15:31:22,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12609ms 2018-05-24 15:31:22,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277853ms 2018-05-24 15:31:22,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126235ms 2018-05-24 15:31:22,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221373ms 2018-05-24 15:31:22,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200636ms 2018-05-24 15:31:22,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185287ms 2018-05-24 15:31:22,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114298ms 2018-05-24 15:31:22,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297250ms 2018-05-24 15:31:22,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53136ms 2018-05-24 15:31:22,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69081ms 2018-05-24 15:31:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235031ms 2018-05-24 15:31:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41512ms 2018-05-24 15:31:22,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270563ms 2018-05-24 15:31:22,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195791ms 2018-05-24 15:31:22,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298243ms 2018-05-24 15:31:22,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25753ms 2018-05-24 15:31:22,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41947ms 2018-05-24 15:31:22,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261165ms 2018-05-24 15:31:22,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206640ms 2018-05-24 15:31:22,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235743ms 2018-05-24 15:31:22,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117505ms 2018-05-24 15:31:22,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231063ms 2018-05-24 15:31:22,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 170691ms 2018-05-24 15:31:22,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10578ms 2018-05-24 15:31:22,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70055ms 2018-05-24 15:31:23,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262191ms 2018-05-24 15:31:23,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 738ms 2018-05-24 15:31:23,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74555ms 2018-05-24 15:31:23,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3685ms 2018-05-24 15:31:23,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211528ms 2018-05-24 15:31:23,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134892ms 2018-05-24 15:31:23,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189092ms 2018-05-24 15:31:23,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282143ms 2018-05-24 15:31:23,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263539ms 2018-05-24 15:31:23,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223512ms 2018-05-24 15:31:23,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177663ms 2018-05-24 15:31:23,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251043ms 2018-05-24 15:31:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74357ms 2018-05-24 15:31:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133838ms 2018-05-24 15:31:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63312ms 2018-05-24 15:31:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85935ms 2018-05-24 15:31:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247045ms 2018-05-24 15:31:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100816ms 2018-05-24 15:31:23,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133815ms 2018-05-24 15:31:23,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30671ms 2018-05-24 15:31:23,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268468ms 2018-05-24 15:31:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162691ms 2018-05-24 15:31:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18590ms 2018-05-24 15:31:23,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264644ms 2018-05-24 15:31:23,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297995ms 2018-05-24 15:31:23,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28634ms 2018-05-24 15:31:23,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126715ms 2018-05-24 15:31:23,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72352ms 2018-05-24 15:31:23,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194020ms 2018-05-24 15:31:23,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134601ms 2018-05-24 15:31:24,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288098ms 2018-05-24 15:31:24,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59757ms 2018-05-24 15:31:24,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231269ms 2018-05-24 15:31:24,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123481ms 2018-05-24 15:31:24,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181227ms 2018-05-24 15:31:24,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249869ms 2018-05-24 15:31:24,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251291ms 2018-05-24 15:31:24,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270356ms 2018-05-24 15:31:24,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76347ms 2018-05-24 15:31:24,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1021ms 2018-05-24 15:31:24,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148527ms 2018-05-24 15:31:24,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76287ms 2018-05-24 15:31:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:24,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38769ms 2018-05-24 15:31:24,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31635ms 2018-05-24 15:31:24,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94439ms 2018-05-24 15:31:24,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87208ms 2018-05-24 15:31:24,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216368ms 2018-05-24 15:31:24,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244838ms 2018-05-24 15:31:24,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57980ms 2018-05-24 15:31:24,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200949ms 2018-05-24 15:31:24,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171620ms 2018-05-24 15:31:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:24,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198828ms 2018-05-24 15:31:24,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188626ms 2018-05-24 15:31:24,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35419ms 2018-05-24 15:31:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25011ms 2018-05-24 15:31:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31326ms 2018-05-24 15:31:24,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296314ms 2018-05-24 15:31:24,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247856ms 2018-05-24 15:31:24,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235201ms 2018-05-24 15:31:24,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282648ms 2018-05-24 15:31:25,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270528ms 2018-05-24 15:31:25,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218552ms 2018-05-24 15:31:25,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174271ms 2018-05-24 15:31:25,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148765ms 2018-05-24 15:31:25,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238641ms 2018-05-24 15:31:25,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204636ms 2018-05-24 15:31:25,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148466ms 2018-05-24 15:31:25,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37560ms 2018-05-24 15:31:25,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39726ms 2018-05-24 15:31:25,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126330ms 2018-05-24 15:31:25,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202396ms 2018-05-24 15:31:25,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49917ms 2018-05-24 15:31:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176789ms 2018-05-24 15:31:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 204165ms 2018-05-24 15:31:25,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237449ms 2018-05-24 15:31:25,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 136109ms 2018-05-24 15:31:25,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75922ms 2018-05-24 15:31:25,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245068ms 2018-05-24 15:31:25,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285015ms 2018-05-24 15:31:25,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286392ms 2018-05-24 15:31:25,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210ms 2018-05-24 15:31:25,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175304ms 2018-05-24 15:31:25,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66498ms 2018-05-24 15:31:25,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48573ms 2018-05-24 15:31:25,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103167ms 2018-05-24 15:31:25,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215439ms 2018-05-24 15:31:25,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141100ms 2018-05-24 15:31:25,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264557ms 2018-05-24 15:31:25,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250797ms 2018-05-24 15:31:25,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79383ms 2018-05-24 15:31:26,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158374ms 2018-05-24 15:31:26,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249870ms 2018-05-24 15:31:26,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284031ms 2018-05-24 15:31:26,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159956ms 2018-05-24 15:31:26,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183038ms 2018-05-24 15:31:26,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251099ms 2018-05-24 15:31:26,131 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:26,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164455ms 2018-05-24 15:31:26,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5809ms 2018-05-24 15:31:26,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175237ms 2018-05-24 15:31:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213289ms 2018-05-24 15:31:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196281ms 2018-05-24 15:31:26,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250237ms 2018-05-24 15:31:26,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 90043ms 2018-05-24 15:31:26,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120548ms 2018-05-24 15:31:26,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164842ms 2018-05-24 15:31:26,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:31:26,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47645ms 2018-05-24 15:31:26,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234680ms 2018-05-24 15:31:26,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189303ms 2018-05-24 15:31:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120138ms 2018-05-24 15:31:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46912ms 2018-05-24 15:31:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56634ms 2018-05-24 15:31:26,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23115ms 2018-05-24 15:31:26,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23163ms 2018-05-24 15:31:26,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142384ms 2018-05-24 15:31:26,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155751ms 2018-05-24 15:31:26,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101031ms 2018-05-24 15:31:26,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22477ms 2018-05-24 15:31:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214819ms 2018-05-24 15:31:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157598ms 2018-05-24 15:31:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142230ms 2018-05-24 15:31:27,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 242968ms 2018-05-24 15:31:27,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53425ms 2018-05-24 15:31:27,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249886ms 2018-05-24 15:31:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197909ms 2018-05-24 15:31:27,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194176ms 2018-05-24 15:31:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174822ms 2018-05-24 15:31:27,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278866ms 2018-05-24 15:31:27,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236652ms 2018-05-24 15:31:27,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268954ms 2018-05-24 15:31:27,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25564ms 2018-05-24 15:31:27,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228663ms 2018-05-24 15:31:27,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92164ms 2018-05-24 15:31:27,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229584ms 2018-05-24 15:31:27,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17922ms 2018-05-24 15:31:27,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273196ms 2018-05-24 15:31:27,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281782ms 2018-05-24 15:31:27,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 92881ms 2018-05-24 15:31:27,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78235ms 2018-05-24 15:31:27,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173941ms 2018-05-24 15:31:27,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144629ms 2018-05-24 15:31:27,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14915ms 2018-05-24 15:31:27,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166854ms 2018-05-24 15:31:27,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103436ms 2018-05-24 15:31:27,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191618ms 2018-05-24 15:31:27,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65196ms 2018-05-24 15:31:27,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289838ms 2018-05-24 15:31:27,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145540ms 2018-05-24 15:31:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31314ms 2018-05-24 15:31:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255643ms 2018-05-24 15:31:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76909ms 2018-05-24 15:31:28,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108763ms 2018-05-24 15:31:28,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298427ms 2018-05-24 15:31:28,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27408ms 2018-05-24 15:31:28,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205060ms 2018-05-24 15:31:28,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147292ms 2018-05-24 15:31:28,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171331ms 2018-05-24 15:31:28,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 143990ms 2018-05-24 15:31:28,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287746ms 2018-05-24 15:31:28,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198254ms 2018-05-24 15:31:28,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179154ms 2018-05-24 15:31:28,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278622ms 2018-05-24 15:31:28,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122687ms 2018-05-24 15:31:28,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272541ms 2018-05-24 15:31:28,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224046ms 2018-05-24 15:31:28,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153158ms 2018-05-24 15:31:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230765ms 2018-05-24 15:31:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119896ms 2018-05-24 15:31:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257187ms 2018-05-24 15:31:28,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212399ms 2018-05-24 15:31:28,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1364ms 2018-05-24 15:31:28,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89874ms 2018-05-24 15:31:28,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285962ms 2018-05-24 15:31:28,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222513ms 2018-05-24 15:31:28,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222691ms 2018-05-24 15:31:28,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111296ms 2018-05-24 15:31:28,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146688ms 2018-05-24 15:31:28,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296153ms 2018-05-24 15:31:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251464ms 2018-05-24 15:31:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105840ms 2018-05-24 15:31:28,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43124ms 2018-05-24 15:31:29,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229216ms 2018-05-24 15:31:29,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180282ms 2018-05-24 15:31:29,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106969ms 2018-05-24 15:31:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51105ms 2018-05-24 15:31:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212553ms 2018-05-24 15:31:29,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253171ms 2018-05-24 15:31:29,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222901ms 2018-05-24 15:31:29,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79894ms 2018-05-24 15:31:29,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42729ms 2018-05-24 15:31:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262492ms 2018-05-24 15:31:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136136ms 2018-05-24 15:31:29,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29938ms 2018-05-24 15:31:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:29,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176903ms 2018-05-24 15:31:29,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49664ms 2018-05-24 15:31:29,416 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234923ms 2018-05-24 15:31:29,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119595ms 2018-05-24 15:31:29,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87665ms 2018-05-24 15:31:29,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4034ms 2018-05-24 15:31:29,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106804ms 2018-05-24 15:31:29,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99863ms 2018-05-24 15:31:29,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121836ms 2018-05-24 15:31:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:29,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81003ms 2018-05-24 15:31:29,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194948ms 2018-05-24 15:31:29,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163227ms 2018-05-24 15:31:29,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65416ms 2018-05-24 15:31:29,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226651ms 2018-05-24 15:31:29,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199117ms 2018-05-24 15:31:29,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119371ms 2018-05-24 15:31:29,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151764ms 2018-05-24 15:31:29,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299905ms 2018-05-24 15:31:30,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86045ms 2018-05-24 15:31:30,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73855ms 2018-05-24 15:31:30,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197004ms 2018-05-24 15:31:30,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36934ms 2018-05-24 15:31:30,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272139ms 2018-05-24 15:31:30,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63821ms 2018-05-24 15:31:30,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214389ms 2018-05-24 15:31:30,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16099ms 2018-05-24 15:31:30,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285405ms 2018-05-24 15:31:30,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242813ms 2018-05-24 15:31:30,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95017ms 2018-05-24 15:31:30,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171890ms 2018-05-24 15:31:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255347ms 2018-05-24 15:31:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146736ms 2018-05-24 15:31:30,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194154ms 2018-05-24 15:31:30,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172770ms 2018-05-24 15:31:30,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134580ms 2018-05-24 15:31:30,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32734ms 2018-05-24 15:31:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99748ms 2018-05-24 15:31:30,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50469ms 2018-05-24 15:31:30,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61716ms 2018-05-24 15:31:30,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67223ms 2018-05-24 15:31:30,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59966ms 2018-05-24 15:31:30,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169284ms 2018-05-24 15:31:30,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156990ms 2018-05-24 15:31:30,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146891ms 2018-05-24 15:31:30,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248028ms 2018-05-24 15:31:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30354ms 2018-05-24 15:31:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133702ms 2018-05-24 15:31:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228388ms 2018-05-24 15:31:31,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38196ms 2018-05-24 15:31:31,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176765ms 2018-05-24 15:31:31,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213216ms 2018-05-24 15:31:31,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204339ms 2018-05-24 15:31:31,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243754ms 2018-05-24 15:31:31,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80353ms 2018-05-24 15:31:31,132 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:31,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134341ms 2018-05-24 15:31:31,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66977ms 2018-05-24 15:31:31,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37451ms 2018-05-24 15:31:31,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247318ms 2018-05-24 15:31:31,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206823ms 2018-05-24 15:31:31,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64995ms 2018-05-24 15:31:31,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10754ms 2018-05-24 15:31:31,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 250090ms 2018-05-24 15:31:31,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122628ms 2018-05-24 15:31:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299217ms 2018-05-24 15:31:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265898ms 2018-05-24 15:31:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53115ms 2018-05-24 15:31:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93709ms 2018-05-24 15:31:31,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4875ms 2018-05-24 15:31:31,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218066ms 2018-05-24 15:31:31,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 248089ms 2018-05-24 15:31:31,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214197ms 2018-05-24 15:31:31,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165246ms 2018-05-24 15:31:31,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121719ms 2018-05-24 15:31:31,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260099ms 2018-05-24 15:31:31,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187414ms 2018-05-24 15:31:31,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268991ms 2018-05-24 15:31:31,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259872ms 2018-05-24 15:31:31,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91339ms 2018-05-24 15:31:32,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130330ms 2018-05-24 15:31:32,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54741ms 2018-05-24 15:31:32,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195722ms 2018-05-24 15:31:32,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 171137ms 2018-05-24 15:31:32,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296524ms 2018-05-24 15:31:32,117 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168275ms 2018-05-24 15:31:32,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177966ms 2018-05-24 15:31:32,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293135ms 2018-05-24 15:31:32,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225563ms 2018-05-24 15:31:32,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115011ms 2018-05-24 15:31:32,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210460ms 2018-05-24 15:31:32,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275122ms 2018-05-24 15:31:32,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200232ms 2018-05-24 15:31:32,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114046ms 2018-05-24 15:31:32,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131255ms 2018-05-24 15:31:32,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16934ms 2018-05-24 15:31:32,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189709ms 2018-05-24 15:31:32,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129559ms 2018-05-24 15:31:32,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93485ms 2018-05-24 15:31:32,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109242ms 2018-05-24 15:31:32,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195050ms 2018-05-24 15:31:32,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63671ms 2018-05-24 15:31:32,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288771ms 2018-05-24 15:31:32,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287824ms 2018-05-24 15:31:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250733ms 2018-05-24 15:31:32,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198403ms 2018-05-24 15:31:32,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158230ms 2018-05-24 15:31:32,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230189ms 2018-05-24 15:31:32,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200189ms 2018-05-24 15:31:32,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99419ms 2018-05-24 15:31:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134826ms 2018-05-24 15:31:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77956ms 2018-05-24 15:31:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86636ms 2018-05-24 15:31:33,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278908ms 2018-05-24 15:31:33,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14316ms 2018-05-24 15:31:33,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121072ms 2018-05-24 15:31:33,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263382ms 2018-05-24 15:31:33,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 126084ms 2018-05-24 15:31:33,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277452ms 2018-05-24 15:31:33,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193270ms 2018-05-24 15:31:33,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32066ms 2018-05-24 15:31:33,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266613ms 2018-05-24 15:31:33,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267518ms 2018-05-24 15:31:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45979ms 2018-05-24 15:31:33,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239156ms 2018-05-24 15:31:33,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142514ms 2018-05-24 15:31:33,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117291ms 2018-05-24 15:31:33,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284634ms 2018-05-24 15:31:33,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299044ms 2018-05-24 15:31:33,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273415ms 2018-05-24 15:31:33,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206740ms 2018-05-24 15:31:33,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94424ms 2018-05-24 15:31:33,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274303ms 2018-05-24 15:31:33,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167174ms 2018-05-24 15:31:33,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115059ms 2018-05-24 15:31:33,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192807ms 2018-05-24 15:31:33,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233903ms 2018-05-24 15:31:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78444ms 2018-05-24 15:31:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139279ms 2018-05-24 15:31:33,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191301ms 2018-05-24 15:31:34,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201642ms 2018-05-24 15:31:34,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255906ms 2018-05-24 15:31:34,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155372ms 2018-05-24 15:31:34,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 180599ms 2018-05-24 15:31:34,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8404ms 2018-05-24 15:31:34,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137374ms 2018-05-24 15:31:34,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159310ms 2018-05-24 15:31:34,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28878ms 2018-05-24 15:31:34,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136370ms 2018-05-24 15:31:34,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227722ms 2018-05-24 15:31:34,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167064ms 2018-05-24 15:31:34,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45880ms 2018-05-24 15:31:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:34,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235916ms 2018-05-24 15:31:34,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65700ms 2018-05-24 15:31:34,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235484ms 2018-05-24 15:31:34,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220947ms 2018-05-24 15:31:34,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76798ms 2018-05-24 15:31:34,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269733ms 2018-05-24 15:31:34,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202145ms 2018-05-24 15:31:34,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36509ms 2018-05-24 15:31:34,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165436ms 2018-05-24 15:31:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:34,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283078ms 2018-05-24 15:31:34,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64516ms 2018-05-24 15:31:34,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167176ms 2018-05-24 15:31:34,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73311ms 2018-05-24 15:31:34,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18875ms 2018-05-24 15:31:34,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138733ms 2018-05-24 15:31:34,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269641ms 2018-05-24 15:31:34,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219216ms 2018-05-24 15:31:34,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90907ms 2018-05-24 15:31:35,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258520ms 2018-05-24 15:31:35,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295247ms 2018-05-24 15:31:35,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34639ms 2018-05-24 15:31:35,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85752ms 2018-05-24 15:31:35,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211003ms 2018-05-24 15:31:35,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56144ms 2018-05-24 15:31:35,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288320ms 2018-05-24 15:31:35,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192705ms 2018-05-24 15:31:35,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83554ms 2018-05-24 15:31:35,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113823ms 2018-05-24 15:31:35,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172659ms 2018-05-24 15:31:35,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99048ms 2018-05-24 15:31:35,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76901ms 2018-05-24 15:31:35,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146031ms 2018-05-24 15:31:35,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290170ms 2018-05-24 15:31:35,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149661ms 2018-05-24 15:31:35,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101027ms 2018-05-24 15:31:35,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110368ms 2018-05-24 15:31:35,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290587ms 2018-05-24 15:31:35,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294424ms 2018-05-24 15:31:35,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85918ms 2018-05-24 15:31:35,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266528ms 2018-05-24 15:31:35,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69736ms 2018-05-24 15:31:35,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14806ms 2018-05-24 15:31:35,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88050ms 2018-05-24 15:31:35,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296588ms 2018-05-24 15:31:35,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46782ms 2018-05-24 15:31:35,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30043ms 2018-05-24 15:31:35,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119635ms 2018-05-24 15:31:35,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148365ms 2018-05-24 15:31:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110338ms 2018-05-24 15:31:36,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88342ms 2018-05-24 15:31:36,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62658ms 2018-05-24 15:31:36,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137455ms 2018-05-24 15:31:36,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200769ms 2018-05-24 15:31:36,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113954ms 2018-05-24 15:31:36,133 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:36,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156363ms 2018-05-24 15:31:36,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251197ms 2018-05-24 15:31:36,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96795ms 2018-05-24 15:31:36,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217736ms 2018-05-24 15:31:36,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247775ms 2018-05-24 15:31:36,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182440ms 2018-05-24 15:31:36,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229774ms 2018-05-24 15:31:36,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197346ms 2018-05-24 15:31:36,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210249ms 2018-05-24 15:31:36,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123392ms 2018-05-24 15:31:36,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58654ms 2018-05-24 15:31:36,516 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144891ms 2018-05-24 15:31:36,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57070ms 2018-05-24 15:31:36,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177957ms 2018-05-24 15:31:36,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95743ms 2018-05-24 15:31:36,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295570ms 2018-05-24 15:31:36,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31014ms 2018-05-24 15:31:36,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229879ms 2018-05-24 15:31:36,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 242911ms 2018-05-24 15:31:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232829ms 2018-05-24 15:31:36,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33202ms 2018-05-24 15:31:36,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294506ms 2018-05-24 15:31:36,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276946ms 2018-05-24 15:31:36,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283753ms 2018-05-24 15:31:37,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44505ms 2018-05-24 15:31:37,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17910ms 2018-05-24 15:31:37,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281978ms 2018-05-24 15:31:37,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270240ms 2018-05-24 15:31:37,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 135139ms 2018-05-24 15:31:37,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209642ms 2018-05-24 15:31:37,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 6099ms 2018-05-24 15:31:37,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161188ms 2018-05-24 15:31:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256241ms 2018-05-24 15:31:37,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23936ms 2018-05-24 15:31:37,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153241ms 2018-05-24 15:31:37,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78391ms 2018-05-24 15:31:37,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278358ms 2018-05-24 15:31:37,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117996ms 2018-05-24 15:31:37,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193847ms 2018-05-24 15:31:37,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21213ms 2018-05-24 15:31:37,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22806ms 2018-05-24 15:31:37,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167310ms 2018-05-24 15:31:37,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1677ms 2018-05-24 15:31:37,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33881ms 2018-05-24 15:31:37,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104762ms 2018-05-24 15:31:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115879ms 2018-05-24 15:31:37,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64029ms 2018-05-24 15:31:37,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290388ms 2018-05-24 15:31:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103341ms 2018-05-24 15:31:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 256232ms 2018-05-24 15:31:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162162ms 2018-05-24 15:31:37,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161149ms 2018-05-24 15:31:37,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96407ms 2018-05-24 15:31:37,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296069ms 2018-05-24 15:31:38,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 110925ms 2018-05-24 15:31:38,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164458ms 2018-05-24 15:31:38,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163315ms 2018-05-24 15:31:38,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253353ms 2018-05-24 15:31:38,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243053ms 2018-05-24 15:31:38,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144348ms 2018-05-24 15:31:38,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32750ms 2018-05-24 15:31:38,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152867ms 2018-05-24 15:31:38,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1274ms 2018-05-24 15:31:38,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197377ms 2018-05-24 15:31:38,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8287ms 2018-05-24 15:31:38,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188670ms 2018-05-24 15:31:38,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177295ms 2018-05-24 15:31:38,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37106ms 2018-05-24 15:31:38,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200637ms 2018-05-24 15:31:38,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218383ms 2018-05-24 15:31:38,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115969ms 2018-05-24 15:31:38,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226077ms 2018-05-24 15:31:38,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 180834ms 2018-05-24 15:31:38,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91687ms 2018-05-24 15:31:38,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226640ms 2018-05-24 15:31:38,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27837ms 2018-05-24 15:31:38,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218490ms 2018-05-24 15:31:38,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205576ms 2018-05-24 15:31:38,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146122ms 2018-05-24 15:31:38,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113285ms 2018-05-24 15:31:38,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4583ms 2018-05-24 15:31:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147637ms 2018-05-24 15:31:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137430ms 2018-05-24 15:31:38,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286620ms 2018-05-24 15:31:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285269ms 2018-05-24 15:31:39,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206754ms 2018-05-24 15:31:39,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106051ms 2018-05-24 15:31:39,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105601ms 2018-05-24 15:31:39,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256245ms 2018-05-24 15:31:39,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104746ms 2018-05-24 15:31:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98318ms 2018-05-24 15:31:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225648ms 2018-05-24 15:31:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178616ms 2018-05-24 15:31:39,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43359ms 2018-05-24 15:31:39,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92362ms 2018-05-24 15:31:39,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130525ms 2018-05-24 15:31:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:39,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141898ms 2018-05-24 15:31:39,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51579ms 2018-05-24 15:31:39,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93647ms 2018-05-24 15:31:39,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143837ms 2018-05-24 15:31:39,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156776ms 2018-05-24 15:31:39,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175190ms 2018-05-24 15:31:39,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161985ms 2018-05-24 15:31:39,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275845ms 2018-05-24 15:31:39,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63295ms 2018-05-24 15:31:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:39,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:39,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251089ms 2018-05-24 15:31:39,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135516ms 2018-05-24 15:31:39,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166570ms 2018-05-24 15:31:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88675ms 2018-05-24 15:31:39,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35118ms 2018-05-24 15:31:39,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17401ms 2018-05-24 15:31:39,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4742ms 2018-05-24 15:31:39,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194888ms 2018-05-24 15:31:39,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16451ms 2018-05-24 15:31:40,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193600ms 2018-05-24 15:31:40,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191580ms 2018-05-24 15:31:40,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62913ms 2018-05-24 15:31:40,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47043ms 2018-05-24 15:31:40,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212362ms 2018-05-24 15:31:40,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151827ms 2018-05-24 15:31:40,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168402ms 2018-05-24 15:31:40,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186524ms 2018-05-24 15:31:40,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237713ms 2018-05-24 15:31:40,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116703ms 2018-05-24 15:31:40,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189876ms 2018-05-24 15:31:40,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76832ms 2018-05-24 15:31:40,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 33462ms 2018-05-24 15:31:40,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196541ms 2018-05-24 15:31:40,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92933ms 2018-05-24 15:31:40,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 196955ms 2018-05-24 15:31:40,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105391ms 2018-05-24 15:31:40,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25660ms 2018-05-24 15:31:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219274ms 2018-05-24 15:31:40,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113763ms 2018-05-24 15:31:40,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270379ms 2018-05-24 15:31:40,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181945ms 2018-05-24 15:31:40,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8322ms 2018-05-24 15:31:40,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64238ms 2018-05-24 15:31:40,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238819ms 2018-05-24 15:31:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33603ms 2018-05-24 15:31:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174535ms 2018-05-24 15:31:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133117ms 2018-05-24 15:31:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190879ms 2018-05-24 15:31:40,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19294ms 2018-05-24 15:31:41,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49732ms 2018-05-24 15:31:41,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210069ms 2018-05-24 15:31:41,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294018ms 2018-05-24 15:31:41,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270467ms 2018-05-24 15:31:41,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38734ms 2018-05-24 15:31:41,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192526ms 2018-05-24 15:31:41,134 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:41,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164916ms 2018-05-24 15:31:41,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24772ms 2018-05-24 15:31:41,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208832ms 2018-05-24 15:31:41,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129445ms 2018-05-24 15:31:41,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 169450ms 2018-05-24 15:31:41,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9324ms 2018-05-24 15:31:41,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178103ms 2018-05-24 15:31:41,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187468ms 2018-05-24 15:31:41,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55475ms 2018-05-24 15:31:41,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88101ms 2018-05-24 15:31:41,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36358ms 2018-05-24 15:31:41,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56962ms 2018-05-24 15:31:41,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173921ms 2018-05-24 15:31:41,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120563ms 2018-05-24 15:31:41,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238135ms 2018-05-24 15:31:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190813ms 2018-05-24 15:31:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174546ms 2018-05-24 15:31:41,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31326ms 2018-05-24 15:31:41,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38271ms 2018-05-24 15:31:41,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23042ms 2018-05-24 15:31:41,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246619ms 2018-05-24 15:31:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 96206ms 2018-05-24 15:31:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298621ms 2018-05-24 15:31:41,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10103ms 2018-05-24 15:31:42,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290032ms 2018-05-24 15:31:42,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192495ms 2018-05-24 15:31:42,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243727ms 2018-05-24 15:31:42,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139153ms 2018-05-24 15:31:42,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141490ms 2018-05-24 15:31:42,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261523ms 2018-05-24 15:31:42,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200208ms 2018-05-24 15:31:42,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146215ms 2018-05-24 15:31:42,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146005ms 2018-05-24 15:31:42,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266966ms 2018-05-24 15:31:42,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299026ms 2018-05-24 15:31:42,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18631ms 2018-05-24 15:31:42,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199053ms 2018-05-24 15:31:42,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165725ms 2018-05-24 15:31:42,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200756ms 2018-05-24 15:31:42,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 130790ms 2018-05-24 15:31:42,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256501ms 2018-05-24 15:31:42,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129784ms 2018-05-24 15:31:42,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263904ms 2018-05-24 15:31:42,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82835ms 2018-05-24 15:31:42,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271131ms 2018-05-24 15:31:42,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206055ms 2018-05-24 15:31:42,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14468ms 2018-05-24 15:31:42,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89477ms 2018-05-24 15:31:42,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 180331ms 2018-05-24 15:31:42,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50904ms 2018-05-24 15:31:42,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161802ms 2018-05-24 15:31:42,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276883ms 2018-05-24 15:31:42,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141815ms 2018-05-24 15:31:42,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114062ms 2018-05-24 15:31:43,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246934ms 2018-05-24 15:31:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100130ms 2018-05-24 15:31:43,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203232ms 2018-05-24 15:31:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112509ms 2018-05-24 15:31:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83068ms 2018-05-24 15:31:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14681ms 2018-05-24 15:31:43,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104227ms 2018-05-24 15:31:43,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246130ms 2018-05-24 15:31:43,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23804ms 2018-05-24 15:31:43,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275472ms 2018-05-24 15:31:43,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140835ms 2018-05-24 15:31:43,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193104ms 2018-05-24 15:31:43,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102075ms 2018-05-24 15:31:43,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190375ms 2018-05-24 15:31:43,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4975ms 2018-05-24 15:31:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157461ms 2018-05-24 15:31:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54559ms 2018-05-24 15:31:43,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135795ms 2018-05-24 15:31:43,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134063ms 2018-05-24 15:31:43,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166822ms 2018-05-24 15:31:43,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179675ms 2018-05-24 15:31:43,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214067ms 2018-05-24 15:31:43,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38160ms 2018-05-24 15:31:43,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70074ms 2018-05-24 15:31:43,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162468ms 2018-05-24 15:31:43,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2753ms 2018-05-24 15:31:43,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144426ms 2018-05-24 15:31:43,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177322ms 2018-05-24 15:31:43,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238199ms 2018-05-24 15:31:43,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181155ms 2018-05-24 15:31:44,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 169963ms 2018-05-24 15:31:44,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274759ms 2018-05-24 15:31:44,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149192ms 2018-05-24 15:31:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109825ms 2018-05-24 15:31:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149026ms 2018-05-24 15:31:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67053ms 2018-05-24 15:31:44,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83169ms 2018-05-24 15:31:44,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184722ms 2018-05-24 15:31:44,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86569ms 2018-05-24 15:31:44,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159459ms 2018-05-24 15:31:44,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59653ms 2018-05-24 15:31:44,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177391ms 2018-05-24 15:31:44,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:44,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:44,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163088ms 2018-05-24 15:31:44,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 199284ms 2018-05-24 15:31:44,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252272ms 2018-05-24 15:31:44,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251529ms 2018-05-24 15:31:44,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256386ms 2018-05-24 15:31:44,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214680ms 2018-05-24 15:31:44,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101677ms 2018-05-24 15:31:44,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19094ms 2018-05-24 15:31:44,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158838ms 2018-05-24 15:31:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:44,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:44,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208049ms 2018-05-24 15:31:44,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87398ms 2018-05-24 15:31:44,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151086ms 2018-05-24 15:31:44,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229013ms 2018-05-24 15:31:44,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49681ms 2018-05-24 15:31:44,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159467ms 2018-05-24 15:31:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181684ms 2018-05-24 15:31:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157090ms 2018-05-24 15:31:44,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212217ms 2018-05-24 15:31:45,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218714ms 2018-05-24 15:31:45,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86487ms 2018-05-24 15:31:45,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44075ms 2018-05-24 15:31:45,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 179676ms 2018-05-24 15:31:45,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228199ms 2018-05-24 15:31:45,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200377ms 2018-05-24 15:31:45,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106667ms 2018-05-24 15:31:45,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25763ms 2018-05-24 15:31:45,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11280ms 2018-05-24 15:31:45,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247327ms 2018-05-24 15:31:45,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257369ms 2018-05-24 15:31:45,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156169ms 2018-05-24 15:31:45,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280864ms 2018-05-24 15:31:45,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28903ms 2018-05-24 15:31:45,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206672ms 2018-05-24 15:31:45,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265158ms 2018-05-24 15:31:45,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232646ms 2018-05-24 15:31:45,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274000ms 2018-05-24 15:31:45,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45788ms 2018-05-24 15:31:45,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100457ms 2018-05-24 15:31:45,616 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52273ms 2018-05-24 15:31:45,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4787ms 2018-05-24 15:31:45,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22910ms 2018-05-24 15:31:45,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235231ms 2018-05-24 15:31:45,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19306ms 2018-05-24 15:31:45,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121775ms 2018-05-24 15:31:45,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217340ms 2018-05-24 15:31:45,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57328ms 2018-05-24 15:31:45,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20846ms 2018-05-24 15:31:45,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206498ms 2018-05-24 15:31:46,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123848ms 2018-05-24 15:31:46,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33736ms 2018-05-24 15:31:46,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201095ms 2018-05-24 15:31:46,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192211ms 2018-05-24 15:31:46,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135147ms 2018-05-24 15:31:46,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54803ms 2018-05-24 15:31:46,136 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:46,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294758ms 2018-05-24 15:31:46,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76972ms 2018-05-24 15:31:46,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6542ms 2018-05-24 15:31:46,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134402ms 2018-05-24 15:31:46,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290654ms 2018-05-24 15:31:46,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130438ms 2018-05-24 15:31:46,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:31:46,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141381ms 2018-05-24 15:31:46,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150954ms 2018-05-24 15:31:46,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172000ms 2018-05-24 15:31:46,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79804ms 2018-05-24 15:31:46,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34649ms 2018-05-24 15:31:46,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295819ms 2018-05-24 15:31:46,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18351ms 2018-05-24 15:31:46,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109954ms 2018-05-24 15:31:46,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280144ms 2018-05-24 15:31:46,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262734ms 2018-05-24 15:31:46,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167295ms 2018-05-24 15:31:46,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118926ms 2018-05-24 15:31:46,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66010ms 2018-05-24 15:31:46,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33960ms 2018-05-24 15:31:46,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221583ms 2018-05-24 15:31:46,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177716ms 2018-05-24 15:31:46,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198779ms 2018-05-24 15:31:46,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107611ms 2018-05-24 15:31:47,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279360ms 2018-05-24 15:31:47,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269679ms 2018-05-24 15:31:47,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4336ms 2018-05-24 15:31:47,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295452ms 2018-05-24 15:31:47,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108305ms 2018-05-24 15:31:47,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140507ms 2018-05-24 15:31:47,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72000ms 2018-05-24 15:31:47,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97487ms 2018-05-24 15:31:47,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97241ms 2018-05-24 15:31:47,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45760ms 2018-05-24 15:31:47,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220448ms 2018-05-24 15:31:47,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209902ms 2018-05-24 15:31:47,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187936ms 2018-05-24 15:31:47,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96969ms 2018-05-24 15:31:47,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64547ms 2018-05-24 15:31:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234249ms 2018-05-24 15:31:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214905ms 2018-05-24 15:31:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46867ms 2018-05-24 15:31:47,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243389ms 2018-05-24 15:31:47,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74823ms 2018-05-24 15:31:47,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 704ms 2018-05-24 15:31:47,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184001ms 2018-05-24 15:31:47,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5074ms 2018-05-24 15:31:47,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93098ms 2018-05-24 15:31:47,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181164ms 2018-05-24 15:31:47,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158892ms 2018-05-24 15:31:47,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256159ms 2018-05-24 15:31:47,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103505ms 2018-05-24 15:31:47,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 124018ms 2018-05-24 15:31:47,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229111ms 2018-05-24 15:31:48,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41988ms 2018-05-24 15:31:48,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 791ms 2018-05-24 15:31:48,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154742ms 2018-05-24 15:31:48,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151168ms 2018-05-24 15:31:48,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31885ms 2018-05-24 15:31:48,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161400ms 2018-05-24 15:31:48,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65966ms 2018-05-24 15:31:48,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160339ms 2018-05-24 15:31:48,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148860ms 2018-05-24 15:31:48,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150004ms 2018-05-24 15:31:48,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267637ms 2018-05-24 15:31:48,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110969ms 2018-05-24 15:31:48,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 126229ms 2018-05-24 15:31:48,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279948ms 2018-05-24 15:31:48,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207368ms 2018-05-24 15:31:48,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218797ms 2018-05-24 15:31:48,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116998ms 2018-05-24 15:31:48,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242666ms 2018-05-24 15:31:48,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13696ms 2018-05-24 15:31:48,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236399ms 2018-05-24 15:31:48,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65808ms 2018-05-24 15:31:48,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73309ms 2018-05-24 15:31:48,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246253ms 2018-05-24 15:31:48,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238802ms 2018-05-24 15:31:48,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251094ms 2018-05-24 15:31:48,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248705ms 2018-05-24 15:31:48,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162924ms 2018-05-24 15:31:48,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288304ms 2018-05-24 15:31:48,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150177ms 2018-05-24 15:31:48,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259229ms 2018-05-24 15:31:49,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158725ms 2018-05-24 15:31:49,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5661ms 2018-05-24 15:31:49,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120781ms 2018-05-24 15:31:49,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123142ms 2018-05-24 15:31:49,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62307ms 2018-05-24 15:31:49,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289144ms 2018-05-24 15:31:49,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 139316ms 2018-05-24 15:31:49,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63105ms 2018-05-24 15:31:49,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54928ms 2018-05-24 15:31:49,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231934ms 2018-05-24 15:31:49,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274965ms 2018-05-24 15:31:49,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105286ms 2018-05-24 15:31:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:49,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202125ms 2018-05-24 15:31:49,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237657ms 2018-05-24 15:31:49,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41441ms 2018-05-24 15:31:49,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74336ms 2018-05-24 15:31:49,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241195ms 2018-05-24 15:31:49,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157686ms 2018-05-24 15:31:49,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284418ms 2018-05-24 15:31:49,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106480ms 2018-05-24 15:31:49,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286281ms 2018-05-24 15:31:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:49,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49652ms 2018-05-24 15:31:49,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182535ms 2018-05-24 15:31:49,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84722ms 2018-05-24 15:31:49,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234602ms 2018-05-24 15:31:49,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74008ms 2018-05-24 15:31:49,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149392ms 2018-05-24 15:31:49,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246455ms 2018-05-24 15:31:49,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164594ms 2018-05-24 15:31:49,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37662ms 2018-05-24 15:31:50,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43187ms 2018-05-24 15:31:50,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261201ms 2018-05-24 15:31:50,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146237ms 2018-05-24 15:31:50,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298697ms 2018-05-24 15:31:50,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23881ms 2018-05-24 15:31:50,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204077ms 2018-05-24 15:31:50,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260892ms 2018-05-24 15:31:50,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6460ms 2018-05-24 15:31:50,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201945ms 2018-05-24 15:31:50,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278267ms 2018-05-24 15:31:50,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193389ms 2018-05-24 15:31:50,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102945ms 2018-05-24 15:31:50,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79070ms 2018-05-24 15:31:50,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206761ms 2018-05-24 15:31:50,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290965ms 2018-05-24 15:31:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140166ms 2018-05-24 15:31:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164087ms 2018-05-24 15:31:50,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293581ms 2018-05-24 15:31:50,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106749ms 2018-05-24 15:31:50,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 47816ms 2018-05-24 15:31:50,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295243ms 2018-05-24 15:31:50,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35489ms 2018-05-24 15:31:50,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23974ms 2018-05-24 15:31:50,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16679ms 2018-05-24 15:31:50,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152105ms 2018-05-24 15:31:50,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68374ms 2018-05-24 15:31:50,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163979ms 2018-05-24 15:31:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171321ms 2018-05-24 15:31:50,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284117ms 2018-05-24 15:31:50,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120304ms 2018-05-24 15:31:51,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287858ms 2018-05-24 15:31:51,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281466ms 2018-05-24 15:31:51,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245162ms 2018-05-24 15:31:51,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241904ms 2018-05-24 15:31:51,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146574ms 2018-05-24 15:31:51,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188577ms 2018-05-24 15:31:51,136 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249548ms 2018-05-24 15:31:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20913ms 2018-05-24 15:31:51,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190740ms 2018-05-24 15:31:51,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85486ms 2018-05-24 15:31:51,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233967ms 2018-05-24 15:31:51,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227657ms 2018-05-24 15:31:51,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112375ms 2018-05-24 15:31:51,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59744ms 2018-05-24 15:31:51,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190571ms 2018-05-24 15:31:51,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133185ms 2018-05-24 15:31:51,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15618ms 2018-05-24 15:31:51,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103491ms 2018-05-24 15:31:51,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280492ms 2018-05-24 15:31:51,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296600ms 2018-05-24 15:31:51,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5138ms 2018-05-24 15:31:51,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87142ms 2018-05-24 15:31:51,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56341ms 2018-05-24 15:31:51,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129088ms 2018-05-24 15:31:51,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188718ms 2018-05-24 15:31:51,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229386ms 2018-05-24 15:31:51,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86961ms 2018-05-24 15:31:51,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270054ms 2018-05-24 15:31:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21091ms 2018-05-24 15:31:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265719ms 2018-05-24 15:31:52,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148792ms 2018-05-24 15:31:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134480ms 2018-05-24 15:31:52,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241728ms 2018-05-24 15:31:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55657ms 2018-05-24 15:31:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46458ms 2018-05-24 15:31:52,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89343ms 2018-05-24 15:31:52,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 99051ms 2018-05-24 15:31:52,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170055ms 2018-05-24 15:31:52,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159595ms 2018-05-24 15:31:52,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 180532ms 2018-05-24 15:31:52,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299775ms 2018-05-24 15:31:52,316 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14964ms 2018-05-24 15:31:52,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202059ms 2018-05-24 15:31:52,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130159ms 2018-05-24 15:31:52,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77123ms 2018-05-24 15:31:52,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213918ms 2018-05-24 15:31:52,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161072ms 2018-05-24 15:31:52,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224754ms 2018-05-24 15:31:52,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276935ms 2018-05-24 15:31:52,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12116ms 2018-05-24 15:31:52,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233075ms 2018-05-24 15:31:52,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98340ms 2018-05-24 15:31:52,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254045ms 2018-05-24 15:31:52,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128469ms 2018-05-24 15:31:52,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118996ms 2018-05-24 15:31:52,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263089ms 2018-05-24 15:31:52,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276498ms 2018-05-24 15:31:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188580ms 2018-05-24 15:31:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82347ms 2018-05-24 15:31:52,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244655ms 2018-05-24 15:31:53,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100488ms 2018-05-24 15:31:53,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133623ms 2018-05-24 15:31:53,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55596ms 2018-05-24 15:31:53,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192539ms 2018-05-24 15:31:53,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134897ms 2018-05-24 15:31:53,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49646ms 2018-05-24 15:31:53,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14166ms 2018-05-24 15:31:53,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11010ms 2018-05-24 15:31:53,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92650ms 2018-05-24 15:31:53,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28160ms 2018-05-24 15:31:53,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34616ms 2018-05-24 15:31:53,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146812ms 2018-05-24 15:31:53,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10770ms 2018-05-24 15:31:53,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234321ms 2018-05-24 15:31:53,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161536ms 2018-05-24 15:31:53,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257778ms 2018-05-24 15:31:53,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267237ms 2018-05-24 15:31:53,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62145ms 2018-05-24 15:31:53,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 242434ms 2018-05-24 15:31:53,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161504ms 2018-05-24 15:31:53,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110713ms 2018-05-24 15:31:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277182ms 2018-05-24 15:31:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53377ms 2018-05-24 15:31:53,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153782ms 2018-05-24 15:31:53,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154708ms 2018-05-24 15:31:53,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232185ms 2018-05-24 15:31:53,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67965ms 2018-05-24 15:31:53,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246040ms 2018-05-24 15:31:53,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232840ms 2018-05-24 15:31:53,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81014ms 2018-05-24 15:31:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269721ms 2018-05-24 15:31:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260773ms 2018-05-24 15:31:54,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271852ms 2018-05-24 15:31:54,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225341ms 2018-05-24 15:31:54,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281479ms 2018-05-24 15:31:54,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85973ms 2018-05-24 15:31:54,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173529ms 2018-05-24 15:31:54,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140979ms 2018-05-24 15:31:54,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205965ms 2018-05-24 15:31:54,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289724ms 2018-05-24 15:31:54,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157822ms 2018-05-24 15:31:54,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15824ms 2018-05-24 15:31:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:54,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288617ms 2018-05-24 15:31:54,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161291ms 2018-05-24 15:31:54,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242304ms 2018-05-24 15:31:54,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284586ms 2018-05-24 15:31:54,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24196ms 2018-05-24 15:31:54,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65141ms 2018-05-24 15:31:54,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106513ms 2018-05-24 15:31:54,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112203ms 2018-05-24 15:31:54,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174451ms 2018-05-24 15:31:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:54,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33935ms 2018-05-24 15:31:54,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63243ms 2018-05-24 15:31:54,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91236ms 2018-05-24 15:31:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87690ms 2018-05-24 15:31:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184593ms 2018-05-24 15:31:54,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18538ms 2018-05-24 15:31:54,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214934ms 2018-05-24 15:31:54,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206243ms 2018-05-24 15:31:54,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70521ms 2018-05-24 15:31:55,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172867ms 2018-05-24 15:31:55,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254086ms 2018-05-24 15:31:55,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73998ms 2018-05-24 15:31:55,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29359ms 2018-05-24 15:31:55,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264101ms 2018-05-24 15:31:55,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103756ms 2018-05-24 15:31:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 69020ms 2018-05-24 15:31:55,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93739ms 2018-05-24 15:31:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156898ms 2018-05-24 15:31:55,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212747ms 2018-05-24 15:31:55,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257572ms 2018-05-24 15:31:55,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183857ms 2018-05-24 15:31:55,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186970ms 2018-05-24 15:31:55,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298363ms 2018-05-24 15:31:55,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103089ms 2018-05-24 15:31:55,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178791ms 2018-05-24 15:31:55,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5213ms 2018-05-24 15:31:55,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87586ms 2018-05-24 15:31:55,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165064ms 2018-05-24 15:31:55,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137213ms 2018-05-24 15:31:55,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196827ms 2018-05-24 15:31:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182369ms 2018-05-24 15:31:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78073ms 2018-05-24 15:31:55,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282275ms 2018-05-24 15:31:55,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274354ms 2018-05-24 15:31:55,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295786ms 2018-05-24 15:31:55,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208065ms 2018-05-24 15:31:55,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208506ms 2018-05-24 15:31:55,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95218ms 2018-05-24 15:31:55,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229135ms 2018-05-24 15:31:56,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46554ms 2018-05-24 15:31:56,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35832ms 2018-05-24 15:31:56,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82360ms 2018-05-24 15:31:56,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6070ms 2018-05-24 15:31:56,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49312ms 2018-05-24 15:31:56,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234542ms 2018-05-24 15:31:56,138 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:31:56,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79173ms 2018-05-24 15:31:56,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272586ms 2018-05-24 15:31:56,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60352ms 2018-05-24 15:31:56,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31111ms 2018-05-24 15:31:56,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52347ms 2018-05-24 15:31:56,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250987ms 2018-05-24 15:31:56,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183039ms 2018-05-24 15:31:56,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121318ms 2018-05-24 15:31:56,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212852ms 2018-05-24 15:31:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197828ms 2018-05-24 15:31:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253188ms 2018-05-24 15:31:56,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276146ms 2018-05-24 15:31:56,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252830ms 2018-05-24 15:31:56,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195427ms 2018-05-24 15:31:56,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284573ms 2018-05-24 15:31:56,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244206ms 2018-05-24 15:31:56,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219927ms 2018-05-24 15:31:56,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214119ms 2018-05-24 15:31:56,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207303ms 2018-05-24 15:31:56,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9729ms 2018-05-24 15:31:56,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253153ms 2018-05-24 15:31:56,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25493ms 2018-05-24 15:31:56,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28507ms 2018-05-24 15:31:56,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213236ms 2018-05-24 15:31:57,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191265ms 2018-05-24 15:31:57,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254794ms 2018-05-24 15:31:57,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49494ms 2018-05-24 15:31:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261881ms 2018-05-24 15:31:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190682ms 2018-05-24 15:31:57,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37517ms 2018-05-24 15:31:57,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182849ms 2018-05-24 15:31:57,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215465ms 2018-05-24 15:31:57,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124513ms 2018-05-24 15:31:57,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143577ms 2018-05-24 15:31:57,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224197ms 2018-05-24 15:31:57,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248870ms 2018-05-24 15:31:57,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17725ms 2018-05-24 15:31:57,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36529ms 2018-05-24 15:31:57,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255190ms 2018-05-24 15:31:57,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 170623ms 2018-05-24 15:31:57,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264702ms 2018-05-24 15:31:57,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273392ms 2018-05-24 15:31:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184182ms 2018-05-24 15:31:57,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294130ms 2018-05-24 15:31:57,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104823ms 2018-05-24 15:31:57,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52191ms 2018-05-24 15:31:57,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192999ms 2018-05-24 15:31:57,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180107ms 2018-05-24 15:31:57,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63416ms 2018-05-24 15:31:57,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227392ms 2018-05-24 15:31:57,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259473ms 2018-05-24 15:31:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282603ms 2018-05-24 15:31:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192076ms 2018-05-24 15:31:57,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1639ms 2018-05-24 15:31:58,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208428ms 2018-05-24 15:31:58,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163940ms 2018-05-24 15:31:58,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41004ms 2018-05-24 15:31:58,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154857ms 2018-05-24 15:31:58,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1099ms 2018-05-24 15:31:58,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94592ms 2018-05-24 15:31:58,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277534ms 2018-05-24 15:31:58,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220076ms 2018-05-24 15:31:58,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275813ms 2018-05-24 15:31:58,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215202ms 2018-05-24 15:31:58,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240654ms 2018-05-24 15:31:58,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264350ms 2018-05-24 15:31:58,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212193ms 2018-05-24 15:31:58,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151588ms 2018-05-24 15:31:58,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200678ms 2018-05-24 15:31:58,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216833ms 2018-05-24 15:31:58,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197021ms 2018-05-24 15:31:58,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256671ms 2018-05-24 15:31:58,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45805ms 2018-05-24 15:31:58,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114179ms 2018-05-24 15:31:58,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200123ms 2018-05-24 15:31:58,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87081ms 2018-05-24 15:31:58,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10362ms 2018-05-24 15:31:58,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194221ms 2018-05-24 15:31:58,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43657ms 2018-05-24 15:31:58,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259353ms 2018-05-24 15:31:58,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292628ms 2018-05-24 15:31:58,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123761ms 2018-05-24 15:31:58,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91371ms 2018-05-24 15:31:58,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6310ms 2018-05-24 15:31:59,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93768ms 2018-05-24 15:31:59,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133062ms 2018-05-24 15:31:59,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128583ms 2018-05-24 15:31:59,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57101ms 2018-05-24 15:31:59,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137189ms 2018-05-24 15:31:59,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93809ms 2018-05-24 15:31:59,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37069ms 2018-05-24 15:31:59,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251569ms 2018-05-24 15:31:59,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49687ms 2018-05-24 15:31:59,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 126489ms 2018-05-24 15:31:59,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210625ms 2018-05-24 15:31:59,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26045ms 2018-05-24 15:31:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:31:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:31:59,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198430ms 2018-05-24 15:31:59,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281404ms 2018-05-24 15:31:59,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8327ms 2018-05-24 15:31:59,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48005ms 2018-05-24 15:31:59,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152714ms 2018-05-24 15:31:59,516 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95168ms 2018-05-24 15:31:59,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281289ms 2018-05-24 15:31:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268075ms 2018-05-24 15:31:59,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176213ms 2018-05-24 15:31:59,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:31:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:31:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:31:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:31:59,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257441ms 2018-05-24 15:31:59,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17255ms 2018-05-24 15:31:59,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171133ms 2018-05-24 15:31:59,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68541ms 2018-05-24 15:31:59,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27017ms 2018-05-24 15:31:59,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276796ms 2018-05-24 15:31:59,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48059ms 2018-05-24 15:31:59,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161087ms 2018-05-24 15:31:59,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215869ms 2018-05-24 15:32:00,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293738ms 2018-05-24 15:32:00,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82582ms 2018-05-24 15:32:00,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101672ms 2018-05-24 15:32:00,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 250006ms 2018-05-24 15:32:00,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52385ms 2018-05-24 15:32:00,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7956ms 2018-05-24 15:32:00,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161217ms 2018-05-24 15:32:00,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201573ms 2018-05-24 15:32:00,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155473ms 2018-05-24 15:32:00,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157393ms 2018-05-24 15:32:00,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266009ms 2018-05-24 15:32:00,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61655ms 2018-05-24 15:32:00,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278889ms 2018-05-24 15:32:00,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274847ms 2018-05-24 15:32:00,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40358ms 2018-05-24 15:32:00,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214713ms 2018-05-24 15:32:00,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111435ms 2018-05-24 15:32:00,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152621ms 2018-05-24 15:32:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138940ms 2018-05-24 15:32:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193233ms 2018-05-24 15:32:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265838ms 2018-05-24 15:32:00,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227430ms 2018-05-24 15:32:00,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222314ms 2018-05-24 15:32:00,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197166ms 2018-05-24 15:32:00,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231535ms 2018-05-24 15:32:00,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245553ms 2018-05-24 15:32:00,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167988ms 2018-05-24 15:32:00,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224378ms 2018-05-24 15:32:00,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181429ms 2018-05-24 15:32:00,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235158ms 2018-05-24 15:32:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130153ms 2018-05-24 15:32:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 179851ms 2018-05-24 15:32:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124448ms 2018-05-24 15:32:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64576ms 2018-05-24 15:32:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241568ms 2018-05-24 15:32:01,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29081ms 2018-05-24 15:32:01,139 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112526ms 2018-05-24 15:32:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231517ms 2018-05-24 15:32:01,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189332ms 2018-05-24 15:32:01,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118891ms 2018-05-24 15:32:01,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177993ms 2018-05-24 15:32:01,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272002ms 2018-05-24 15:32:01,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236249ms 2018-05-24 15:32:01,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236618ms 2018-05-24 15:32:01,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244656ms 2018-05-24 15:32:01,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168235ms 2018-05-24 15:32:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140697ms 2018-05-24 15:32:01,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118423ms 2018-05-24 15:32:01,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239745ms 2018-05-24 15:32:01,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203617ms 2018-05-24 15:32:01,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145648ms 2018-05-24 15:32:01,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157560ms 2018-05-24 15:32:01,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90560ms 2018-05-24 15:32:01,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171381ms 2018-05-24 15:32:01,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56960ms 2018-05-24 15:32:01,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119917ms 2018-05-24 15:32:01,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32646ms 2018-05-24 15:32:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198216ms 2018-05-24 15:32:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271154ms 2018-05-24 15:32:01,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174337ms 2018-05-24 15:32:02,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26600ms 2018-05-24 15:32:02,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205389ms 2018-05-24 15:32:02,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58410ms 2018-05-24 15:32:02,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17340ms 2018-05-24 15:32:02,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30883ms 2018-05-24 15:32:02,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58598ms 2018-05-24 15:32:02,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103301ms 2018-05-24 15:32:02,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34805ms 2018-05-24 15:32:02,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246497ms 2018-05-24 15:32:02,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260907ms 2018-05-24 15:32:02,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 306ms 2018-05-24 15:32:02,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153413ms 2018-05-24 15:32:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132363ms 2018-05-24 15:32:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139529ms 2018-05-24 15:32:02,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66218ms 2018-05-24 15:32:02,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10935ms 2018-05-24 15:32:02,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52108ms 2018-05-24 15:32:02,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208710ms 2018-05-24 15:32:02,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97101ms 2018-05-24 15:32:02,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151259ms 2018-05-24 15:32:02,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86717ms 2018-05-24 15:32:02,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254915ms 2018-05-24 15:32:02,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158747ms 2018-05-24 15:32:02,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4346ms 2018-05-24 15:32:02,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96050ms 2018-05-24 15:32:02,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122555ms 2018-05-24 15:32:02,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8331ms 2018-05-24 15:32:02,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291ms 2018-05-24 15:32:02,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197536ms 2018-05-24 15:32:02,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16904ms 2018-05-24 15:32:03,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132267ms 2018-05-24 15:32:03,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291620ms 2018-05-24 15:32:03,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199017ms 2018-05-24 15:32:03,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286789ms 2018-05-24 15:32:03,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271604ms 2018-05-24 15:32:03,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267189ms 2018-05-24 15:32:03,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247334ms 2018-05-24 15:32:03,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70893ms 2018-05-24 15:32:03,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131563ms 2018-05-24 15:32:03,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186829ms 2018-05-24 15:32:03,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159311ms 2018-05-24 15:32:03,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208354ms 2018-05-24 15:32:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42767ms 2018-05-24 15:32:03,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119160ms 2018-05-24 15:32:03,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232394ms 2018-05-24 15:32:03,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83050ms 2018-05-24 15:32:03,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127681ms 2018-05-24 15:32:03,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28897ms 2018-05-24 15:32:03,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119470ms 2018-05-24 15:32:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259924ms 2018-05-24 15:32:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237173ms 2018-05-24 15:32:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253161ms 2018-05-24 15:32:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133523ms 2018-05-24 15:32:03,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62201ms 2018-05-24 15:32:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197008ms 2018-05-24 15:32:03,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91705ms 2018-05-24 15:32:03,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73081ms 2018-05-24 15:32:03,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209661ms 2018-05-24 15:32:03,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21119ms 2018-05-24 15:32:03,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101588ms 2018-05-24 15:32:04,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152465ms 2018-05-24 15:32:04,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 217428ms 2018-05-24 15:32:04,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109012ms 2018-05-24 15:32:04,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 96742ms 2018-05-24 15:32:04,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230539ms 2018-05-24 15:32:04,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147201ms 2018-05-24 15:32:04,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243134ms 2018-05-24 15:32:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87865ms 2018-05-24 15:32:04,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18076ms 2018-05-24 15:32:04,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72122ms 2018-05-24 15:32:04,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73220ms 2018-05-24 15:32:04,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189030ms 2018-05-24 15:32:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:04,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67820ms 2018-05-24 15:32:04,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77959ms 2018-05-24 15:32:04,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267518ms 2018-05-24 15:32:04,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268456ms 2018-05-24 15:32:04,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99657ms 2018-05-24 15:32:04,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211898ms 2018-05-24 15:32:04,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 189105ms 2018-05-24 15:32:04,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56844ms 2018-05-24 15:32:04,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242765ms 2018-05-24 15:32:04,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:04,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260824ms 2018-05-24 15:32:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122020ms 2018-05-24 15:32:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44196ms 2018-05-24 15:32:04,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110936ms 2018-05-24 15:32:04,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 75781ms 2018-05-24 15:32:04,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32515ms 2018-05-24 15:32:04,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97660ms 2018-05-24 15:32:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164584ms 2018-05-24 15:32:04,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92030ms 2018-05-24 15:32:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173744ms 2018-05-24 15:32:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90820ms 2018-05-24 15:32:05,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274317ms 2018-05-24 15:32:05,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144880ms 2018-05-24 15:32:05,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95296ms 2018-05-24 15:32:05,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30635ms 2018-05-24 15:32:05,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39107ms 2018-05-24 15:32:05,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267174ms 2018-05-24 15:32:05,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217241ms 2018-05-24 15:32:05,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 143757ms 2018-05-24 15:32:05,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291708ms 2018-05-24 15:32:05,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137711ms 2018-05-24 15:32:05,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268295ms 2018-05-24 15:32:05,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6307ms 2018-05-24 15:32:05,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55883ms 2018-05-24 15:32:05,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39358ms 2018-05-24 15:32:05,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256280ms 2018-05-24 15:32:05,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255989ms 2018-05-24 15:32:05,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243631ms 2018-05-24 15:32:05,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154283ms 2018-05-24 15:32:05,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123950ms 2018-05-24 15:32:05,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230684ms 2018-05-24 15:32:05,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151195ms 2018-05-24 15:32:05,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125463ms 2018-05-24 15:32:05,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54032ms 2018-05-24 15:32:05,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164306ms 2018-05-24 15:32:05,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287038ms 2018-05-24 15:32:05,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 14828ms 2018-05-24 15:32:05,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96745ms 2018-05-24 15:32:05,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290948ms 2018-05-24 15:32:06,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165748ms 2018-05-24 15:32:06,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17859ms 2018-05-24 15:32:06,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291537ms 2018-05-24 15:32:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257046ms 2018-05-24 15:32:06,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 80552ms 2018-05-24 15:32:06,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224415ms 2018-05-24 15:32:06,140 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:06,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176676ms 2018-05-24 15:32:06,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19576ms 2018-05-24 15:32:06,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277764ms 2018-05-24 15:32:06,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161879ms 2018-05-24 15:32:06,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296954ms 2018-05-24 15:32:06,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26196ms 2018-05-24 15:32:06,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175735ms 2018-05-24 15:32:06,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287665ms 2018-05-24 15:32:06,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13829ms 2018-05-24 15:32:06,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:32:06,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85000ms 2018-05-24 15:32:06,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162081ms 2018-05-24 15:32:06,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204106ms 2018-05-24 15:32:06,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46375ms 2018-05-24 15:32:06,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15342ms 2018-05-24 15:32:06,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173758ms 2018-05-24 15:32:06,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206546ms 2018-05-24 15:32:06,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245229ms 2018-05-24 15:32:06,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188150ms 2018-05-24 15:32:06,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143437ms 2018-05-24 15:32:06,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157076ms 2018-05-24 15:32:06,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8683ms 2018-05-24 15:32:06,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4501ms 2018-05-24 15:32:06,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216923ms 2018-05-24 15:32:06,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277395ms 2018-05-24 15:32:07,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244917ms 2018-05-24 15:32:07,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91223ms 2018-05-24 15:32:07,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125681ms 2018-05-24 15:32:07,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203247ms 2018-05-24 15:32:07,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15960ms 2018-05-24 15:32:07,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60399ms 2018-05-24 15:32:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94903ms 2018-05-24 15:32:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236103ms 2018-05-24 15:32:07,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41459ms 2018-05-24 15:32:07,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177520ms 2018-05-24 15:32:07,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180771ms 2018-05-24 15:32:07,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146713ms 2018-05-24 15:32:07,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46037ms 2018-05-24 15:32:07,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54260ms 2018-05-24 15:32:07,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64322ms 2018-05-24 15:32:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206021ms 2018-05-24 15:32:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20468ms 2018-05-24 15:32:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184537ms 2018-05-24 15:32:07,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174498ms 2018-05-24 15:32:07,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 295664ms 2018-05-24 15:32:07,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37671ms 2018-05-24 15:32:07,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65452ms 2018-05-24 15:32:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26874ms 2018-05-24 15:32:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67171ms 2018-05-24 15:32:07,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 99361ms 2018-05-24 15:32:07,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194909ms 2018-05-24 15:32:07,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55446ms 2018-05-24 15:32:07,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229587ms 2018-05-24 15:32:07,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90699ms 2018-05-24 15:32:07,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158770ms 2018-05-24 15:32:08,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38338ms 2018-05-24 15:32:08,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100988ms 2018-05-24 15:32:08,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 316ms 2018-05-24 15:32:08,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38423ms 2018-05-24 15:32:08,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261287ms 2018-05-24 15:32:08,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16370ms 2018-05-24 15:32:08,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35191ms 2018-05-24 15:32:08,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19027ms 2018-05-24 15:32:08,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161453ms 2018-05-24 15:32:08,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4715ms 2018-05-24 15:32:08,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24151ms 2018-05-24 15:32:08,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100001ms 2018-05-24 15:32:08,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183220ms 2018-05-24 15:32:08,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166383ms 2018-05-24 15:32:08,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39582ms 2018-05-24 15:32:08,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193679ms 2018-05-24 15:32:08,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124402ms 2018-05-24 15:32:08,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41517ms 2018-05-24 15:32:08,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9224ms 2018-05-24 15:32:08,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58363ms 2018-05-24 15:32:08,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80065ms 2018-05-24 15:32:08,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252915ms 2018-05-24 15:32:08,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76938ms 2018-05-24 15:32:08,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246199ms 2018-05-24 15:32:08,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95734ms 2018-05-24 15:32:08,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25795ms 2018-05-24 15:32:08,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290079ms 2018-05-24 15:32:08,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288117ms 2018-05-24 15:32:08,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158219ms 2018-05-24 15:32:08,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172698ms 2018-05-24 15:32:09,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46946ms 2018-05-24 15:32:09,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3917ms 2018-05-24 15:32:09,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129320ms 2018-05-24 15:32:09,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240685ms 2018-05-24 15:32:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95249ms 2018-05-24 15:32:09,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220715ms 2018-05-24 15:32:09,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117676ms 2018-05-24 15:32:09,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119247ms 2018-05-24 15:32:09,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121699ms 2018-05-24 15:32:09,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75782ms 2018-05-24 15:32:09,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121885ms 2018-05-24 15:32:09,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48175ms 2018-05-24 15:32:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:09,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188611ms 2018-05-24 15:32:09,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56689ms 2018-05-24 15:32:09,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223274ms 2018-05-24 15:32:09,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185918ms 2018-05-24 15:32:09,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232201ms 2018-05-24 15:32:09,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270186ms 2018-05-24 15:32:09,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187642ms 2018-05-24 15:32:09,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35087ms 2018-05-24 15:32:09,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51891ms 2018-05-24 15:32:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:09,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 107728ms 2018-05-24 15:32:09,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284499ms 2018-05-24 15:32:09,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231063ms 2018-05-24 15:32:09,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38917ms 2018-05-24 15:32:09,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151218ms 2018-05-24 15:32:09,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244936ms 2018-05-24 15:32:09,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220916ms 2018-05-24 15:32:09,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90554ms 2018-05-24 15:32:09,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297475ms 2018-05-24 15:32:10,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 107200ms 2018-05-24 15:32:10,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182250ms 2018-05-24 15:32:10,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136389ms 2018-05-24 15:32:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279977ms 2018-05-24 15:32:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242591ms 2018-05-24 15:32:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248744ms 2018-05-24 15:32:10,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 22793ms 2018-05-24 15:32:10,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291476ms 2018-05-24 15:32:10,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169619ms 2018-05-24 15:32:10,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183914ms 2018-05-24 15:32:10,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116721ms 2018-05-24 15:32:10,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284588ms 2018-05-24 15:32:10,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226653ms 2018-05-24 15:32:10,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140951ms 2018-05-24 15:32:10,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120012ms 2018-05-24 15:32:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288355ms 2018-05-24 15:32:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299674ms 2018-05-24 15:32:10,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45162ms 2018-05-24 15:32:10,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203241ms 2018-05-24 15:32:10,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288937ms 2018-05-24 15:32:10,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219022ms 2018-05-24 15:32:10,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83278ms 2018-05-24 15:32:10,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17068ms 2018-05-24 15:32:10,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103007ms 2018-05-24 15:32:10,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219500ms 2018-05-24 15:32:10,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168770ms 2018-05-24 15:32:10,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174410ms 2018-05-24 15:32:10,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56835ms 2018-05-24 15:32:10,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39555ms 2018-05-24 15:32:10,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13948ms 2018-05-24 15:32:11,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205702ms 2018-05-24 15:32:11,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200074ms 2018-05-24 15:32:11,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268808ms 2018-05-24 15:32:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290794ms 2018-05-24 15:32:11,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24072ms 2018-05-24 15:32:11,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16811ms 2018-05-24 15:32:11,141 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 287484ms 2018-05-24 15:32:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139059ms 2018-05-24 15:32:11,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52471ms 2018-05-24 15:32:11,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228504ms 2018-05-24 15:32:11,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258939ms 2018-05-24 15:32:11,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147868ms 2018-05-24 15:32:11,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283347ms 2018-05-24 15:32:11,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263976ms 2018-05-24 15:32:11,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136353ms 2018-05-24 15:32:11,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 250567ms 2018-05-24 15:32:11,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232881ms 2018-05-24 15:32:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206000ms 2018-05-24 15:32:11,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144568ms 2018-05-24 15:32:11,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191542ms 2018-05-24 15:32:11,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296948ms 2018-05-24 15:32:11,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218192ms 2018-05-24 15:32:11,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258562ms 2018-05-24 15:32:11,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110253ms 2018-05-24 15:32:11,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276164ms 2018-05-24 15:32:11,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179753ms 2018-05-24 15:32:11,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55135ms 2018-05-24 15:32:11,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16181ms 2018-05-24 15:32:11,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132782ms 2018-05-24 15:32:11,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281228ms 2018-05-24 15:32:12,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202204ms 2018-05-24 15:32:12,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276477ms 2018-05-24 15:32:12,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39064ms 2018-05-24 15:32:12,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103694ms 2018-05-24 15:32:12,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267800ms 2018-05-24 15:32:12,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296123ms 2018-05-24 15:32:12,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281215ms 2018-05-24 15:32:12,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114104ms 2018-05-24 15:32:12,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37684ms 2018-05-24 15:32:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2161ms 2018-05-24 15:32:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73071ms 2018-05-24 15:32:12,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169690ms 2018-05-24 15:32:12,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138359ms 2018-05-24 15:32:12,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142026ms 2018-05-24 15:32:12,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43006ms 2018-05-24 15:32:12,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84767ms 2018-05-24 15:32:12,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58243ms 2018-05-24 15:32:12,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229979ms 2018-05-24 15:32:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118757ms 2018-05-24 15:32:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153495ms 2018-05-24 15:32:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96284ms 2018-05-24 15:32:12,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159974ms 2018-05-24 15:32:12,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6940ms 2018-05-24 15:32:12,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150146ms 2018-05-24 15:32:12,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19530ms 2018-05-24 15:32:12,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139250ms 2018-05-24 15:32:12,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249617ms 2018-05-24 15:32:12,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84052ms 2018-05-24 15:32:12,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234081ms 2018-05-24 15:32:12,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114743ms 2018-05-24 15:32:13,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285925ms 2018-05-24 15:32:13,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74917ms 2018-05-24 15:32:13,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270674ms 2018-05-24 15:32:13,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261501ms 2018-05-24 15:32:13,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89731ms 2018-05-24 15:32:13,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12947ms 2018-05-24 15:32:13,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275268ms 2018-05-24 15:32:13,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278948ms 2018-05-24 15:32:13,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178526ms 2018-05-24 15:32:13,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12817ms 2018-05-24 15:32:13,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137434ms 2018-05-24 15:32:13,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70469ms 2018-05-24 15:32:13,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 199398ms 2018-05-24 15:32:13,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36190ms 2018-05-24 15:32:13,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147419ms 2018-05-24 15:32:13,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278168ms 2018-05-24 15:32:13,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49734ms 2018-05-24 15:32:13,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239381ms 2018-05-24 15:32:13,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283264ms 2018-05-24 15:32:13,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252655ms 2018-05-24 15:32:13,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68157ms 2018-05-24 15:32:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205484ms 2018-05-24 15:32:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245164ms 2018-05-24 15:32:13,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296447ms 2018-05-24 15:32:13,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39286ms 2018-05-24 15:32:13,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254949ms 2018-05-24 15:32:13,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163578ms 2018-05-24 15:32:13,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160031ms 2018-05-24 15:32:13,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229447ms 2018-05-24 15:32:13,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190723ms 2018-05-24 15:32:14,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9157ms 2018-05-24 15:32:14,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39786ms 2018-05-24 15:32:14,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162819ms 2018-05-24 15:32:14,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287385ms 2018-05-24 15:32:14,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280531ms 2018-05-24 15:32:14,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171518ms 2018-05-24 15:32:14,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157628ms 2018-05-24 15:32:14,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123870ms 2018-05-24 15:32:14,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235711ms 2018-05-24 15:32:14,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84198ms 2018-05-24 15:32:14,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214552ms 2018-05-24 15:32:14,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189245ms 2018-05-24 15:32:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:14,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:14,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248034ms 2018-05-24 15:32:14,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3285ms 2018-05-24 15:32:14,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124399ms 2018-05-24 15:32:14,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283017ms 2018-05-24 15:32:14,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182365ms 2018-05-24 15:32:14,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25161ms 2018-05-24 15:32:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25823ms 2018-05-24 15:32:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70245ms 2018-05-24 15:32:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114478ms 2018-05-24 15:32:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:14,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189583ms 2018-05-24 15:32:14,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94059ms 2018-05-24 15:32:14,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186082ms 2018-05-24 15:32:14,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263915ms 2018-05-24 15:32:14,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230629ms 2018-05-24 15:32:14,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168950ms 2018-05-24 15:32:14,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162811ms 2018-05-24 15:32:14,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197767ms 2018-05-24 15:32:14,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93914ms 2018-05-24 15:32:15,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 107416ms 2018-05-24 15:32:15,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151776ms 2018-05-24 15:32:15,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58234ms 2018-05-24 15:32:15,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9362ms 2018-05-24 15:32:15,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232732ms 2018-05-24 15:32:15,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55237ms 2018-05-24 15:32:15,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 237947ms 2018-05-24 15:32:15,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145190ms 2018-05-24 15:32:15,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244246ms 2018-05-24 15:32:15,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252306ms 2018-05-24 15:32:15,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103934ms 2018-05-24 15:32:15,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104040ms 2018-05-24 15:32:15,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175619ms 2018-05-24 15:32:15,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7806ms 2018-05-24 15:32:15,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61984ms 2018-05-24 15:32:15,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122020ms 2018-05-24 15:32:15,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47806ms 2018-05-24 15:32:15,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189950ms 2018-05-24 15:32:15,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16655ms 2018-05-24 15:32:15,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 204097ms 2018-05-24 15:32:15,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137148ms 2018-05-24 15:32:15,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296173ms 2018-05-24 15:32:15,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104093ms 2018-05-24 15:32:15,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24679ms 2018-05-24 15:32:15,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105414ms 2018-05-24 15:32:15,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276997ms 2018-05-24 15:32:15,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28327ms 2018-05-24 15:32:15,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257563ms 2018-05-24 15:32:15,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125777ms 2018-05-24 15:32:15,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92137ms 2018-05-24 15:32:16,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30275ms 2018-05-24 15:32:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22086ms 2018-05-24 15:32:16,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165083ms 2018-05-24 15:32:16,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187294ms 2018-05-24 15:32:16,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100166ms 2018-05-24 15:32:16,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253972ms 2018-05-24 15:32:16,142 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:16,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199011ms 2018-05-24 15:32:16,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21561ms 2018-05-24 15:32:16,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158640ms 2018-05-24 15:32:16,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45381ms 2018-05-24 15:32:16,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272499ms 2018-05-24 15:32:16,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106263ms 2018-05-24 15:32:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66293ms 2018-05-24 15:32:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26412ms 2018-05-24 15:32:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277970ms 2018-05-24 15:32:16,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176314ms 2018-05-24 15:32:16,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206472ms 2018-05-24 15:32:16,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45045ms 2018-05-24 15:32:16,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272168ms 2018-05-24 15:32:16,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127041ms 2018-05-24 15:32:16,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272422ms 2018-05-24 15:32:16,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100774ms 2018-05-24 15:32:16,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82707ms 2018-05-24 15:32:16,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176696ms 2018-05-24 15:32:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282940ms 2018-05-24 15:32:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146715ms 2018-05-24 15:32:16,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176255ms 2018-05-24 15:32:16,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168694ms 2018-05-24 15:32:16,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36981ms 2018-05-24 15:32:16,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235686ms 2018-05-24 15:32:17,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222905ms 2018-05-24 15:32:17,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101970ms 2018-05-24 15:32:17,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100836ms 2018-05-24 15:32:17,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127847ms 2018-05-24 15:32:17,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283905ms 2018-05-24 15:32:17,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214257ms 2018-05-24 15:32:17,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109323ms 2018-05-24 15:32:17,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272659ms 2018-05-24 15:32:17,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27054ms 2018-05-24 15:32:17,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147898ms 2018-05-24 15:32:17,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31654ms 2018-05-24 15:32:17,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182007ms 2018-05-24 15:32:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288382ms 2018-05-24 15:32:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191366ms 2018-05-24 15:32:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257303ms 2018-05-24 15:32:17,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85270ms 2018-05-24 15:32:17,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182003ms 2018-05-24 15:32:17,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172312ms 2018-05-24 15:32:17,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230863ms 2018-05-24 15:32:17,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 143854ms 2018-05-24 15:32:17,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255265ms 2018-05-24 15:32:17,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 160439ms 2018-05-24 15:32:17,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291605ms 2018-05-24 15:32:17,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168153ms 2018-05-24 15:32:17,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70998ms 2018-05-24 15:32:17,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209969ms 2018-05-24 15:32:17,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224022ms 2018-05-24 15:32:17,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200303ms 2018-05-24 15:32:17,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 248492ms 2018-05-24 15:32:17,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138427ms 2018-05-24 15:32:18,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138601ms 2018-05-24 15:32:18,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26633ms 2018-05-24 15:32:18,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32962ms 2018-05-24 15:32:18,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175995ms 2018-05-24 15:32:18,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217021ms 2018-05-24 15:32:18,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267552ms 2018-05-24 15:32:18,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 135488ms 2018-05-24 15:32:18,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230234ms 2018-05-24 15:32:18,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191682ms 2018-05-24 15:32:18,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166356ms 2018-05-24 15:32:18,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162735ms 2018-05-24 15:32:18,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180332ms 2018-05-24 15:32:18,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138897ms 2018-05-24 15:32:18,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149321ms 2018-05-24 15:32:18,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128692ms 2018-05-24 15:32:18,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214733ms 2018-05-24 15:32:18,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278841ms 2018-05-24 15:32:18,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74475ms 2018-05-24 15:32:18,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254474ms 2018-05-24 15:32:18,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142605ms 2018-05-24 15:32:18,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167175ms 2018-05-24 15:32:18,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295058ms 2018-05-24 15:32:18,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229915ms 2018-05-24 15:32:18,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1986ms 2018-05-24 15:32:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258033ms 2018-05-24 15:32:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91456ms 2018-05-24 15:32:18,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243323ms 2018-05-24 15:32:18,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103229ms 2018-05-24 15:32:18,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104703ms 2018-05-24 15:32:18,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209096ms 2018-05-24 15:32:19,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279361ms 2018-05-24 15:32:19,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150231ms 2018-05-24 15:32:19,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10294ms 2018-05-24 15:32:19,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102313ms 2018-05-24 15:32:19,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204802ms 2018-05-24 15:32:19,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147209ms 2018-05-24 15:32:19,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167138ms 2018-05-24 15:32:19,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91959ms 2018-05-24 15:32:19,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191884ms 2018-05-24 15:32:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 231226ms 2018-05-24 15:32:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159520ms 2018-05-24 15:32:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72059ms 2018-05-24 15:32:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:19,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172444ms 2018-05-24 15:32:19,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16083ms 2018-05-24 15:32:19,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9861ms 2018-05-24 15:32:19,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119537ms 2018-05-24 15:32:19,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290908ms 2018-05-24 15:32:19,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16559ms 2018-05-24 15:32:19,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196463ms 2018-05-24 15:32:19,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283503ms 2018-05-24 15:32:19,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65501ms 2018-05-24 15:32:19,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:19,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123622ms 2018-05-24 15:32:19,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205486ms 2018-05-24 15:32:19,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106533ms 2018-05-24 15:32:19,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165708ms 2018-05-24 15:32:19,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79016ms 2018-05-24 15:32:19,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2830ms 2018-05-24 15:32:19,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 28767ms 2018-05-24 15:32:19,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253108ms 2018-05-24 15:32:19,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157567ms 2018-05-24 15:32:20,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108171ms 2018-05-24 15:32:20,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137512ms 2018-05-24 15:32:20,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157137ms 2018-05-24 15:32:20,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177870ms 2018-05-24 15:32:20,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265585ms 2018-05-24 15:32:20,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59177ms 2018-05-24 15:32:20,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262604ms 2018-05-24 15:32:20,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70494ms 2018-05-24 15:32:20,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155336ms 2018-05-24 15:32:20,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59791ms 2018-05-24 15:32:20,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263192ms 2018-05-24 15:32:20,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43031ms 2018-05-24 15:32:20,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225368ms 2018-05-24 15:32:20,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292491ms 2018-05-24 15:32:20,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271687ms 2018-05-24 15:32:20,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84274ms 2018-05-24 15:32:20,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57591ms 2018-05-24 15:32:20,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181714ms 2018-05-24 15:32:20,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36425ms 2018-05-24 15:32:20,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183757ms 2018-05-24 15:32:20,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236428ms 2018-05-24 15:32:20,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93029ms 2018-05-24 15:32:20,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65155ms 2018-05-24 15:32:20,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280056ms 2018-05-24 15:32:20,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53023ms 2018-05-24 15:32:20,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172107ms 2018-05-24 15:32:20,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112584ms 2018-05-24 15:32:20,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284397ms 2018-05-24 15:32:20,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12378ms 2018-05-24 15:32:20,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275231ms 2018-05-24 15:32:21,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257559ms 2018-05-24 15:32:21,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226269ms 2018-05-24 15:32:21,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257775ms 2018-05-24 15:32:21,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220244ms 2018-05-24 15:32:21,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75984ms 2018-05-24 15:32:21,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125252ms 2018-05-24 15:32:21,143 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:21,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137838ms 2018-05-24 15:32:21,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299758ms 2018-05-24 15:32:21,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194580ms 2018-05-24 15:32:21,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268574ms 2018-05-24 15:32:21,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229665ms 2018-05-24 15:32:21,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119948ms 2018-05-24 15:32:21,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109944ms 2018-05-24 15:32:21,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146356ms 2018-05-24 15:32:21,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67680ms 2018-05-24 15:32:21,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259304ms 2018-05-24 15:32:21,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138821ms 2018-05-24 15:32:21,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288366ms 2018-05-24 15:32:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1242ms 2018-05-24 15:32:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 978ms 2018-05-24 15:32:21,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57360ms 2018-05-24 15:32:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213069ms 2018-05-24 15:32:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130917ms 2018-05-24 15:32:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228817ms 2018-05-24 15:32:21,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214993ms 2018-05-24 15:32:21,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249072ms 2018-05-24 15:32:21,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86982ms 2018-05-24 15:32:21,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182152ms 2018-05-24 15:32:21,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69986ms 2018-05-24 15:32:21,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28531ms 2018-05-24 15:32:22,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235097ms 2018-05-24 15:32:22,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62131ms 2018-05-24 15:32:22,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98038ms 2018-05-24 15:32:22,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7609ms 2018-05-24 15:32:22,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41566ms 2018-05-24 15:32:22,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148528ms 2018-05-24 15:32:22,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64595ms 2018-05-24 15:32:22,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 606ms 2018-05-24 15:32:22,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7936ms 2018-05-24 15:32:22,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190587ms 2018-05-24 15:32:22,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158637ms 2018-05-24 15:32:22,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227759ms 2018-05-24 15:32:22,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265059ms 2018-05-24 15:32:22,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185938ms 2018-05-24 15:32:22,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262657ms 2018-05-24 15:32:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276693ms 2018-05-24 15:32:22,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9225ms 2018-05-24 15:32:22,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159063ms 2018-05-24 15:32:22,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106666ms 2018-05-24 15:32:22,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246412ms 2018-05-24 15:32:22,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88129ms 2018-05-24 15:32:22,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 228180ms 2018-05-24 15:32:22,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264356ms 2018-05-24 15:32:22,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1777ms 2018-05-24 15:32:22,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227470ms 2018-05-24 15:32:22,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198363ms 2018-05-24 15:32:22,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73592ms 2018-05-24 15:32:22,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233338ms 2018-05-24 15:32:22,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159407ms 2018-05-24 15:32:22,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197312ms 2018-05-24 15:32:23,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 239758ms 2018-05-24 15:32:23,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4320ms 2018-05-24 15:32:23,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188815ms 2018-05-24 15:32:23,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273969ms 2018-05-24 15:32:23,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4504ms 2018-05-24 15:32:23,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143718ms 2018-05-24 15:32:23,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72651ms 2018-05-24 15:32:23,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120417ms 2018-05-24 15:32:23,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23021ms 2018-05-24 15:32:23,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8255ms 2018-05-24 15:32:23,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227484ms 2018-05-24 15:32:23,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218197ms 2018-05-24 15:32:23,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210349ms 2018-05-24 15:32:23,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265171ms 2018-05-24 15:32:23,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124801ms 2018-05-24 15:32:23,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44357ms 2018-05-24 15:32:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283462ms 2018-05-24 15:32:23,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55230ms 2018-05-24 15:32:23,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291562ms 2018-05-24 15:32:23,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25468ms 2018-05-24 15:32:23,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170058ms 2018-05-24 15:32:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158381ms 2018-05-24 15:32:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169666ms 2018-05-24 15:32:23,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146364ms 2018-05-24 15:32:23,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269849ms 2018-05-24 15:32:23,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255872ms 2018-05-24 15:32:23,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62970ms 2018-05-24 15:32:23,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53566ms 2018-05-24 15:32:23,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84565ms 2018-05-24 15:32:23,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282458ms 2018-05-24 15:32:24,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215918ms 2018-05-24 15:32:24,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110839ms 2018-05-24 15:32:24,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2721ms 2018-05-24 15:32:24,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272311ms 2018-05-24 15:32:24,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99735ms 2018-05-24 15:32:24,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169526ms 2018-05-24 15:32:24,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23963ms 2018-05-24 15:32:24,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16733ms 2018-05-24 15:32:24,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259884ms 2018-05-24 15:32:24,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251593ms 2018-05-24 15:32:24,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196946ms 2018-05-24 15:32:24,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43212ms 2018-05-24 15:32:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:24,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35318ms 2018-05-24 15:32:24,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 154207ms 2018-05-24 15:32:24,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80582ms 2018-05-24 15:32:24,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280367ms 2018-05-24 15:32:24,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273135ms 2018-05-24 15:32:24,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224777ms 2018-05-24 15:32:24,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269499ms 2018-05-24 15:32:24,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247348ms 2018-05-24 15:32:24,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243989ms 2018-05-24 15:32:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:24,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78010ms 2018-05-24 15:32:24,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75096ms 2018-05-24 15:32:24,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67513ms 2018-05-24 15:32:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209488ms 2018-05-24 15:32:24,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10318ms 2018-05-24 15:32:24,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26852ms 2018-05-24 15:32:24,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141115ms 2018-05-24 15:32:24,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103742ms 2018-05-24 15:32:24,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101190ms 2018-05-24 15:32:25,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13587ms 2018-05-24 15:32:25,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202643ms 2018-05-24 15:32:25,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27064ms 2018-05-24 15:32:25,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243249ms 2018-05-24 15:32:25,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111694ms 2018-05-24 15:32:25,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107869ms 2018-05-24 15:32:25,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174691ms 2018-05-24 15:32:25,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8358ms 2018-05-24 15:32:25,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189385ms 2018-05-24 15:32:25,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203790ms 2018-05-24 15:32:25,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112469ms 2018-05-24 15:32:25,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231949ms 2018-05-24 15:32:25,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143799ms 2018-05-24 15:32:25,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185127ms 2018-05-24 15:32:25,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116705ms 2018-05-24 15:32:25,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254974ms 2018-05-24 15:32:25,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126381ms 2018-05-24 15:32:25,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43847ms 2018-05-24 15:32:25,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53793ms 2018-05-24 15:32:25,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267202ms 2018-05-24 15:32:25,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112853ms 2018-05-24 15:32:25,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268506ms 2018-05-24 15:32:25,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277814ms 2018-05-24 15:32:25,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235999ms 2018-05-24 15:32:25,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184491ms 2018-05-24 15:32:25,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206799ms 2018-05-24 15:32:25,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145472ms 2018-05-24 15:32:25,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208461ms 2018-05-24 15:32:25,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50616ms 2018-05-24 15:32:25,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4392ms 2018-05-24 15:32:26,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266541ms 2018-05-24 15:32:26,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206760ms 2018-05-24 15:32:26,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108917ms 2018-05-24 15:32:26,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128810ms 2018-05-24 15:32:26,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103776ms 2018-05-24 15:32:26,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105458ms 2018-05-24 15:32:26,143 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:26,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161034ms 2018-05-24 15:32:26,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35829ms 2018-05-24 15:32:26,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225063ms 2018-05-24 15:32:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155558ms 2018-05-24 15:32:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294765ms 2018-05-24 15:32:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279876ms 2018-05-24 15:32:26,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:32:26,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187608ms 2018-05-24 15:32:26,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259058ms 2018-05-24 15:32:26,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250768ms 2018-05-24 15:32:26,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113302ms 2018-05-24 15:32:26,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43282ms 2018-05-24 15:32:26,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117494ms 2018-05-24 15:32:26,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280566ms 2018-05-24 15:32:26,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37247ms 2018-05-24 15:32:26,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285067ms 2018-05-24 15:32:26,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120116ms 2018-05-24 15:32:26,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138727ms 2018-05-24 15:32:26,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197589ms 2018-05-24 15:32:26,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36795ms 2018-05-24 15:32:26,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77075ms 2018-05-24 15:32:26,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112532ms 2018-05-24 15:32:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51576ms 2018-05-24 15:32:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32996ms 2018-05-24 15:32:26,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101471ms 2018-05-24 15:32:27,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261225ms 2018-05-24 15:32:27,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68778ms 2018-05-24 15:32:27,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287420ms 2018-05-24 15:32:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275534ms 2018-05-24 15:32:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32586ms 2018-05-24 15:32:27,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48195ms 2018-05-24 15:32:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53113ms 2018-05-24 15:32:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187080ms 2018-05-24 15:32:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261534ms 2018-05-24 15:32:27,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276227ms 2018-05-24 15:32:27,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287577ms 2018-05-24 15:32:27,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150361ms 2018-05-24 15:32:27,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188607ms 2018-05-24 15:32:27,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266975ms 2018-05-24 15:32:27,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139370ms 2018-05-24 15:32:27,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201050ms 2018-05-24 15:32:27,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181135ms 2018-05-24 15:32:27,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170108ms 2018-05-24 15:32:27,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19196ms 2018-05-24 15:32:27,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137162ms 2018-05-24 15:32:27,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209173ms 2018-05-24 15:32:27,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265018ms 2018-05-24 15:32:27,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117025ms 2018-05-24 15:32:27,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17859ms 2018-05-24 15:32:27,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296390ms 2018-05-24 15:32:27,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160190ms 2018-05-24 15:32:27,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257767ms 2018-05-24 15:32:27,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238518ms 2018-05-24 15:32:27,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109864ms 2018-05-24 15:32:27,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230709ms 2018-05-24 15:32:28,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294930ms 2018-05-24 15:32:28,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214055ms 2018-05-24 15:32:28,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76364ms 2018-05-24 15:32:28,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 33477ms 2018-05-24 15:32:28,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206079ms 2018-05-24 15:32:28,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74326ms 2018-05-24 15:32:28,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98475ms 2018-05-24 15:32:28,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137442ms 2018-05-24 15:32:28,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297881ms 2018-05-24 15:32:28,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78169ms 2018-05-24 15:32:28,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161468ms 2018-05-24 15:32:28,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261163ms 2018-05-24 15:32:28,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152330ms 2018-05-24 15:32:28,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93668ms 2018-05-24 15:32:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96528ms 2018-05-24 15:32:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259048ms 2018-05-24 15:32:28,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261536ms 2018-05-24 15:32:28,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120043ms 2018-05-24 15:32:28,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54282ms 2018-05-24 15:32:28,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12766ms 2018-05-24 15:32:28,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158932ms 2018-05-24 15:32:28,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272734ms 2018-05-24 15:32:28,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133022ms 2018-05-24 15:32:28,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99549ms 2018-05-24 15:32:28,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45528ms 2018-05-24 15:32:28,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 223187ms 2018-05-24 15:32:28,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281189ms 2018-05-24 15:32:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172118ms 2018-05-24 15:32:28,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167516ms 2018-05-24 15:32:28,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48450ms 2018-05-24 15:32:29,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272602ms 2018-05-24 15:32:29,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241994ms 2018-05-24 15:32:29,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181788ms 2018-05-24 15:32:29,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21705ms 2018-05-24 15:32:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139477ms 2018-05-24 15:32:29,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214782ms 2018-05-24 15:32:29,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116330ms 2018-05-24 15:32:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119472ms 2018-05-24 15:32:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264961ms 2018-05-24 15:32:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232971ms 2018-05-24 15:32:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7603ms 2018-05-24 15:32:29,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73767ms 2018-05-24 15:32:29,367 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:29,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133595ms 2018-05-24 15:32:29,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 213681ms 2018-05-24 15:32:29,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101521ms 2018-05-24 15:32:29,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 271147ms 2018-05-24 15:32:29,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237417ms 2018-05-24 15:32:29,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167212ms 2018-05-24 15:32:29,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280717ms 2018-05-24 15:32:29,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8615ms 2018-05-24 15:32:29,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186709ms 2018-05-24 15:32:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:29,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:29,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:29,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280831ms 2018-05-24 15:32:29,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240526ms 2018-05-24 15:32:29,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129495ms 2018-05-24 15:32:29,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108069ms 2018-05-24 15:32:29,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130476ms 2018-05-24 15:32:29,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82723ms 2018-05-24 15:32:29,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281864ms 2018-05-24 15:32:29,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9337ms 2018-05-24 15:32:29,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117573ms 2018-05-24 15:32:30,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221320ms 2018-05-24 15:32:30,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 263356ms 2018-05-24 15:32:30,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221888ms 2018-05-24 15:32:30,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56477ms 2018-05-24 15:32:30,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126040ms 2018-05-24 15:32:30,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108841ms 2018-05-24 15:32:30,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 99990ms 2018-05-24 15:32:30,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110032ms 2018-05-24 15:32:30,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188120ms 2018-05-24 15:32:30,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199553ms 2018-05-24 15:32:30,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100286ms 2018-05-24 15:32:30,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296577ms 2018-05-24 15:32:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207836ms 2018-05-24 15:32:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252364ms 2018-05-24 15:32:30,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282296ms 2018-05-24 15:32:30,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246842ms 2018-05-24 15:32:30,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269856ms 2018-05-24 15:32:30,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178897ms 2018-05-24 15:32:30,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253568ms 2018-05-24 15:32:30,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108750ms 2018-05-24 15:32:30,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192517ms 2018-05-24 15:32:30,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84948ms 2018-05-24 15:32:30,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84963ms 2018-05-24 15:32:30,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150147ms 2018-05-24 15:32:30,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235742ms 2018-05-24 15:32:30,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82329ms 2018-05-24 15:32:30,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269886ms 2018-05-24 15:32:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149323ms 2018-05-24 15:32:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169877ms 2018-05-24 15:32:30,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207846ms 2018-05-24 15:32:31,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54581ms 2018-05-24 15:32:31,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4569ms 2018-05-24 15:32:31,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162487ms 2018-05-24 15:32:31,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186567ms 2018-05-24 15:32:31,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234316ms 2018-05-24 15:32:31,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263952ms 2018-05-24 15:32:31,144 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:31,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122937ms 2018-05-24 15:32:31,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69099ms 2018-05-24 15:32:31,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296229ms 2018-05-24 15:32:31,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260439ms 2018-05-24 15:32:31,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43750ms 2018-05-24 15:32:31,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76588ms 2018-05-24 15:32:31,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69033ms 2018-05-24 15:32:31,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8407ms 2018-05-24 15:32:31,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51782ms 2018-05-24 15:32:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 239052ms 2018-05-24 15:32:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298440ms 2018-05-24 15:32:31,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24809ms 2018-05-24 15:32:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35788ms 2018-05-24 15:32:31,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82811ms 2018-05-24 15:32:31,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194599ms 2018-05-24 15:32:31,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86899ms 2018-05-24 15:32:31,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 796ms 2018-05-24 15:32:31,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70196ms 2018-05-24 15:32:31,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81352ms 2018-05-24 15:32:31,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120750ms 2018-05-24 15:32:31,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184823ms 2018-05-24 15:32:31,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116999ms 2018-05-24 15:32:31,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18685ms 2018-05-24 15:32:31,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87389ms 2018-05-24 15:32:32,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246692ms 2018-05-24 15:32:32,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216978ms 2018-05-24 15:32:32,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239533ms 2018-05-24 15:32:32,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104085ms 2018-05-24 15:32:32,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107325ms 2018-05-24 15:32:32,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129416ms 2018-05-24 15:32:32,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222899ms 2018-05-24 15:32:32,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278248ms 2018-05-24 15:32:32,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67123ms 2018-05-24 15:32:32,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93363ms 2018-05-24 15:32:32,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5312ms 2018-05-24 15:32:32,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139446ms 2018-05-24 15:32:32,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78751ms 2018-05-24 15:32:32,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37718ms 2018-05-24 15:32:32,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233856ms 2018-05-24 15:32:32,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 47847ms 2018-05-24 15:32:32,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119303ms 2018-05-24 15:32:32,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298347ms 2018-05-24 15:32:32,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78622ms 2018-05-24 15:32:32,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144131ms 2018-05-24 15:32:32,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165257ms 2018-05-24 15:32:32,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67916ms 2018-05-24 15:32:32,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206899ms 2018-05-24 15:32:32,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21023ms 2018-05-24 15:32:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 230790ms 2018-05-24 15:32:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106285ms 2018-05-24 15:32:32,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107097ms 2018-05-24 15:32:32,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7589ms 2018-05-24 15:32:32,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233742ms 2018-05-24 15:32:32,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262278ms 2018-05-24 15:32:33,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254005ms 2018-05-24 15:32:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39912ms 2018-05-24 15:32:33,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128356ms 2018-05-24 15:32:33,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271150ms 2018-05-24 15:32:33,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 239830ms 2018-05-24 15:32:33,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153213ms 2018-05-24 15:32:33,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151725ms 2018-05-24 15:32:33,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180450ms 2018-05-24 15:32:33,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294026ms 2018-05-24 15:32:33,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9513ms 2018-05-24 15:32:33,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56027ms 2018-05-24 15:32:33,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154662ms 2018-05-24 15:32:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65948ms 2018-05-24 15:32:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297557ms 2018-05-24 15:32:33,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109137ms 2018-05-24 15:32:33,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243234ms 2018-05-24 15:32:33,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234350ms 2018-05-24 15:32:33,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20319ms 2018-05-24 15:32:33,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245522ms 2018-05-24 15:32:33,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288654ms 2018-05-24 15:32:33,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266126ms 2018-05-24 15:32:33,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260683ms 2018-05-24 15:32:33,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137194ms 2018-05-24 15:32:33,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115752ms 2018-05-24 15:32:33,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51737ms 2018-05-24 15:32:33,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145336ms 2018-05-24 15:32:33,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80118ms 2018-05-24 15:32:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272290ms 2018-05-24 15:32:33,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188137ms 2018-05-24 15:32:33,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30602ms 2018-05-24 15:32:34,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212246ms 2018-05-24 15:32:34,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289337ms 2018-05-24 15:32:34,016 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231708ms 2018-05-24 15:32:34,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90638ms 2018-05-24 15:32:34,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42855ms 2018-05-24 15:32:34,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123807ms 2018-05-24 15:32:34,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241059ms 2018-05-24 15:32:34,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122581ms 2018-05-24 15:32:34,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207868ms 2018-05-24 15:32:34,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297498ms 2018-05-24 15:32:34,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222243ms 2018-05-24 15:32:34,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112631ms 2018-05-24 15:32:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:34,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12547ms 2018-05-24 15:32:34,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175142ms 2018-05-24 15:32:34,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8587ms 2018-05-24 15:32:34,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59644ms 2018-05-24 15:32:34,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 199789ms 2018-05-24 15:32:34,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196437ms 2018-05-24 15:32:34,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234034ms 2018-05-24 15:32:34,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106292ms 2018-05-24 15:32:34,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127770ms 2018-05-24 15:32:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:34,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252503ms 2018-05-24 15:32:34,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84749ms 2018-05-24 15:32:34,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87749ms 2018-05-24 15:32:34,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119652ms 2018-05-24 15:32:34,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175509ms 2018-05-24 15:32:34,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230347ms 2018-05-24 15:32:34,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181596ms 2018-05-24 15:32:34,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20484ms 2018-05-24 15:32:34,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226774ms 2018-05-24 15:32:35,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114861ms 2018-05-24 15:32:35,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44100ms 2018-05-24 15:32:35,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141700ms 2018-05-24 15:32:35,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18340ms 2018-05-24 15:32:35,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121572ms 2018-05-24 15:32:35,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142804ms 2018-05-24 15:32:35,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203075ms 2018-05-24 15:32:35,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174025ms 2018-05-24 15:32:35,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8520ms 2018-05-24 15:32:35,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27714ms 2018-05-24 15:32:35,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168126ms 2018-05-24 15:32:35,316 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7796ms 2018-05-24 15:32:35,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218997ms 2018-05-24 15:32:35,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82803ms 2018-05-24 15:32:35,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188993ms 2018-05-24 15:32:35,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42744ms 2018-05-24 15:32:35,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19992ms 2018-05-24 15:32:35,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191257ms 2018-05-24 15:32:35,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94218ms 2018-05-24 15:32:35,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240659ms 2018-05-24 15:32:35,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60835ms 2018-05-24 15:32:35,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5260ms 2018-05-24 15:32:35,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142006ms 2018-05-24 15:32:35,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68043ms 2018-05-24 15:32:35,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238127ms 2018-05-24 15:32:35,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154229ms 2018-05-24 15:32:35,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31466ms 2018-05-24 15:32:35,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146836ms 2018-05-24 15:32:35,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286750ms 2018-05-24 15:32:35,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191508ms 2018-05-24 15:32:36,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71392ms 2018-05-24 15:32:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295887ms 2018-05-24 15:32:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199896ms 2018-05-24 15:32:36,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261716ms 2018-05-24 15:32:36,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185612ms 2018-05-24 15:32:36,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77837ms 2018-05-24 15:32:36,145 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:36,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119906ms 2018-05-24 15:32:36,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115933ms 2018-05-24 15:32:36,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61162ms 2018-05-24 15:32:36,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254641ms 2018-05-24 15:32:36,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227994ms 2018-05-24 15:32:36,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6023ms 2018-05-24 15:32:36,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152454ms 2018-05-24 15:32:36,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192595ms 2018-05-24 15:32:36,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254862ms 2018-05-24 15:32:36,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244424ms 2018-05-24 15:32:36,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277736ms 2018-05-24 15:32:36,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260896ms 2018-05-24 15:32:36,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247862ms 2018-05-24 15:32:36,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145230ms 2018-05-24 15:32:36,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248570ms 2018-05-24 15:32:36,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212703ms 2018-05-24 15:32:36,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297140ms 2018-05-24 15:32:36,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118569ms 2018-05-24 15:32:36,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59575ms 2018-05-24 15:32:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78447ms 2018-05-24 15:32:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269222ms 2018-05-24 15:32:36,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284927ms 2018-05-24 15:32:36,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18065ms 2018-05-24 15:32:36,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254540ms 2018-05-24 15:32:37,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50245ms 2018-05-24 15:32:37,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140995ms 2018-05-24 15:32:37,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39487ms 2018-05-24 15:32:37,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272944ms 2018-05-24 15:32:37,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9822ms 2018-05-24 15:32:37,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71616ms 2018-05-24 15:32:37,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113602ms 2018-05-24 15:32:37,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153109ms 2018-05-24 15:32:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246411ms 2018-05-24 15:32:37,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30799ms 2018-05-24 15:32:37,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246738ms 2018-05-24 15:32:37,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232729ms 2018-05-24 15:32:37,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124749ms 2018-05-24 15:32:37,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17608ms 2018-05-24 15:32:37,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162857ms 2018-05-24 15:32:37,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69147ms 2018-05-24 15:32:37,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245959ms 2018-05-24 15:32:37,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245812ms 2018-05-24 15:32:37,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66636ms 2018-05-24 15:32:37,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111066ms 2018-05-24 15:32:37,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195074ms 2018-05-24 15:32:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 131937ms 2018-05-24 15:32:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86482ms 2018-05-24 15:32:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207101ms 2018-05-24 15:32:37,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30937ms 2018-05-24 15:32:37,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192335ms 2018-05-24 15:32:37,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102386ms 2018-05-24 15:32:37,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162437ms 2018-05-24 15:32:37,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232488ms 2018-05-24 15:32:37,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275560ms 2018-05-24 15:32:38,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196461ms 2018-05-24 15:32:38,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2238ms 2018-05-24 15:32:38,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141174ms 2018-05-24 15:32:38,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278765ms 2018-05-24 15:32:38,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97205ms 2018-05-24 15:32:38,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145532ms 2018-05-24 15:32:38,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103188ms 2018-05-24 15:32:38,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167403ms 2018-05-24 15:32:38,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204281ms 2018-05-24 15:32:38,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185443ms 2018-05-24 15:32:38,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 79697ms 2018-05-24 15:32:38,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229388ms 2018-05-24 15:32:38,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50894ms 2018-05-24 15:32:38,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240359ms 2018-05-24 15:32:38,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269907ms 2018-05-24 15:32:38,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146281ms 2018-05-24 15:32:38,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190523ms 2018-05-24 15:32:38,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171633ms 2018-05-24 15:32:38,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5396ms 2018-05-24 15:32:38,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206781ms 2018-05-24 15:32:38,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270369ms 2018-05-24 15:32:38,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70627ms 2018-05-24 15:32:38,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78743ms 2018-05-24 15:32:38,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161237ms 2018-05-24 15:32:38,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145509ms 2018-05-24 15:32:38,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45842ms 2018-05-24 15:32:38,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3941ms 2018-05-24 15:32:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106532ms 2018-05-24 15:32:38,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149372ms 2018-05-24 15:32:38,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229906ms 2018-05-24 15:32:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195369ms 2018-05-24 15:32:39,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 271603ms 2018-05-24 15:32:39,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83570ms 2018-05-24 15:32:39,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50609ms 2018-05-24 15:32:39,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114468ms 2018-05-24 15:32:39,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37910ms 2018-05-24 15:32:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244822ms 2018-05-24 15:32:39,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68697ms 2018-05-24 15:32:39,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20429ms 2018-05-24 15:32:39,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181849ms 2018-05-24 15:32:39,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48997ms 2018-05-24 15:32:39,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113177ms 2018-05-24 15:32:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:39,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258825ms 2018-05-24 15:32:39,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164793ms 2018-05-24 15:32:39,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181458ms 2018-05-24 15:32:39,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101341ms 2018-05-24 15:32:39,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17891ms 2018-05-24 15:32:39,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258991ms 2018-05-24 15:32:39,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79087ms 2018-05-24 15:32:39,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209337ms 2018-05-24 15:32:39,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9832ms 2018-05-24 15:32:39,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:39,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 4775ms 2018-05-24 15:32:39,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120987ms 2018-05-24 15:32:39,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51109ms 2018-05-24 15:32:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152097ms 2018-05-24 15:32:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5327ms 2018-05-24 15:32:39,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195336ms 2018-05-24 15:32:39,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293506ms 2018-05-24 15:32:39,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127470ms 2018-05-24 15:32:39,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111818ms 2018-05-24 15:32:40,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115943ms 2018-05-24 15:32:40,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113371ms 2018-05-24 15:32:40,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103420ms 2018-05-24 15:32:40,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258213ms 2018-05-24 15:32:40,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22643ms 2018-05-24 15:32:40,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127430ms 2018-05-24 15:32:40,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233762ms 2018-05-24 15:32:40,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222401ms 2018-05-24 15:32:40,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243095ms 2018-05-24 15:32:40,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214698ms 2018-05-24 15:32:40,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38590ms 2018-05-24 15:32:40,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19983ms 2018-05-24 15:32:40,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8956ms 2018-05-24 15:32:40,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163675ms 2018-05-24 15:32:40,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9031ms 2018-05-24 15:32:40,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 60698ms 2018-05-24 15:32:40,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94866ms 2018-05-24 15:32:40,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124736ms 2018-05-24 15:32:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243790ms 2018-05-24 15:32:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 196285ms 2018-05-24 15:32:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273274ms 2018-05-24 15:32:40,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180374ms 2018-05-24 15:32:40,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 1302ms 2018-05-24 15:32:40,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19701ms 2018-05-24 15:32:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185327ms 2018-05-24 15:32:40,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235181ms 2018-05-24 15:32:40,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78125ms 2018-05-24 15:32:40,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86577ms 2018-05-24 15:32:40,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47567ms 2018-05-24 15:32:40,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59632ms 2018-05-24 15:32:41,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44358ms 2018-05-24 15:32:41,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183623ms 2018-05-24 15:32:41,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201097ms 2018-05-24 15:32:41,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82626ms 2018-05-24 15:32:41,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120053ms 2018-05-24 15:32:41,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6816ms 2018-05-24 15:32:41,145 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:41,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164101ms 2018-05-24 15:32:41,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58436ms 2018-05-24 15:32:41,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283302ms 2018-05-24 15:32:41,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193459ms 2018-05-24 15:32:41,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5290ms 2018-05-24 15:32:41,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36147ms 2018-05-24 15:32:41,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37690ms 2018-05-24 15:32:41,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147824ms 2018-05-24 15:32:41,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56848ms 2018-05-24 15:32:41,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252494ms 2018-05-24 15:32:41,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33471ms 2018-05-24 15:32:41,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137010ms 2018-05-24 15:32:41,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166595ms 2018-05-24 15:32:41,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 6933ms 2018-05-24 15:32:41,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230058ms 2018-05-24 15:32:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206711ms 2018-05-24 15:32:41,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124301ms 2018-05-24 15:32:41,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292848ms 2018-05-24 15:32:41,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68532ms 2018-05-24 15:32:41,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46060ms 2018-05-24 15:32:41,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8943ms 2018-05-24 15:32:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64832ms 2018-05-24 15:32:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186158ms 2018-05-24 15:32:41,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202625ms 2018-05-24 15:32:42,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237293ms 2018-05-24 15:32:42,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281089ms 2018-05-24 15:32:42,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225923ms 2018-05-24 15:32:42,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156669ms 2018-05-24 15:32:42,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40213ms 2018-05-24 15:32:42,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287949ms 2018-05-24 15:32:42,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268265ms 2018-05-24 15:32:42,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126235ms 2018-05-24 15:32:42,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296298ms 2018-05-24 15:32:42,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164557ms 2018-05-24 15:32:42,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294050ms 2018-05-24 15:32:42,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6416ms 2018-05-24 15:32:42,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23141ms 2018-05-24 15:32:42,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105720ms 2018-05-24 15:32:42,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150133ms 2018-05-24 15:32:42,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 111296ms 2018-05-24 15:32:42,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106454ms 2018-05-24 15:32:42,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233461ms 2018-05-24 15:32:42,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125380ms 2018-05-24 15:32:42,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45350ms 2018-05-24 15:32:42,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105495ms 2018-05-24 15:32:42,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118718ms 2018-05-24 15:32:42,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55019ms 2018-05-24 15:32:42,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294018ms 2018-05-24 15:32:42,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39108ms 2018-05-24 15:32:42,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297569ms 2018-05-24 15:32:42,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144180ms 2018-05-24 15:32:42,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277424ms 2018-05-24 15:32:42,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52305ms 2018-05-24 15:32:42,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186752ms 2018-05-24 15:32:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272697ms 2018-05-24 15:32:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90915ms 2018-05-24 15:32:43,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296247ms 2018-05-24 15:32:43,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108024ms 2018-05-24 15:32:43,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247671ms 2018-05-24 15:32:43,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274864ms 2018-05-24 15:32:43,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 174559ms 2018-05-24 15:32:43,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59198ms 2018-05-24 15:32:43,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94155ms 2018-05-24 15:32:43,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7206ms 2018-05-24 15:32:43,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132805ms 2018-05-24 15:32:43,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292074ms 2018-05-24 15:32:43,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23948ms 2018-05-24 15:32:43,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296508ms 2018-05-24 15:32:43,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270427ms 2018-05-24 15:32:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34653ms 2018-05-24 15:32:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258244ms 2018-05-24 15:32:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210787ms 2018-05-24 15:32:43,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224865ms 2018-05-24 15:32:43,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288661ms 2018-05-24 15:32:43,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100972ms 2018-05-24 15:32:43,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65019ms 2018-05-24 15:32:43,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288452ms 2018-05-24 15:32:43,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286465ms 2018-05-24 15:32:43,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145155ms 2018-05-24 15:32:43,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275585ms 2018-05-24 15:32:43,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61291ms 2018-05-24 15:32:43,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140694ms 2018-05-24 15:32:43,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94443ms 2018-05-24 15:32:43,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78053ms 2018-05-24 15:32:44,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288104ms 2018-05-24 15:32:44,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243282ms 2018-05-24 15:32:44,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190817ms 2018-05-24 15:32:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166969ms 2018-05-24 15:32:44,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295841ms 2018-05-24 15:32:44,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102522ms 2018-05-24 15:32:44,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34647ms 2018-05-24 15:32:44,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156230ms 2018-05-24 15:32:44,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12028ms 2018-05-24 15:32:44,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 19003ms 2018-05-24 15:32:44,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150671ms 2018-05-24 15:32:44,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245273ms 2018-05-24 15:32:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:44,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137062ms 2018-05-24 15:32:44,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198833ms 2018-05-24 15:32:44,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185078ms 2018-05-24 15:32:44,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269883ms 2018-05-24 15:32:44,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291424ms 2018-05-24 15:32:44,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236998ms 2018-05-24 15:32:44,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20122ms 2018-05-24 15:32:44,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191422ms 2018-05-24 15:32:44,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267270ms 2018-05-24 15:32:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:44,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5810ms 2018-05-24 15:32:44,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50858ms 2018-05-24 15:32:44,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25170ms 2018-05-24 15:32:44,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140829ms 2018-05-24 15:32:44,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72769ms 2018-05-24 15:32:44,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280169ms 2018-05-24 15:32:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288248ms 2018-05-24 15:32:44,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239161ms 2018-05-24 15:32:44,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131794ms 2018-05-24 15:32:45,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212014ms 2018-05-24 15:32:45,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194158ms 2018-05-24 15:32:45,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188936ms 2018-05-24 15:32:45,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281915ms 2018-05-24 15:32:45,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22458ms 2018-05-24 15:32:45,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49289ms 2018-05-24 15:32:45,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169214ms 2018-05-24 15:32:45,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 75434ms 2018-05-24 15:32:45,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99991ms 2018-05-24 15:32:45,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273185ms 2018-05-24 15:32:45,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37278ms 2018-05-24 15:32:45,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68198ms 2018-05-24 15:32:45,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35850ms 2018-05-24 15:32:45,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132294ms 2018-05-24 15:32:45,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62082ms 2018-05-24 15:32:45,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272309ms 2018-05-24 15:32:45,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143221ms 2018-05-24 15:32:45,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205168ms 2018-05-24 15:32:45,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146856ms 2018-05-24 15:32:45,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3479ms 2018-05-24 15:32:45,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163756ms 2018-05-24 15:32:45,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 287092ms 2018-05-24 15:32:45,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259769ms 2018-05-24 15:32:45,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275407ms 2018-05-24 15:32:45,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193969ms 2018-05-24 15:32:45,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125842ms 2018-05-24 15:32:45,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86294ms 2018-05-24 15:32:45,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200257ms 2018-05-24 15:32:45,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227214ms 2018-05-24 15:32:45,917 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219819ms 2018-05-24 15:32:46,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 223617ms 2018-05-24 15:32:46,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282774ms 2018-05-24 15:32:46,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264911ms 2018-05-24 15:32:46,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 28933ms 2018-05-24 15:32:46,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208829ms 2018-05-24 15:32:46,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66769ms 2018-05-24 15:32:46,147 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:46,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71641ms 2018-05-24 15:32:46,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27158ms 2018-05-24 15:32:46,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232100ms 2018-05-24 15:32:46,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17677ms 2018-05-24 15:32:46,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238667ms 2018-05-24 15:32:46,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166118ms 2018-05-24 15:32:46,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129467ms 2018-05-24 15:32:46,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199813ms 2018-05-24 15:32:46,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149391ms 2018-05-24 15:32:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:32:46,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295505ms 2018-05-24 15:32:46,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202579ms 2018-05-24 15:32:46,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208564ms 2018-05-24 15:32:46,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246077ms 2018-05-24 15:32:46,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29440ms 2018-05-24 15:32:46,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262951ms 2018-05-24 15:32:46,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55700ms 2018-05-24 15:32:46,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74861ms 2018-05-24 15:32:46,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180201ms 2018-05-24 15:32:46,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57581ms 2018-05-24 15:32:46,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226224ms 2018-05-24 15:32:46,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237430ms 2018-05-24 15:32:46,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197758ms 2018-05-24 15:32:46,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242435ms 2018-05-24 15:32:46,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242151ms 2018-05-24 15:32:47,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113448ms 2018-05-24 15:32:47,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138943ms 2018-05-24 15:32:47,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113624ms 2018-05-24 15:32:47,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140137ms 2018-05-24 15:32:47,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 232323ms 2018-05-24 15:32:47,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286128ms 2018-05-24 15:32:47,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39284ms 2018-05-24 15:32:47,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48414ms 2018-05-24 15:32:47,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56913ms 2018-05-24 15:32:47,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29541ms 2018-05-24 15:32:47,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102820ms 2018-05-24 15:32:47,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36998ms 2018-05-24 15:32:47,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298055ms 2018-05-24 15:32:47,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52185ms 2018-05-24 15:32:47,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260198ms 2018-05-24 15:32:47,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219899ms 2018-05-24 15:32:47,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191155ms 2018-05-24 15:32:47,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158910ms 2018-05-24 15:32:47,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97741ms 2018-05-24 15:32:47,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270226ms 2018-05-24 15:32:47,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191170ms 2018-05-24 15:32:47,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88399ms 2018-05-24 15:32:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107185ms 2018-05-24 15:32:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42657ms 2018-05-24 15:32:47,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203921ms 2018-05-24 15:32:47,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182466ms 2018-05-24 15:32:47,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31159ms 2018-05-24 15:32:47,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231514ms 2018-05-24 15:32:47,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216910ms 2018-05-24 15:32:47,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44633ms 2018-05-24 15:32:48,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251161ms 2018-05-24 15:32:48,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176117ms 2018-05-24 15:32:48,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293163ms 2018-05-24 15:32:48,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38321ms 2018-05-24 15:32:48,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34295ms 2018-05-24 15:32:48,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242893ms 2018-05-24 15:32:48,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230909ms 2018-05-24 15:32:48,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49583ms 2018-05-24 15:32:48,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297831ms 2018-05-24 15:32:48,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 144928ms 2018-05-24 15:32:48,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175671ms 2018-05-24 15:32:48,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36888ms 2018-05-24 15:32:48,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168277ms 2018-05-24 15:32:48,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158394ms 2018-05-24 15:32:48,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116286ms 2018-05-24 15:32:48,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101982ms 2018-05-24 15:32:48,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 221075ms 2018-05-24 15:32:48,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231499ms 2018-05-24 15:32:48,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290569ms 2018-05-24 15:32:48,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 80274ms 2018-05-24 15:32:48,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199299ms 2018-05-24 15:32:48,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187956ms 2018-05-24 15:32:48,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 6072ms 2018-05-24 15:32:48,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272705ms 2018-05-24 15:32:48,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65243ms 2018-05-24 15:32:48,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252194ms 2018-05-24 15:32:48,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181421ms 2018-05-24 15:32:48,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164129ms 2018-05-24 15:32:48,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245931ms 2018-05-24 15:32:48,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253553ms 2018-05-24 15:32:49,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130347ms 2018-05-24 15:32:49,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191560ms 2018-05-24 15:32:49,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158666ms 2018-05-24 15:32:49,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33809ms 2018-05-24 15:32:49,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18633ms 2018-05-24 15:32:49,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1175ms 2018-05-24 15:32:49,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191810ms 2018-05-24 15:32:49,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68742ms 2018-05-24 15:32:49,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42579ms 2018-05-24 15:32:49,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89940ms 2018-05-24 15:32:49,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168788ms 2018-05-24 15:32:49,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35561ms 2018-05-24 15:32:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:49,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133118ms 2018-05-24 15:32:49,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197813ms 2018-05-24 15:32:49,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234601ms 2018-05-24 15:32:49,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24332ms 2018-05-24 15:32:49,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 259462ms 2018-05-24 15:32:49,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96984ms 2018-05-24 15:32:49,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211350ms 2018-05-24 15:32:49,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158171ms 2018-05-24 15:32:49,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14438ms 2018-05-24 15:32:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:49,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 226544ms 2018-05-24 15:32:49,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40394ms 2018-05-24 15:32:49,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107390ms 2018-05-24 15:32:49,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117362ms 2018-05-24 15:32:49,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5817ms 2018-05-24 15:32:49,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191832ms 2018-05-24 15:32:49,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162875ms 2018-05-24 15:32:49,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119572ms 2018-05-24 15:32:49,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89773ms 2018-05-24 15:32:50,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237244ms 2018-05-24 15:32:50,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24312ms 2018-05-24 15:32:50,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33922ms 2018-05-24 15:32:50,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150479ms 2018-05-24 15:32:50,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 226412ms 2018-05-24 15:32:50,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197342ms 2018-05-24 15:32:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 174745ms 2018-05-24 15:32:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176892ms 2018-05-24 15:32:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190276ms 2018-05-24 15:32:50,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39257ms 2018-05-24 15:32:50,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252856ms 2018-05-24 15:32:50,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292833ms 2018-05-24 15:32:50,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45710ms 2018-05-24 15:32:50,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83868ms 2018-05-24 15:32:50,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126747ms 2018-05-24 15:32:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283008ms 2018-05-24 15:32:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 123796ms 2018-05-24 15:32:50,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180641ms 2018-05-24 15:32:50,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190129ms 2018-05-24 15:32:50,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20268ms 2018-05-24 15:32:50,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120579ms 2018-05-24 15:32:50,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177806ms 2018-05-24 15:32:50,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20125ms 2018-05-24 15:32:50,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291164ms 2018-05-24 15:32:50,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280534ms 2018-05-24 15:32:50,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22611ms 2018-05-24 15:32:50,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117446ms 2018-05-24 15:32:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55293ms 2018-05-24 15:32:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117436ms 2018-05-24 15:32:50,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79984ms 2018-05-24 15:32:51,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126011ms 2018-05-24 15:32:51,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215111ms 2018-05-24 15:32:51,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160703ms 2018-05-24 15:32:51,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97172ms 2018-05-24 15:32:51,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215047ms 2018-05-24 15:32:51,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140785ms 2018-05-24 15:32:51,147 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 75314ms 2018-05-24 15:32:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111584ms 2018-05-24 15:32:51,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199084ms 2018-05-24 15:32:51,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249121ms 2018-05-24 15:32:51,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212182ms 2018-05-24 15:32:51,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195081ms 2018-05-24 15:32:51,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54240ms 2018-05-24 15:32:51,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202811ms 2018-05-24 15:32:51,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111881ms 2018-05-24 15:32:51,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284604ms 2018-05-24 15:32:51,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130049ms 2018-05-24 15:32:51,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147803ms 2018-05-24 15:32:51,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 134923ms 2018-05-24 15:32:51,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143964ms 2018-05-24 15:32:51,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234645ms 2018-05-24 15:32:51,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142462ms 2018-05-24 15:32:51,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158798ms 2018-05-24 15:32:51,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83432ms 2018-05-24 15:32:51,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254434ms 2018-05-24 15:32:51,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169946ms 2018-05-24 15:32:51,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155898ms 2018-05-24 15:32:51,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161240ms 2018-05-24 15:32:51,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283623ms 2018-05-24 15:32:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189231ms 2018-05-24 15:32:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43387ms 2018-05-24 15:32:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59109ms 2018-05-24 15:32:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81973ms 2018-05-24 15:32:52,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294165ms 2018-05-24 15:32:52,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39592ms 2018-05-24 15:32:52,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254888ms 2018-05-24 15:32:52,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194894ms 2018-05-24 15:32:52,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125140ms 2018-05-24 15:32:52,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297424ms 2018-05-24 15:32:52,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23258ms 2018-05-24 15:32:52,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49464ms 2018-05-24 15:32:52,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45810ms 2018-05-24 15:32:52,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153826ms 2018-05-24 15:32:52,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62843ms 2018-05-24 15:32:52,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211102ms 2018-05-24 15:32:52,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149254ms 2018-05-24 15:32:52,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100185ms 2018-05-24 15:32:52,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161647ms 2018-05-24 15:32:52,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197156ms 2018-05-24 15:32:52,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131980ms 2018-05-24 15:32:52,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156930ms 2018-05-24 15:32:52,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218402ms 2018-05-24 15:32:52,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234628ms 2018-05-24 15:32:52,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10162ms 2018-05-24 15:32:52,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126988ms 2018-05-24 15:32:52,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203372ms 2018-05-24 15:32:52,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232458ms 2018-05-24 15:32:52,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27887ms 2018-05-24 15:32:52,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227755ms 2018-05-24 15:32:52,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86864ms 2018-05-24 15:32:53,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113256ms 2018-05-24 15:32:53,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219699ms 2018-05-24 15:32:53,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192873ms 2018-05-24 15:32:53,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148446ms 2018-05-24 15:32:53,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185271ms 2018-05-24 15:32:53,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212826ms 2018-05-24 15:32:53,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269450ms 2018-05-24 15:32:53,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3065ms 2018-05-24 15:32:53,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89707ms 2018-05-24 15:32:53,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 185946ms 2018-05-24 15:32:53,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80698ms 2018-05-24 15:32:53,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54098ms 2018-05-24 15:32:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 207857ms 2018-05-24 15:32:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136379ms 2018-05-24 15:32:53,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95061ms 2018-05-24 15:32:53,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26675ms 2018-05-24 15:32:53,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73223ms 2018-05-24 15:32:53,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28294ms 2018-05-24 15:32:53,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25106ms 2018-05-24 15:32:53,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37304ms 2018-05-24 15:32:53,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99416ms 2018-05-24 15:32:53,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299030ms 2018-05-24 15:32:53,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7661ms 2018-05-24 15:32:53,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50327ms 2018-05-24 15:32:53,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 58932ms 2018-05-24 15:32:53,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62283ms 2018-05-24 15:32:53,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257072ms 2018-05-24 15:32:53,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 28256ms 2018-05-24 15:32:53,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292936ms 2018-05-24 15:32:53,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222654ms 2018-05-24 15:32:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97853ms 2018-05-24 15:32:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189568ms 2018-05-24 15:32:54,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245790ms 2018-05-24 15:32:54,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29679ms 2018-05-24 15:32:54,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282971ms 2018-05-24 15:32:54,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185984ms 2018-05-24 15:32:54,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257748ms 2018-05-24 15:32:54,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114554ms 2018-05-24 15:32:54,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254330ms 2018-05-24 15:32:54,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117994ms 2018-05-24 15:32:54,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152593ms 2018-05-24 15:32:54,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184328ms 2018-05-24 15:32:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:54,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35844ms 2018-05-24 15:32:54,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249867ms 2018-05-24 15:32:54,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278922ms 2018-05-24 15:32:54,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125153ms 2018-05-24 15:32:54,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211202ms 2018-05-24 15:32:54,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158740ms 2018-05-24 15:32:54,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183568ms 2018-05-24 15:32:54,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10441ms 2018-05-24 15:32:54,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288223ms 2018-05-24 15:32:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:54,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129306ms 2018-05-24 15:32:54,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101139ms 2018-05-24 15:32:54,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281853ms 2018-05-24 15:32:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293695ms 2018-05-24 15:32:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75774ms 2018-05-24 15:32:54,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70775ms 2018-05-24 15:32:54,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 216175ms 2018-05-24 15:32:54,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170190ms 2018-05-24 15:32:54,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35751ms 2018-05-24 15:32:55,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286417ms 2018-05-24 15:32:55,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88204ms 2018-05-24 15:32:55,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291107ms 2018-05-24 15:32:55,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10155ms 2018-05-24 15:32:55,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48030ms 2018-05-24 15:32:55,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266853ms 2018-05-24 15:32:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 187203ms 2018-05-24 15:32:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299296ms 2018-05-24 15:32:55,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148109ms 2018-05-24 15:32:55,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5305ms 2018-05-24 15:32:55,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31020ms 2018-05-24 15:32:55,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216480ms 2018-05-24 15:32:55,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23158ms 2018-05-24 15:32:55,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6945ms 2018-05-24 15:32:55,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136259ms 2018-05-24 15:32:55,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132617ms 2018-05-24 15:32:55,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61431ms 2018-05-24 15:32:55,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10855ms 2018-05-24 15:32:55,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220831ms 2018-05-24 15:32:55,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52482ms 2018-05-24 15:32:55,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203883ms 2018-05-24 15:32:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5492ms 2018-05-24 15:32:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 41968ms 2018-05-24 15:32:55,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266363ms 2018-05-24 15:32:55,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83622ms 2018-05-24 15:32:55,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 166022ms 2018-05-24 15:32:55,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212717ms 2018-05-24 15:32:55,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 75196ms 2018-05-24 15:32:55,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71746ms 2018-05-24 15:32:55,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230720ms 2018-05-24 15:32:56,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240986ms 2018-05-24 15:32:56,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169317ms 2018-05-24 15:32:56,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21687ms 2018-05-24 15:32:56,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 140475ms 2018-05-24 15:32:56,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39858ms 2018-05-24 15:32:56,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83286ms 2018-05-24 15:32:56,148 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:32:56,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22746ms 2018-05-24 15:32:56,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269979ms 2018-05-24 15:32:56,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186423ms 2018-05-24 15:32:56,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 87690ms 2018-05-24 15:32:56,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8240ms 2018-05-24 15:32:56,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65052ms 2018-05-24 15:32:56,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212371ms 2018-05-24 15:32:56,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45438ms 2018-05-24 15:32:56,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210445ms 2018-05-24 15:32:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15435ms 2018-05-24 15:32:56,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61929ms 2018-05-24 15:32:56,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157744ms 2018-05-24 15:32:56,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246989ms 2018-05-24 15:32:56,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118161ms 2018-05-24 15:32:56,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255933ms 2018-05-24 15:32:56,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182178ms 2018-05-24 15:32:56,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147117ms 2018-05-24 15:32:56,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178666ms 2018-05-24 15:32:56,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197597ms 2018-05-24 15:32:56,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284222ms 2018-05-24 15:32:56,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24711ms 2018-05-24 15:32:56,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115956ms 2018-05-24 15:32:56,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293067ms 2018-05-24 15:32:56,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6324ms 2018-05-24 15:32:57,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280841ms 2018-05-24 15:32:57,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171907ms 2018-05-24 15:32:57,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180168ms 2018-05-24 15:32:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147390ms 2018-05-24 15:32:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226865ms 2018-05-24 15:32:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277713ms 2018-05-24 15:32:57,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282590ms 2018-05-24 15:32:57,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62311ms 2018-05-24 15:32:57,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299844ms 2018-05-24 15:32:57,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233171ms 2018-05-24 15:32:57,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157386ms 2018-05-24 15:32:57,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136155ms 2018-05-24 15:32:57,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64631ms 2018-05-24 15:32:57,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89478ms 2018-05-24 15:32:57,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182116ms 2018-05-24 15:32:57,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93481ms 2018-05-24 15:32:57,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214537ms 2018-05-24 15:32:57,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 47208ms 2018-05-24 15:32:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 85356ms 2018-05-24 15:32:57,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161700ms 2018-05-24 15:32:57,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289759ms 2018-05-24 15:32:57,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184196ms 2018-05-24 15:32:57,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197299ms 2018-05-24 15:32:57,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99800ms 2018-05-24 15:32:57,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262250ms 2018-05-24 15:32:57,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247557ms 2018-05-24 15:32:57,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118819ms 2018-05-24 15:32:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56647ms 2018-05-24 15:32:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292041ms 2018-05-24 15:32:57,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133003ms 2018-05-24 15:32:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59468ms 2018-05-24 15:32:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156970ms 2018-05-24 15:32:58,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294144ms 2018-05-24 15:32:58,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206331ms 2018-05-24 15:32:58,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 204844ms 2018-05-24 15:32:58,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179414ms 2018-05-24 15:32:58,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41137ms 2018-05-24 15:32:58,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114129ms 2018-05-24 15:32:58,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198810ms 2018-05-24 15:32:58,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239162ms 2018-05-24 15:32:58,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56473ms 2018-05-24 15:32:58,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115345ms 2018-05-24 15:32:58,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 218832ms 2018-05-24 15:32:58,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233413ms 2018-05-24 15:32:58,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78025ms 2018-05-24 15:32:58,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21916ms 2018-05-24 15:32:58,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225138ms 2018-05-24 15:32:58,515 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89572ms 2018-05-24 15:32:58,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 297823ms 2018-05-24 15:32:58,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237117ms 2018-05-24 15:32:58,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265215ms 2018-05-24 15:32:58,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279913ms 2018-05-24 15:32:58,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172673ms 2018-05-24 15:32:58,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134242ms 2018-05-24 15:32:58,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 104403ms 2018-05-24 15:32:58,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272647ms 2018-05-24 15:32:58,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129718ms 2018-05-24 15:32:58,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95720ms 2018-05-24 15:32:58,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26934ms 2018-05-24 15:32:58,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88666ms 2018-05-24 15:32:59,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144641ms 2018-05-24 15:32:59,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145744ms 2018-05-24 15:32:59,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84997ms 2018-05-24 15:32:59,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163363ms 2018-05-24 15:32:59,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261306ms 2018-05-24 15:32:59,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231758ms 2018-05-24 15:32:59,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61723ms 2018-05-24 15:32:59,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108529ms 2018-05-24 15:32:59,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127531ms 2018-05-24 15:32:59,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 3712ms 2018-05-24 15:32:59,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291099ms 2018-05-24 15:32:59,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200348ms 2018-05-24 15:32:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:32:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:32:59,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83524ms 2018-05-24 15:32:59,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254875ms 2018-05-24 15:32:59,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280669ms 2018-05-24 15:32:59,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103530ms 2018-05-24 15:32:59,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59ms 2018-05-24 15:32:59,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13568ms 2018-05-24 15:32:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129363ms 2018-05-24 15:32:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 270836ms 2018-05-24 15:32:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229508ms 2018-05-24 15:32:59,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:32:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:32:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:32:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:32:59,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257774ms 2018-05-24 15:32:59,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14742ms 2018-05-24 15:32:59,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69827ms 2018-05-24 15:32:59,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175464ms 2018-05-24 15:32:59,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188497ms 2018-05-24 15:32:59,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10546ms 2018-05-24 15:32:59,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60180ms 2018-05-24 15:32:59,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38181ms 2018-05-24 15:32:59,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63673ms 2018-05-24 15:33:00,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31530ms 2018-05-24 15:33:00,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179042ms 2018-05-24 15:33:00,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195675ms 2018-05-24 15:33:00,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30309ms 2018-05-24 15:33:00,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203818ms 2018-05-24 15:33:00,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244643ms 2018-05-24 15:33:00,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91725ms 2018-05-24 15:33:00,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266430ms 2018-05-24 15:33:00,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3495ms 2018-05-24 15:33:00,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264883ms 2018-05-24 15:33:00,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293619ms 2018-05-24 15:33:00,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18208ms 2018-05-24 15:33:00,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139797ms 2018-05-24 15:33:00,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156300ms 2018-05-24 15:33:00,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186428ms 2018-05-24 15:33:00,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165875ms 2018-05-24 15:33:00,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268901ms 2018-05-24 15:33:00,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89072ms 2018-05-24 15:33:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252448ms 2018-05-24 15:33:00,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10456ms 2018-05-24 15:33:00,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119320ms 2018-05-24 15:33:00,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159453ms 2018-05-24 15:33:00,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12490ms 2018-05-24 15:33:00,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144255ms 2018-05-24 15:33:00,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275973ms 2018-05-24 15:33:00,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291574ms 2018-05-24 15:33:00,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24711ms 2018-05-24 15:33:00,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96405ms 2018-05-24 15:33:00,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10595ms 2018-05-24 15:33:00,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231618ms 2018-05-24 15:33:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288235ms 2018-05-24 15:33:01,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110874ms 2018-05-24 15:33:01,016 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265492ms 2018-05-24 15:33:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210222ms 2018-05-24 15:33:01,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283745ms 2018-05-24 15:33:01,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75505ms 2018-05-24 15:33:01,149 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:01,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10158ms 2018-05-24 15:33:01,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172077ms 2018-05-24 15:33:01,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179404ms 2018-05-24 15:33:01,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193680ms 2018-05-24 15:33:01,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287270ms 2018-05-24 15:33:01,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160064ms 2018-05-24 15:33:01,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 131358ms 2018-05-24 15:33:01,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33495ms 2018-05-24 15:33:01,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250139ms 2018-05-24 15:33:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 55889ms 2018-05-24 15:33:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135934ms 2018-05-24 15:33:01,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81396ms 2018-05-24 15:33:01,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35421ms 2018-05-24 15:33:01,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67673ms 2018-05-24 15:33:01,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116013ms 2018-05-24 15:33:01,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299463ms 2018-05-24 15:33:01,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263224ms 2018-05-24 15:33:01,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53986ms 2018-05-24 15:33:01,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 18086ms 2018-05-24 15:33:01,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226771ms 2018-05-24 15:33:01,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137889ms 2018-05-24 15:33:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 6342ms 2018-05-24 15:33:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162067ms 2018-05-24 15:33:01,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185680ms 2018-05-24 15:33:02,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83163ms 2018-05-24 15:33:02,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88150ms 2018-05-24 15:33:02,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48539ms 2018-05-24 15:33:02,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253840ms 2018-05-24 15:33:02,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212262ms 2018-05-24 15:33:02,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245719ms 2018-05-24 15:33:02,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141969ms 2018-05-24 15:33:02,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50901ms 2018-05-24 15:33:02,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283462ms 2018-05-24 15:33:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 287142ms 2018-05-24 15:33:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265288ms 2018-05-24 15:33:02,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290218ms 2018-05-24 15:33:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73355ms 2018-05-24 15:33:02,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8508ms 2018-05-24 15:33:02,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122176ms 2018-05-24 15:33:02,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163753ms 2018-05-24 15:33:02,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141218ms 2018-05-24 15:33:02,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99757ms 2018-05-24 15:33:02,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202370ms 2018-05-24 15:33:02,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105472ms 2018-05-24 15:33:02,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292599ms 2018-05-24 15:33:02,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176330ms 2018-05-24 15:33:02,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255253ms 2018-05-24 15:33:02,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297458ms 2018-05-24 15:33:02,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28069ms 2018-05-24 15:33:02,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197095ms 2018-05-24 15:33:02,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117580ms 2018-05-24 15:33:02,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291119ms 2018-05-24 15:33:02,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142172ms 2018-05-24 15:33:02,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252503ms 2018-05-24 15:33:03,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225311ms 2018-05-24 15:33:03,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268910ms 2018-05-24 15:33:03,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102440ms 2018-05-24 15:33:03,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158611ms 2018-05-24 15:33:03,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202411ms 2018-05-24 15:33:03,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5855ms 2018-05-24 15:33:03,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261526ms 2018-05-24 15:33:03,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114873ms 2018-05-24 15:33:03,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37094ms 2018-05-24 15:33:03,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283255ms 2018-05-24 15:33:03,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267077ms 2018-05-24 15:33:03,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87025ms 2018-05-24 15:33:03,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 184221ms 2018-05-24 15:33:03,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109193ms 2018-05-24 15:33:03,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197034ms 2018-05-24 15:33:03,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208267ms 2018-05-24 15:33:03,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259448ms 2018-05-24 15:33:03,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173068ms 2018-05-24 15:33:03,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94686ms 2018-05-24 15:33:03,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62404ms 2018-05-24 15:33:03,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277945ms 2018-05-24 15:33:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 203261ms 2018-05-24 15:33:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169225ms 2018-05-24 15:33:03,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266984ms 2018-05-24 15:33:03,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 253005ms 2018-05-24 15:33:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35996ms 2018-05-24 15:33:03,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208244ms 2018-05-24 15:33:03,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26865ms 2018-05-24 15:33:03,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7152ms 2018-05-24 15:33:03,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267223ms 2018-05-24 15:33:04,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165580ms 2018-05-24 15:33:04,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270253ms 2018-05-24 15:33:04,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267712ms 2018-05-24 15:33:04,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 609ms 2018-05-24 15:33:04,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52463ms 2018-05-24 15:33:04,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252606ms 2018-05-24 15:33:04,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 144941ms 2018-05-24 15:33:04,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223626ms 2018-05-24 15:33:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287959ms 2018-05-24 15:33:04,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208827ms 2018-05-24 15:33:04,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242869ms 2018-05-24 15:33:04,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135897ms 2018-05-24 15:33:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:04,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:04,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 156768ms 2018-05-24 15:33:04,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260883ms 2018-05-24 15:33:04,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249399ms 2018-05-24 15:33:04,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163257ms 2018-05-24 15:33:04,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275288ms 2018-05-24 15:33:04,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265105ms 2018-05-24 15:33:04,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161910ms 2018-05-24 15:33:04,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190922ms 2018-05-24 15:33:04,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227042ms 2018-05-24 15:33:04,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:04,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255196ms 2018-05-24 15:33:04,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95148ms 2018-05-24 15:33:04,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57912ms 2018-05-24 15:33:04,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5702ms 2018-05-24 15:33:04,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64296ms 2018-05-24 15:33:04,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220758ms 2018-05-24 15:33:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168969ms 2018-05-24 15:33:04,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34873ms 2018-05-24 15:33:04,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169924ms 2018-05-24 15:33:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44101ms 2018-05-24 15:33:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242756ms 2018-05-24 15:33:05,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229103ms 2018-05-24 15:33:05,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122252ms 2018-05-24 15:33:05,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 139273ms 2018-05-24 15:33:05,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91613ms 2018-05-24 15:33:05,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284115ms 2018-05-24 15:33:05,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 268858ms 2018-05-24 15:33:05,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125303ms 2018-05-24 15:33:05,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90135ms 2018-05-24 15:33:05,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227581ms 2018-05-24 15:33:05,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281950ms 2018-05-24 15:33:05,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101841ms 2018-05-24 15:33:05,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212802ms 2018-05-24 15:33:05,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259115ms 2018-05-24 15:33:05,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173391ms 2018-05-24 15:33:05,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256013ms 2018-05-24 15:33:05,516 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29722ms 2018-05-24 15:33:05,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 84615ms 2018-05-24 15:33:05,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274067ms 2018-05-24 15:33:05,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113682ms 2018-05-24 15:33:05,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212226ms 2018-05-24 15:33:05,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 221667ms 2018-05-24 15:33:05,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104822ms 2018-05-24 15:33:05,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 126480ms 2018-05-24 15:33:05,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51062ms 2018-05-24 15:33:05,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170594ms 2018-05-24 15:33:05,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26199ms 2018-05-24 15:33:05,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11098ms 2018-05-24 15:33:05,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210429ms 2018-05-24 15:33:06,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293255ms 2018-05-24 15:33:06,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116291ms 2018-05-24 15:33:06,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261985ms 2018-05-24 15:33:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88346ms 2018-05-24 15:33:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180120ms 2018-05-24 15:33:06,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28185ms 2018-05-24 15:33:06,150 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:06,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37102ms 2018-05-24 15:33:06,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35950ms 2018-05-24 15:33:06,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55938ms 2018-05-24 15:33:06,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10060ms 2018-05-24 15:33:06,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37691ms 2018-05-24 15:33:06,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237128ms 2018-05-24 15:33:06,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175292ms 2018-05-24 15:33:06,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109927ms 2018-05-24 15:33:06,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15598ms 2018-05-24 15:33:06,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:33:06,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 32915ms 2018-05-24 15:33:06,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77978ms 2018-05-24 15:33:06,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235530ms 2018-05-24 15:33:06,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236851ms 2018-05-24 15:33:06,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190321ms 2018-05-24 15:33:06,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 241101ms 2018-05-24 15:33:06,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246259ms 2018-05-24 15:33:06,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 271446ms 2018-05-24 15:33:06,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45157ms 2018-05-24 15:33:06,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53620ms 2018-05-24 15:33:06,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68920ms 2018-05-24 15:33:06,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163930ms 2018-05-24 15:33:06,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215707ms 2018-05-24 15:33:06,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51025ms 2018-05-24 15:33:06,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18065ms 2018-05-24 15:33:07,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56ms 2018-05-24 15:33:07,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129949ms 2018-05-24 15:33:07,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121043ms 2018-05-24 15:33:07,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288850ms 2018-05-24 15:33:07,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162455ms 2018-05-24 15:33:07,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99006ms 2018-05-24 15:33:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108316ms 2018-05-24 15:33:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178966ms 2018-05-24 15:33:07,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270500ms 2018-05-24 15:33:07,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16851ms 2018-05-24 15:33:07,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15988ms 2018-05-24 15:33:07,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287543ms 2018-05-24 15:33:07,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4622ms 2018-05-24 15:33:07,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138401ms 2018-05-24 15:33:07,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80009ms 2018-05-24 15:33:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 173626ms 2018-05-24 15:33:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 280114ms 2018-05-24 15:33:07,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79841ms 2018-05-24 15:33:07,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50720ms 2018-05-24 15:33:07,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155368ms 2018-05-24 15:33:07,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157245ms 2018-05-24 15:33:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7490ms 2018-05-24 15:33:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69821ms 2018-05-24 15:33:07,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227702ms 2018-05-24 15:33:07,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 198227ms 2018-05-24 15:33:07,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290709ms 2018-05-24 15:33:07,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237706ms 2018-05-24 15:33:07,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218086ms 2018-05-24 15:33:07,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147068ms 2018-05-24 15:33:07,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121515ms 2018-05-24 15:33:08,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 278888ms 2018-05-24 15:33:08,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43622ms 2018-05-24 15:33:08,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246517ms 2018-05-24 15:33:08,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 59915ms 2018-05-24 15:33:08,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261680ms 2018-05-24 15:33:08,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59959ms 2018-05-24 15:33:08,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286010ms 2018-05-24 15:33:08,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23293ms 2018-05-24 15:33:08,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131396ms 2018-05-24 15:33:08,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299464ms 2018-05-24 15:33:08,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11518ms 2018-05-24 15:33:08,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161524ms 2018-05-24 15:33:08,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184056ms 2018-05-24 15:33:08,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81504ms 2018-05-24 15:33:08,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163588ms 2018-05-24 15:33:08,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157192ms 2018-05-24 15:33:08,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195574ms 2018-05-24 15:33:08,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16251ms 2018-05-24 15:33:08,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27486ms 2018-05-24 15:33:08,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188834ms 2018-05-24 15:33:08,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114386ms 2018-05-24 15:33:08,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25132ms 2018-05-24 15:33:08,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167984ms 2018-05-24 15:33:08,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58175ms 2018-05-24 15:33:08,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190954ms 2018-05-24 15:33:08,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8672ms 2018-05-24 15:33:08,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69887ms 2018-05-24 15:33:08,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278968ms 2018-05-24 15:33:08,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152953ms 2018-05-24 15:33:08,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207875ms 2018-05-24 15:33:09,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163531ms 2018-05-24 15:33:09,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74474ms 2018-05-24 15:33:09,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267386ms 2018-05-24 15:33:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24092ms 2018-05-24 15:33:09,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85062ms 2018-05-24 15:33:09,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193070ms 2018-05-24 15:33:09,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269651ms 2018-05-24 15:33:09,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128083ms 2018-05-24 15:33:09,210 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 226752ms 2018-05-24 15:33:09,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 92348ms 2018-05-24 15:33:09,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225253ms 2018-05-24 15:33:09,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39923ms 2018-05-24 15:33:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:09,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25648ms 2018-05-24 15:33:09,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69610ms 2018-05-24 15:33:09,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74734ms 2018-05-24 15:33:09,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 76587ms 2018-05-24 15:33:09,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174993ms 2018-05-24 15:33:09,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249888ms 2018-05-24 15:33:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61977ms 2018-05-24 15:33:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157102ms 2018-05-24 15:33:09,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 16599ms 2018-05-24 15:33:09,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:09,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238023ms 2018-05-24 15:33:09,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139875ms 2018-05-24 15:33:09,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71930ms 2018-05-24 15:33:09,776 DEBUG [MemStoreFlusher.1] regionserver.FlushAllLargeStoresPolicy(70): Since none of the CFs were above the size, flushing all. 2018-05-24 15:33:09,776 INFO [MemStoreFlusher.1] regionserver.HRegion(2572): Flushing 3/3 column families, dataSize=223 B heapSize=-272 B 2018-05-24 15:33:09,797 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:33:09,797 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED]]} size 0 2018-05-24 15:33:09,797 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741845_1021{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|FINALIZED], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|FINALIZED]]} size 0 2018-05-24 15:33:09,798 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=223 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/info/621b69ede3f04be9a5c148437136dfd8 2018-05-24 15:33:09,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91021ms 2018-05-24 15:33:09,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267328ms 2018-05-24 15:33:09,809 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/.tmp/info/621b69ede3f04be9a5c148437136dfd8 as hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info/621b69ede3f04be9a5c148437136dfd8 2018-05-24 15:33:09,819 INFO [MemStoreFlusher.1] regionserver.HStore(1070): Added hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/info/621b69ede3f04be9a5c148437136dfd8, entries=2, sequenceid=21, filesize=4.8 K 2018-05-24 15:33:09,820 INFO [MemStoreFlusher.1] regionserver.HRegion(2781): Finished flush of dataSize ~223 B/223, heapSize ~592 B/592, currentSize=0 B/0 for 1588230740 in 44ms, sequenceid=21, compaction requested=false 2018-05-24 15:33:09,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 195243ms 2018-05-24 15:33:09,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147126ms 2018-05-24 15:33:10,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202669ms 2018-05-24 15:33:10,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46418ms 2018-05-24 15:33:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 110485ms 2018-05-24 15:33:10,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48020ms 2018-05-24 15:33:10,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214651ms 2018-05-24 15:33:10,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38107ms 2018-05-24 15:33:10,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114202ms 2018-05-24 15:33:10,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63734ms 2018-05-24 15:33:10,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224702ms 2018-05-24 15:33:10,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61159ms 2018-05-24 15:33:10,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50864ms 2018-05-24 15:33:10,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178061ms 2018-05-24 15:33:10,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 191451ms 2018-05-24 15:33:10,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293214ms 2018-05-24 15:33:10,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236562ms 2018-05-24 15:33:10,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 64956ms 2018-05-24 15:33:10,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138927ms 2018-05-24 15:33:10,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 92984ms 2018-05-24 15:33:10,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54732ms 2018-05-24 15:33:10,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132891ms 2018-05-24 15:33:11,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186281ms 2018-05-24 15:33:11,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72908ms 2018-05-24 15:33:11,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 125989ms 2018-05-24 15:33:11,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164151ms 2018-05-24 15:33:11,151 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:11,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11907ms 2018-05-24 15:33:11,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182662ms 2018-05-24 15:33:11,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210536ms 2018-05-24 15:33:11,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279351ms 2018-05-24 15:33:11,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258107ms 2018-05-24 15:33:11,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98294ms 2018-05-24 15:33:11,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38033ms 2018-05-24 15:33:11,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162490ms 2018-05-24 15:33:11,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106322ms 2018-05-24 15:33:11,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118981ms 2018-05-24 15:33:11,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 110385ms 2018-05-24 15:33:11,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210684ms 2018-05-24 15:33:11,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200640ms 2018-05-24 15:33:11,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50787ms 2018-05-24 15:33:11,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215006ms 2018-05-24 15:33:11,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281111ms 2018-05-24 15:33:12,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 21393ms 2018-05-24 15:33:12,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118300ms 2018-05-24 15:33:12,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238490ms 2018-05-24 15:33:12,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232198ms 2018-05-24 15:33:12,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188160ms 2018-05-24 15:33:12,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69129ms 2018-05-24 15:33:12,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12734ms 2018-05-24 15:33:12,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273125ms 2018-05-24 15:33:12,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217871ms 2018-05-24 15:33:12,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 175650ms 2018-05-24 15:33:12,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5572ms 2018-05-24 15:33:12,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152468ms 2018-05-24 15:33:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268288ms 2018-05-24 15:33:12,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211313ms 2018-05-24 15:33:12,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57518ms 2018-05-24 15:33:12,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199579ms 2018-05-24 15:33:12,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109235ms 2018-05-24 15:33:12,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42658ms 2018-05-24 15:33:12,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 186997ms 2018-05-24 15:33:12,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236231ms 2018-05-24 15:33:13,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261245ms 2018-05-24 15:33:13,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216694ms 2018-05-24 15:33:13,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255377ms 2018-05-24 15:33:13,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261777ms 2018-05-24 15:33:13,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133537ms 2018-05-24 15:33:13,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155191ms 2018-05-24 15:33:13,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276546ms 2018-05-24 15:33:13,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121472ms 2018-05-24 15:33:13,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 152685ms 2018-05-24 15:33:13,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130022ms 2018-05-24 15:33:13,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129113ms 2018-05-24 15:33:13,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 208133ms 2018-05-24 15:33:13,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260628ms 2018-05-24 15:33:13,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40048ms 2018-05-24 15:33:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 107719ms 2018-05-24 15:33:13,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117701ms 2018-05-24 15:33:13,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 73603ms 2018-05-24 15:33:13,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44127ms 2018-05-24 15:33:13,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183327ms 2018-05-24 15:33:13,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263155ms 2018-05-24 15:33:14,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36770ms 2018-05-24 15:33:14,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222924ms 2018-05-24 15:33:14,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57066ms 2018-05-24 15:33:14,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128411ms 2018-05-24 15:33:14,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220362ms 2018-05-24 15:33:14,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30707ms 2018-05-24 15:33:14,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123624ms 2018-05-24 15:33:14,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154940ms 2018-05-24 15:33:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:14,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171773ms 2018-05-24 15:33:14,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162015ms 2018-05-24 15:33:14,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 30877ms 2018-05-24 15:33:14,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160077ms 2018-05-24 15:33:14,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74310ms 2018-05-24 15:33:14,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176612ms 2018-05-24 15:33:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:14,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247776ms 2018-05-24 15:33:14,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201472ms 2018-05-24 15:33:14,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240494ms 2018-05-24 15:33:14,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76843ms 2018-05-24 15:33:14,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31451ms 2018-05-24 15:33:14,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105827ms 2018-05-24 15:33:15,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272024ms 2018-05-24 15:33:15,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242024ms 2018-05-24 15:33:15,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269951ms 2018-05-24 15:33:15,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213155ms 2018-05-24 15:33:15,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42874ms 2018-05-24 15:33:15,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 276231ms 2018-05-24 15:33:15,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 20296ms 2018-05-24 15:33:15,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161419ms 2018-05-24 15:33:15,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13752ms 2018-05-24 15:33:15,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211909ms 2018-05-24 15:33:15,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37865ms 2018-05-24 15:33:15,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28843ms 2018-05-24 15:33:15,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 174175ms 2018-05-24 15:33:15,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129019ms 2018-05-24 15:33:15,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127859ms 2018-05-24 15:33:15,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240372ms 2018-05-24 15:33:15,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16890ms 2018-05-24 15:33:15,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63445ms 2018-05-24 15:33:15,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290951ms 2018-05-24 15:33:15,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81311ms 2018-05-24 15:33:16,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172789ms 2018-05-24 15:33:16,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59969ms 2018-05-24 15:33:16,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49334ms 2018-05-24 15:33:16,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13069ms 2018-05-24 15:33:16,152 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:16,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38284ms 2018-05-24 15:33:16,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75651ms 2018-05-24 15:33:16,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 102320ms 2018-05-24 15:33:16,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167273ms 2018-05-24 15:33:16,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163854ms 2018-05-24 15:33:16,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261669ms 2018-05-24 15:33:16,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16241ms 2018-05-24 15:33:16,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99946ms 2018-05-24 15:33:16,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212148ms 2018-05-24 15:33:16,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 107308ms 2018-05-24 15:33:16,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231333ms 2018-05-24 15:33:16,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71733ms 2018-05-24 15:33:16,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211800ms 2018-05-24 15:33:16,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103142ms 2018-05-24 15:33:16,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 95412ms 2018-05-24 15:33:16,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99039ms 2018-05-24 15:33:17,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72371ms 2018-05-24 15:33:17,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267263ms 2018-05-24 15:33:17,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 38766ms 2018-05-24 15:33:17,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255311ms 2018-05-24 15:33:17,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11191ms 2018-05-24 15:33:17,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272146ms 2018-05-24 15:33:17,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51347ms 2018-05-24 15:33:17,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118210ms 2018-05-24 15:33:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 273542ms 2018-05-24 15:33:17,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138268ms 2018-05-24 15:33:17,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285823ms 2018-05-24 15:33:17,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87048ms 2018-05-24 15:33:17,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37581ms 2018-05-24 15:33:17,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50509ms 2018-05-24 15:33:17,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216721ms 2018-05-24 15:33:17,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 23532ms 2018-05-24 15:33:17,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131265ms 2018-05-24 15:33:17,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 222456ms 2018-05-24 15:33:17,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 168023ms 2018-05-24 15:33:17,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220434ms 2018-05-24 15:33:18,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170484ms 2018-05-24 15:33:18,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274442ms 2018-05-24 15:33:18,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246936ms 2018-05-24 15:33:18,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218968ms 2018-05-24 15:33:18,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120820ms 2018-05-24 15:33:18,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104279ms 2018-05-24 15:33:18,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189469ms 2018-05-24 15:33:18,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112383ms 2018-05-24 15:33:18,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201697ms 2018-05-24 15:33:18,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 164080ms 2018-05-24 15:33:18,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292125ms 2018-05-24 15:33:18,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42403ms 2018-05-24 15:33:18,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25320ms 2018-05-24 15:33:18,616 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99856ms 2018-05-24 15:33:18,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216227ms 2018-05-24 15:33:18,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 89253ms 2018-05-24 15:33:18,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162752ms 2018-05-24 15:33:18,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113302ms 2018-05-24 15:33:18,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43262ms 2018-05-24 15:33:18,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231946ms 2018-05-24 15:33:19,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54912ms 2018-05-24 15:33:19,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224109ms 2018-05-24 15:33:19,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299109ms 2018-05-24 15:33:19,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99708ms 2018-05-24 15:33:19,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122716ms 2018-05-24 15:33:19,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223046ms 2018-05-24 15:33:19,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 115205ms 2018-05-24 15:33:19,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171054ms 2018-05-24 15:33:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:19,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 260954ms 2018-05-24 15:33:19,417 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194119ms 2018-05-24 15:33:19,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 284008ms 2018-05-24 15:33:19,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129245ms 2018-05-24 15:33:19,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76469ms 2018-05-24 15:33:19,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274557ms 2018-05-24 15:33:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:19,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219716ms 2018-05-24 15:33:19,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22386ms 2018-05-24 15:33:19,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290637ms 2018-05-24 15:33:19,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76141ms 2018-05-24 15:33:19,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8093ms 2018-05-24 15:33:19,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228229ms 2018-05-24 15:33:20,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227689ms 2018-05-24 15:33:20,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156425ms 2018-05-24 15:33:20,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234488ms 2018-05-24 15:33:20,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183291ms 2018-05-24 15:33:20,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39307ms 2018-05-24 15:33:20,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212350ms 2018-05-24 15:33:20,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 94429ms 2018-05-24 15:33:20,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196047ms 2018-05-24 15:33:20,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 92462ms 2018-05-24 15:33:20,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17289ms 2018-05-24 15:33:20,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101799ms 2018-05-24 15:33:20,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 783ms 2018-05-24 15:33:20,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130814ms 2018-05-24 15:33:20,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 170153ms 2018-05-24 15:33:20,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 248748ms 2018-05-24 15:33:20,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211933ms 2018-05-24 15:33:20,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161779ms 2018-05-24 15:33:20,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56880ms 2018-05-24 15:33:20,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268836ms 2018-05-24 15:33:20,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73302ms 2018-05-24 15:33:21,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 17644ms 2018-05-24 15:33:21,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117748ms 2018-05-24 15:33:21,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95479ms 2018-05-24 15:33:21,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236304ms 2018-05-24 15:33:21,153 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:21,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 220612ms 2018-05-24 15:33:21,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229346ms 2018-05-24 15:33:21,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 136008ms 2018-05-24 15:33:21,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202140ms 2018-05-24 15:33:21,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16564ms 2018-05-24 15:33:21,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52146ms 2018-05-24 15:33:21,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282840ms 2018-05-24 15:33:21,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110826ms 2018-05-24 15:33:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111493ms 2018-05-24 15:33:21,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43541ms 2018-05-24 15:33:21,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50104ms 2018-05-24 15:33:21,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86156ms 2018-05-24 15:33:21,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76399ms 2018-05-24 15:33:21,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 255595ms 2018-05-24 15:33:21,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52527ms 2018-05-24 15:33:21,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25459ms 2018-05-24 15:33:22,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42163ms 2018-05-24 15:33:22,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159185ms 2018-05-24 15:33:22,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 84003ms 2018-05-24 15:33:22,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113974ms 2018-05-24 15:33:22,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112338ms 2018-05-24 15:33:22,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11031ms 2018-05-24 15:33:22,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 105288ms 2018-05-24 15:33:22,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207857ms 2018-05-24 15:33:22,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132072ms 2018-05-24 15:33:22,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113168ms 2018-05-24 15:33:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147522ms 2018-05-24 15:33:22,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187433ms 2018-05-24 15:33:22,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 211305ms 2018-05-24 15:33:22,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274626ms 2018-05-24 15:33:22,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6201ms 2018-05-24 15:33:22,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 256205ms 2018-05-24 15:33:22,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225462ms 2018-05-24 15:33:22,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136574ms 2018-05-24 15:33:22,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 289208ms 2018-05-24 15:33:22,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2521ms 2018-05-24 15:33:23,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 285915ms 2018-05-24 15:33:23,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155818ms 2018-05-24 15:33:23,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41570ms 2018-05-24 15:33:23,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286356ms 2018-05-24 15:33:23,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268200ms 2018-05-24 15:33:23,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244025ms 2018-05-24 15:33:23,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65842ms 2018-05-24 15:33:23,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213529ms 2018-05-24 15:33:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191914ms 2018-05-24 15:33:23,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217084ms 2018-05-24 15:33:23,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 282381ms 2018-05-24 15:33:23,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9491ms 2018-05-24 15:33:23,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 146982ms 2018-05-24 15:33:23,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134801ms 2018-05-24 15:33:23,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116582ms 2018-05-24 15:33:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85218ms 2018-05-24 15:33:23,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 52913ms 2018-05-24 15:33:23,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13530ms 2018-05-24 15:33:23,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122253ms 2018-05-24 15:33:23,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8058ms 2018-05-24 15:33:24,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285935ms 2018-05-24 15:33:24,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293385ms 2018-05-24 15:33:24,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 48117ms 2018-05-24 15:33:24,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 98730ms 2018-05-24 15:33:24,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72966ms 2018-05-24 15:33:24,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179479ms 2018-05-24 15:33:24,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 65920ms 2018-05-24 15:33:24,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147386ms 2018-05-24 15:33:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:24,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145534ms 2018-05-24 15:33:24,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5492ms 2018-05-24 15:33:24,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91338ms 2018-05-24 15:33:24,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13709ms 2018-05-24 15:33:24,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235063ms 2018-05-24 15:33:24,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194808ms 2018-05-24 15:33:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:24,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151247ms 2018-05-24 15:33:24,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272102ms 2018-05-24 15:33:24,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159431ms 2018-05-24 15:33:24,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 147672ms 2018-05-24 15:33:24,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100634ms 2018-05-24 15:33:24,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296999ms 2018-05-24 15:33:25,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281966ms 2018-05-24 15:33:25,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144724ms 2018-05-24 15:33:25,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 99307ms 2018-05-24 15:33:25,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74485ms 2018-05-24 15:33:25,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 97784ms 2018-05-24 15:33:25,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225774ms 2018-05-24 15:33:25,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162851ms 2018-05-24 15:33:25,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102552ms 2018-05-24 15:33:25,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192655ms 2018-05-24 15:33:25,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24917ms 2018-05-24 15:33:25,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182351ms 2018-05-24 15:33:25,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 125854ms 2018-05-24 15:33:25,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123131ms 2018-05-24 15:33:25,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77183ms 2018-05-24 15:33:25,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 210799ms 2018-05-24 15:33:25,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154654ms 2018-05-24 15:33:25,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 7479ms 2018-05-24 15:33:25,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64085ms 2018-05-24 15:33:25,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114434ms 2018-05-24 15:33:25,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177914ms 2018-05-24 15:33:26,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 135760ms 2018-05-24 15:33:26,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177896ms 2018-05-24 15:33:26,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 194032ms 2018-05-24 15:33:26,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278877ms 2018-05-24 15:33:26,153 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:26,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207772ms 2018-05-24 15:33:26,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 35841ms 2018-05-24 15:33:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193331ms 2018-05-24 15:33:26,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151652ms 2018-05-24 15:33:26,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176693ms 2018-05-24 15:33:26,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25142ms 2018-05-24 15:33:26,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:33:26,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 963ms 2018-05-24 15:33:26,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171674ms 2018-05-24 15:33:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202385ms 2018-05-24 15:33:26,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109401ms 2018-05-24 15:33:26,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13085ms 2018-05-24 15:33:26,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 16188ms 2018-05-24 15:33:26,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189119ms 2018-05-24 15:33:26,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215818ms 2018-05-24 15:33:26,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209647ms 2018-05-24 15:33:26,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295419ms 2018-05-24 15:33:27,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269600ms 2018-05-24 15:33:27,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181037ms 2018-05-24 15:33:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46626ms 2018-05-24 15:33:27,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 27679ms 2018-05-24 15:33:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225984ms 2018-05-24 15:33:27,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43094ms 2018-05-24 15:33:27,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114469ms 2018-05-24 15:33:27,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 137064ms 2018-05-24 15:33:27,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 290447ms 2018-05-24 15:33:27,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237889ms 2018-05-24 15:33:27,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176946ms 2018-05-24 15:33:27,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30832ms 2018-05-24 15:33:27,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141729ms 2018-05-24 15:33:27,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256798ms 2018-05-24 15:33:27,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49471ms 2018-05-24 15:33:27,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223981ms 2018-05-24 15:33:27,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163902ms 2018-05-24 15:33:27,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128585ms 2018-05-24 15:33:27,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200451ms 2018-05-24 15:33:27,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239570ms 2018-05-24 15:33:28,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56518ms 2018-05-24 15:33:28,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211512ms 2018-05-24 15:33:28,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4258ms 2018-05-24 15:33:28,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 268789ms 2018-05-24 15:33:28,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 280845ms 2018-05-24 15:33:28,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271877ms 2018-05-24 15:33:28,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 272119ms 2018-05-24 15:33:28,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103531ms 2018-05-24 15:33:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298223ms 2018-05-24 15:33:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265387ms 2018-05-24 15:33:28,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244957ms 2018-05-24 15:33:28,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229936ms 2018-05-24 15:33:28,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190584ms 2018-05-24 15:33:28,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 163174ms 2018-05-24 15:33:28,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86747ms 2018-05-24 15:33:28,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21155ms 2018-05-24 15:33:28,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50034ms 2018-05-24 15:33:28,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 115795ms 2018-05-24 15:33:28,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121898ms 2018-05-24 15:33:28,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212557ms 2018-05-24 15:33:29,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 69380ms 2018-05-24 15:33:29,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34718ms 2018-05-24 15:33:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246884ms 2018-05-24 15:33:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109122ms 2018-05-24 15:33:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224612ms 2018-05-24 15:33:29,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244283ms 2018-05-24 15:33:29,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 114698ms 2018-05-24 15:33:29,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53952ms 2018-05-24 15:33:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:29,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:29,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22449ms 2018-05-24 15:33:29,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 183796ms 2018-05-24 15:33:29,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 292401ms 2018-05-24 15:33:29,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126420ms 2018-05-24 15:33:29,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258511ms 2018-05-24 15:33:29,609 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 221888ms 2018-05-24 15:33:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:29,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161323ms 2018-05-24 15:33:29,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 244765ms 2018-05-24 15:33:29,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262911ms 2018-05-24 15:33:29,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264309ms 2018-05-24 15:33:29,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165966ms 2018-05-24 15:33:29,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 216456ms 2018-05-24 15:33:30,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82202ms 2018-05-24 15:33:30,016 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1013ms 2018-05-24 15:33:30,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 117155ms 2018-05-24 15:33:30,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 90522ms 2018-05-24 15:33:30,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87243ms 2018-05-24 15:33:30,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281987ms 2018-05-24 15:33:30,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 136589ms 2018-05-24 15:33:30,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279948ms 2018-05-24 15:33:30,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 181222ms 2018-05-24 15:33:30,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50937ms 2018-05-24 15:33:30,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 171187ms 2018-05-24 15:33:30,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 71920ms 2018-05-24 15:33:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192649ms 2018-05-24 15:33:30,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36498ms 2018-05-24 15:33:30,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54604ms 2018-05-24 15:33:30,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 74547ms 2018-05-24 15:33:30,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28013ms 2018-05-24 15:33:30,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119682ms 2018-05-24 15:33:30,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46822ms 2018-05-24 15:33:30,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 253339ms 2018-05-24 15:33:31,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224137ms 2018-05-24 15:33:31,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247557ms 2018-05-24 15:33:31,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 206131ms 2018-05-24 15:33:31,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269871ms 2018-05-24 15:33:31,154 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:31,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209763ms 2018-05-24 15:33:31,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137141ms 2018-05-24 15:33:31,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123153ms 2018-05-24 15:33:31,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31925ms 2018-05-24 15:33:31,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178739ms 2018-05-24 15:33:31,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232309ms 2018-05-24 15:33:31,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101012ms 2018-05-24 15:33:31,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126902ms 2018-05-24 15:33:31,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57239ms 2018-05-24 15:33:31,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46698ms 2018-05-24 15:33:31,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174259ms 2018-05-24 15:33:31,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269598ms 2018-05-24 15:33:31,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 78829ms 2018-05-24 15:33:31,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77514ms 2018-05-24 15:33:31,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145195ms 2018-05-24 15:33:31,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145376ms 2018-05-24 15:33:32,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 214000ms 2018-05-24 15:33:32,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59116ms 2018-05-24 15:33:32,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 202516ms 2018-05-24 15:33:32,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180406ms 2018-05-24 15:33:32,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 22545ms 2018-05-24 15:33:32,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101311ms 2018-05-24 15:33:32,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274494ms 2018-05-24 15:33:32,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4358ms 2018-05-24 15:33:32,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 275729ms 2018-05-24 15:33:32,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175991ms 2018-05-24 15:33:32,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257959ms 2018-05-24 15:33:32,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153345ms 2018-05-24 15:33:32,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 106329ms 2018-05-24 15:33:32,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278849ms 2018-05-24 15:33:32,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261532ms 2018-05-24 15:33:32,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295077ms 2018-05-24 15:33:32,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161239ms 2018-05-24 15:33:32,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121688ms 2018-05-24 15:33:32,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101257ms 2018-05-24 15:33:32,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58370ms 2018-05-24 15:33:33,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132597ms 2018-05-24 15:33:33,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264336ms 2018-05-24 15:33:33,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 269119ms 2018-05-24 15:33:33,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295609ms 2018-05-24 15:33:33,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261367ms 2018-05-24 15:33:33,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 4592ms 2018-05-24 15:33:33,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 215617ms 2018-05-24 15:33:33,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194591ms 2018-05-24 15:33:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 5681ms 2018-05-24 15:33:33,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78941ms 2018-05-24 15:33:33,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163499ms 2018-05-24 15:33:33,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 201282ms 2018-05-24 15:33:33,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245027ms 2018-05-24 15:33:33,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102001ms 2018-05-24 15:33:33,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227424ms 2018-05-24 15:33:33,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184419ms 2018-05-24 15:33:33,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 196274ms 2018-05-24 15:33:33,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33866ms 2018-05-24 15:33:33,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 34318ms 2018-05-24 15:33:33,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183777ms 2018-05-24 15:33:34,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264260ms 2018-05-24 15:33:34,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263902ms 2018-05-24 15:33:34,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277408ms 2018-05-24 15:33:34,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 52374ms 2018-05-24 15:33:34,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 284919ms 2018-05-24 15:33:34,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 294284ms 2018-05-24 15:33:34,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 233792ms 2018-05-24 15:33:34,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106555ms 2018-05-24 15:33:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:34,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112414ms 2018-05-24 15:33:34,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264239ms 2018-05-24 15:33:34,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225063ms 2018-05-24 15:33:34,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275047ms 2018-05-24 15:33:34,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31289ms 2018-05-24 15:33:34,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252716ms 2018-05-24 15:33:34,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:34,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3874ms 2018-05-24 15:33:34,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 113972ms 2018-05-24 15:33:34,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99280ms 2018-05-24 15:33:34,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161354ms 2018-05-24 15:33:34,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270786ms 2018-05-24 15:33:34,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 264898ms 2018-05-24 15:33:35,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 167629ms 2018-05-24 15:33:35,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131393ms 2018-05-24 15:33:35,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165121ms 2018-05-24 15:33:35,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56469ms 2018-05-24 15:33:35,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171443ms 2018-05-24 15:33:35,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 129482ms 2018-05-24 15:33:35,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 53516ms 2018-05-24 15:33:35,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161722ms 2018-05-24 15:33:35,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236446ms 2018-05-24 15:33:35,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260311ms 2018-05-24 15:33:35,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 112017ms 2018-05-24 15:33:35,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147143ms 2018-05-24 15:33:35,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 51640ms 2018-05-24 15:33:35,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94076ms 2018-05-24 15:33:35,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291814ms 2018-05-24 15:33:35,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72160ms 2018-05-24 15:33:35,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232181ms 2018-05-24 15:33:35,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161450ms 2018-05-24 15:33:35,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281683ms 2018-05-24 15:33:35,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 198645ms 2018-05-24 15:33:36,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 227756ms 2018-05-24 15:33:36,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65053ms 2018-05-24 15:33:36,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123774ms 2018-05-24 15:33:36,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166440ms 2018-05-24 15:33:36,156 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:36,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42707ms 2018-05-24 15:33:36,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263595ms 2018-05-24 15:33:36,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 15345ms 2018-05-24 15:33:36,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 212653ms 2018-05-24 15:33:36,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 123542ms 2018-05-24 15:33:36,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41916ms 2018-05-24 15:33:36,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212842ms 2018-05-24 15:33:36,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 291563ms 2018-05-24 15:33:36,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2227ms 2018-05-24 15:33:36,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247897ms 2018-05-24 15:33:36,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155647ms 2018-05-24 15:33:36,716 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282175ms 2018-05-24 15:33:36,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288373ms 2018-05-24 15:33:36,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 36158ms 2018-05-24 15:33:36,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 249803ms 2018-05-24 15:33:36,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228063ms 2018-05-24 15:33:37,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176810ms 2018-05-24 15:33:37,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129097ms 2018-05-24 15:33:37,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 251098ms 2018-05-24 15:33:37,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73084ms 2018-05-24 15:33:37,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273731ms 2018-05-24 15:33:37,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 296084ms 2018-05-24 15:33:37,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72429ms 2018-05-24 15:33:37,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 49152ms 2018-05-24 15:33:37,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176073ms 2018-05-24 15:33:37,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112255ms 2018-05-24 15:33:37,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 13226ms 2018-05-24 15:33:37,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188151ms 2018-05-24 15:33:37,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 141590ms 2018-05-24 15:33:37,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262502ms 2018-05-24 15:33:37,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 72611ms 2018-05-24 15:33:37,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3051ms 2018-05-24 15:33:37,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2327ms 2018-05-24 15:33:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264082ms 2018-05-24 15:33:37,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 261505ms 2018-05-24 15:33:37,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80647ms 2018-05-24 15:33:38,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44988ms 2018-05-24 15:33:38,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 88939ms 2018-05-24 15:33:38,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229709ms 2018-05-24 15:33:38,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279613ms 2018-05-24 15:33:38,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49688ms 2018-05-24 15:33:38,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 162955ms 2018-05-24 15:33:38,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 144922ms 2018-05-24 15:33:38,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279107ms 2018-05-24 15:33:38,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25596ms 2018-05-24 15:33:38,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77070ms 2018-05-24 15:33:38,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151123ms 2018-05-24 15:33:38,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 70967ms 2018-05-24 15:33:38,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170187ms 2018-05-24 15:33:38,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 248901ms 2018-05-24 15:33:38,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299965ms 2018-05-24 15:33:38,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277412ms 2018-05-24 15:33:38,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293305ms 2018-05-24 15:33:38,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237482ms 2018-05-24 15:33:38,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 67784ms 2018-05-24 15:33:38,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159613ms 2018-05-24 15:33:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246437ms 2018-05-24 15:33:39,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255822ms 2018-05-24 15:33:39,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 109175ms 2018-05-24 15:33:39,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263814ms 2018-05-24 15:33:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236560ms 2018-05-24 15:33:39,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140750ms 2018-05-24 15:33:39,297 DEBUG [MemStoreFlusher.1] regionserver.HRegion(2221): Skipping flush on hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. because closing 2018-05-24 15:33:39,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 228905ms 2018-05-24 15:33:39,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293841ms 2018-05-24 15:33:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:39,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 287288ms 2018-05-24 15:33:39,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290053ms 2018-05-24 15:33:39,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265444ms 2018-05-24 15:33:39,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65574ms 2018-05-24 15:33:39,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 277654ms 2018-05-24 15:33:39,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126138ms 2018-05-24 15:33:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:39,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:39,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144382ms 2018-05-24 15:33:39,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29468ms 2018-05-24 15:33:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155761ms 2018-05-24 15:33:39,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260345ms 2018-05-24 15:33:39,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 24167ms 2018-05-24 15:33:39,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244804ms 2018-05-24 15:33:40,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63324ms 2018-05-24 15:33:40,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 151840ms 2018-05-24 15:33:40,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103190ms 2018-05-24 15:33:40,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105350ms 2018-05-24 15:33:40,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9747ms 2018-05-24 15:33:40,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254480ms 2018-05-24 15:33:40,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 298766ms 2018-05-24 15:33:40,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178275ms 2018-05-24 15:33:40,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54573ms 2018-05-24 15:33:40,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32259ms 2018-05-24 15:33:40,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 148876ms 2018-05-24 15:33:40,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185624ms 2018-05-24 15:33:40,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 209950ms 2018-05-24 15:33:40,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122076ms 2018-05-24 15:33:40,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 200240ms 2018-05-24 15:33:40,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 278084ms 2018-05-24 15:33:40,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 192236ms 2018-05-24 15:33:40,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176730ms 2018-05-24 15:33:40,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267174ms 2018-05-24 15:33:40,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 247777ms 2018-05-24 15:33:41,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 60268ms 2018-05-24 15:33:41,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127271ms 2018-05-24 15:33:41,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183728ms 2018-05-24 15:33:41,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71854ms 2018-05-24 15:33:41,157 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:41,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102201ms 2018-05-24 15:33:41,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61773ms 2018-05-24 15:33:41,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46002ms 2018-05-24 15:33:41,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 117485ms 2018-05-24 15:33:41,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199664ms 2018-05-24 15:33:41,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 2536ms 2018-05-24 15:33:41,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142585ms 2018-05-24 15:33:41,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54216ms 2018-05-24 15:33:41,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290922ms 2018-05-24 15:33:41,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 133591ms 2018-05-24 15:33:41,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63080ms 2018-05-24 15:33:41,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43727ms 2018-05-24 15:33:41,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203575ms 2018-05-24 15:33:41,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 191339ms 2018-05-24 15:33:41,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92065ms 2018-05-24 15:33:41,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 40796ms 2018-05-24 15:33:42,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25235ms 2018-05-24 15:33:42,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91170ms 2018-05-24 15:33:42,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 283277ms 2018-05-24 15:33:42,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74552ms 2018-05-24 15:33:42,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 66440ms 2018-05-24 15:33:42,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63373ms 2018-05-24 15:33:42,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265640ms 2018-05-24 15:33:42,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201014ms 2018-05-24 15:33:42,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294752ms 2018-05-24 15:33:42,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 266349ms 2018-05-24 15:33:42,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 153100ms 2018-05-24 15:33:42,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17085ms 2018-05-24 15:33:42,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252005ms 2018-05-24 15:33:42,611 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 235069ms 2018-05-24 15:33:42,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 57016ms 2018-05-24 15:33:42,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 121859ms 2018-05-24 15:33:42,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209144ms 2018-05-24 15:33:42,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 223177ms 2018-05-24 15:33:42,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 153468ms 2018-05-24 15:33:42,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175444ms 2018-05-24 15:33:43,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172554ms 2018-05-24 15:33:43,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 252572ms 2018-05-24 15:33:43,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 254212ms 2018-05-24 15:33:43,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160722ms 2018-05-24 15:33:43,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 42842ms 2018-05-24 15:33:43,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162487ms 2018-05-24 15:33:43,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 158590ms 2018-05-24 15:33:43,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149879ms 2018-05-24 15:33:43,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109739ms 2018-05-24 15:33:43,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 293757ms 2018-05-24 15:33:43,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274570ms 2018-05-24 15:33:43,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143029ms 2018-05-24 15:33:43,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9376ms 2018-05-24 15:33:43,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145099ms 2018-05-24 15:33:43,708 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 165534ms 2018-05-24 15:33:43,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59551ms 2018-05-24 15:33:43,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 137719ms 2018-05-24 15:33:43,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64805ms 2018-05-24 15:33:43,904 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 258355ms 2018-05-24 15:33:43,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 134688ms 2018-05-24 15:33:44,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296448ms 2018-05-24 15:33:44,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 142828ms 2018-05-24 15:33:44,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81903ms 2018-05-24 15:33:44,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51497ms 2018-05-24 15:33:44,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91609ms 2018-05-24 15:33:44,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250635ms 2018-05-24 15:33:44,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126288ms 2018-05-24 15:33:44,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245769ms 2018-05-24 15:33:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:44,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60583ms 2018-05-24 15:33:44,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 120753ms 2018-05-24 15:33:44,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 288017ms 2018-05-24 15:33:44,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49172ms 2018-05-24 15:33:44,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161081ms 2018-05-24 15:33:44,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 81043ms 2018-05-24 15:33:44,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:44,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:44,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 246012ms 2018-05-24 15:33:44,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206598ms 2018-05-24 15:33:44,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177502ms 2018-05-24 15:33:44,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71492ms 2018-05-24 15:33:44,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101132ms 2018-05-24 15:33:44,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290753ms 2018-05-24 15:33:45,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 157346ms 2018-05-24 15:33:45,017 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34441ms 2018-05-24 15:33:45,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 109854ms 2018-05-24 15:33:45,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 174225ms 2018-05-24 15:33:45,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45991ms 2018-05-24 15:33:45,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197730ms 2018-05-24 15:33:45,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 176500ms 2018-05-24 15:33:45,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126353ms 2018-05-24 15:33:45,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 197663ms 2018-05-24 15:33:45,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77960ms 2018-05-24 15:33:45,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 162405ms 2018-05-24 15:33:45,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 91655ms 2018-05-24 15:33:45,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3839ms 2018-05-24 15:33:45,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 56025ms 2018-05-24 15:33:45,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 26692ms 2018-05-24 15:33:45,715 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215978ms 2018-05-24 15:33:45,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230234ms 2018-05-24 15:33:45,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 48437ms 2018-05-24 15:33:45,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 265932ms 2018-05-24 15:33:45,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189124ms 2018-05-24 15:33:46,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119163ms 2018-05-24 15:33:46,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255593ms 2018-05-24 15:33:46,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 161989ms 2018-05-24 15:33:46,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292594ms 2018-05-24 15:33:46,157 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:46,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 219487ms 2018-05-24 15:33:46,216 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149538ms 2018-05-24 15:33:46,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 121749ms 2018-05-24 15:33:46,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204872ms 2018-05-24 15:33:46,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 100684ms 2018-05-24 15:33:46,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207555ms 2018-05-24 15:33:46,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:33:46,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 124806ms 2018-05-24 15:33:46,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 177489ms 2018-05-24 15:33:46,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46354ms 2018-05-24 15:33:46,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 116594ms 2018-05-24 15:33:46,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 82127ms 2018-05-24 15:33:46,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87124ms 2018-05-24 15:33:46,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 31197ms 2018-05-24 15:33:46,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 261932ms 2018-05-24 15:33:46,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29762ms 2018-05-24 15:33:46,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 68147ms 2018-05-24 15:33:47,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 62100ms 2018-05-24 15:33:47,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252665ms 2018-05-24 15:33:47,104 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 229650ms 2018-05-24 15:33:47,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 164717ms 2018-05-24 15:33:47,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233841ms 2018-05-24 15:33:47,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 9306ms 2018-05-24 15:33:47,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196479ms 2018-05-24 15:33:47,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 86723ms 2018-05-24 15:33:47,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 243357ms 2018-05-24 15:33:47,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18623ms 2018-05-24 15:33:47,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 15136ms 2018-05-24 15:33:47,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228952ms 2018-05-24 15:33:47,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 257159ms 2018-05-24 15:33:47,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256565ms 2018-05-24 15:33:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 155377ms 2018-05-24 15:33:47,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 294795ms 2018-05-24 15:33:47,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234625ms 2018-05-24 15:33:47,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122172ms 2018-05-24 15:33:47,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 148868ms 2018-05-24 15:33:47,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 50748ms 2018-05-24 15:33:48,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 113624ms 2018-05-24 15:33:48,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101367ms 2018-05-24 15:33:48,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 262655ms 2018-05-24 15:33:48,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99021ms 2018-05-24 15:33:48,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 182414ms 2018-05-24 15:33:48,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235741ms 2018-05-24 15:33:48,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 122899ms 2018-05-24 15:33:48,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213379ms 2018-05-24 15:33:48,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 240533ms 2018-05-24 15:33:48,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210988ms 2018-05-24 15:33:48,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114302ms 2018-05-24 15:33:48,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 190505ms 2018-05-24 15:33:48,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105482ms 2018-05-24 15:33:48,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 119229ms 2018-05-24 15:33:48,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232271ms 2018-05-24 15:33:48,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 195320ms 2018-05-24 15:33:48,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 29131ms 2018-05-24 15:33:48,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10226ms 2018-05-24 15:33:48,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71476ms 2018-05-24 15:33:48,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245241ms 2018-05-24 15:33:49,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 193718ms 2018-05-24 15:33:49,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133260ms 2018-05-24 15:33:49,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 224256ms 2018-05-24 15:33:49,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91241ms 2018-05-24 15:33:49,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101984ms 2018-05-24 15:33:49,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81146ms 2018-05-24 15:33:49,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194136ms 2018-05-24 15:33:49,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138710ms 2018-05-24 15:33:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:49,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240751ms 2018-05-24 15:33:49,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 208715ms 2018-05-24 15:33:49,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 128443ms 2018-05-24 15:33:49,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147814ms 2018-05-24 15:33:49,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225749ms 2018-05-24 15:33:49,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 101732ms 2018-05-24 15:33:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:49,672 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:49,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32748ms 2018-05-24 15:33:49,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 12086ms 2018-05-24 15:33:49,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 108713ms 2018-05-24 15:33:49,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 236782ms 2018-05-24 15:33:49,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85149ms 2018-05-24 15:33:49,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 118528ms 2018-05-24 15:33:50,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 225891ms 2018-05-24 15:33:50,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100966ms 2018-05-24 15:33:50,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 77082ms 2018-05-24 15:33:50,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 22646ms 2018-05-24 15:33:50,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251828ms 2018-05-24 15:33:50,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 172440ms 2018-05-24 15:33:50,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 25583ms 2018-05-24 15:33:50,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133290ms 2018-05-24 15:33:50,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 10944ms 2018-05-24 15:33:50,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44166ms 2018-05-24 15:33:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 286422ms 2018-05-24 15:33:50,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181520ms 2018-05-24 15:33:50,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89209ms 2018-05-24 15:33:50,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 276833ms 2018-05-24 15:33:50,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 37857ms 2018-05-24 15:33:50,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211579ms 2018-05-24 15:33:50,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 145465ms 2018-05-24 15:33:50,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 23707ms 2018-05-24 15:33:50,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 178880ms 2018-05-24 15:33:50,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279268ms 2018-05-24 15:33:51,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 43580ms 2018-05-24 15:33:51,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 154035ms 2018-05-24 15:33:51,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 279088ms 2018-05-24 15:33:51,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 153130ms 2018-05-24 15:33:51,158 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:51,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 71991ms 2018-05-24 15:33:51,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105679ms 2018-05-24 15:33:51,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 159553ms 2018-05-24 15:33:51,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93011ms 2018-05-24 15:33:51,404 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54617ms 2018-05-24 15:33:51,411 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138920ms 2018-05-24 15:33:51,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 236464ms 2018-05-24 15:33:51,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 161569ms 2018-05-24 15:33:51,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 63484ms 2018-05-24 15:33:51,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100383ms 2018-05-24 15:33:51,704 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 130794ms 2018-05-24 15:33:51,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274974ms 2018-05-24 15:33:51,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55117ms 2018-05-24 15:33:51,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 8808ms 2018-05-24 15:33:51,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 130309ms 2018-05-24 15:33:51,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27881ms 2018-05-24 15:33:52,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205477ms 2018-05-24 15:33:52,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43545ms 2018-05-24 15:33:52,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 267290ms 2018-05-24 15:33:52,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62571ms 2018-05-24 15:33:52,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 234138ms 2018-05-24 15:33:52,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152002ms 2018-05-24 15:33:52,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 238006ms 2018-05-24 15:33:52,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246194ms 2018-05-24 15:33:52,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 205895ms 2018-05-24 15:33:52,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 158620ms 2018-05-24 15:33:52,504 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 54614ms 2018-05-24 15:33:52,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217664ms 2018-05-24 15:33:52,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 149243ms 2018-05-24 15:33:52,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18488ms 2018-05-24 15:33:52,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 274742ms 2018-05-24 15:33:52,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 267916ms 2018-05-24 15:33:52,804 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11091ms 2018-05-24 15:33:52,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87771ms 2018-05-24 15:33:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 141617ms 2018-05-24 15:33:52,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 44005ms 2018-05-24 15:33:53,004 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 46704ms 2018-05-24 15:33:53,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 206768ms 2018-05-24 15:33:53,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 299380ms 2018-05-24 15:33:53,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10743ms 2018-05-24 15:33:53,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 39955ms 2018-05-24 15:33:53,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80314ms 2018-05-24 15:33:53,304 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 138019ms 2018-05-24 15:33:53,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 53894ms 2018-05-24 15:33:53,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 45272ms 2018-05-24 15:33:53,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259778ms 2018-05-24 15:33:53,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5063ms 2018-05-24 15:33:53,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 61111ms 2018-05-24 15:33:53,604 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93261ms 2018-05-24 15:33:53,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81871ms 2018-05-24 15:33:53,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 103443ms 2018-05-24 15:33:53,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79247ms 2018-05-24 15:33:53,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 11917ms 2018-05-24 15:33:53,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100563ms 2018-05-24 15:33:53,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26130ms 2018-05-24 15:33:53,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 93458ms 2018-05-24 15:33:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286557ms 2018-05-24 15:33:54,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 188929ms 2018-05-24 15:33:54,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 245328ms 2018-05-24 15:33:54,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178733ms 2018-05-24 15:33:54,204 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 281985ms 2018-05-24 15:33:54,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61629ms 2018-05-24 15:33:54,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 132897ms 2018-05-24 15:33:54,309 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12528ms 2018-05-24 15:33:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:54,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:54,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. because info has an old edit so flush to free WALs after random delay 83196ms 2018-05-24 15:33:54,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76108ms 2018-05-24 15:33:54,437 INFO [MemStoreFlusher.0] regionserver.HRegion(2572): Flushing 1/1 column families, dataSize=78 B heapSize=232 B 2018-05-24 15:33:54,461 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741846_1022{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:33:54,462 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/.tmp/info/bbdf7b8e2659402eaf6657eb93ecfda1 2018-05-24 15:33:54,465 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741846_1022 size 4898 2018-05-24 15:33:54,465 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741846_1022 size 4898 2018-05-24 15:33:54,470 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/.tmp/info/bbdf7b8e2659402eaf6657eb93ecfda1 as hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/info/bbdf7b8e2659402eaf6657eb93ecfda1 2018-05-24 15:33:54,479 INFO [MemStoreFlusher.0] regionserver.HStore(1070): Added hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/info/bbdf7b8e2659402eaf6657eb93ecfda1, entries=2, sequenceid=6, filesize=4.8 K 2018-05-24 15:33:54,481 INFO [MemStoreFlusher.0] regionserver.HRegion(2781): Finished flush of dataSize ~78 B/78, heapSize ~448 B/448, currentSize=0 B/0 for 9de803c8ab8fedb0c6b8072a4649d9cd in 44ms, sequenceid=6, compaction requested=false 2018-05-24 15:33:54,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234417ms 2018-05-24 15:33:54,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195827ms 2018-05-24 15:33:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:54,711 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56739ms 2018-05-24 15:33:54,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238379ms 2018-05-24 15:33:54,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222728ms 2018-05-24 15:33:55,015 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29849ms 2018-05-24 15:33:55,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9661ms 2018-05-24 15:33:55,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193563ms 2018-05-24 15:33:55,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220537ms 2018-05-24 15:33:55,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8434ms 2018-05-24 15:33:55,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26393ms 2018-05-24 15:33:55,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 213497ms 2018-05-24 15:33:55,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56520ms 2018-05-24 15:33:55,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177818ms 2018-05-24 15:33:55,911 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81196ms 2018-05-24 15:33:56,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130668ms 2018-05-24 15:33:56,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273175ms 2018-05-24 15:33:56,159 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:33:56,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240191ms 2018-05-24 15:33:56,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157350ms 2018-05-24 15:33:56,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195896ms 2018-05-24 15:33:56,516 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81483ms 2018-05-24 15:33:56,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182144ms 2018-05-24 15:33:56,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119727ms 2018-05-24 15:33:56,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264431ms 2018-05-24 15:33:56,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210463ms 2018-05-24 15:33:57,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185360ms 2018-05-24 15:33:57,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36035ms 2018-05-24 15:33:57,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 234759ms 2018-05-24 15:33:57,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3877ms 2018-05-24 15:33:57,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 34458ms 2018-05-24 15:33:57,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142791ms 2018-05-24 15:33:57,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176583ms 2018-05-24 15:33:57,717 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 248692ms 2018-05-24 15:33:57,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46719ms 2018-05-24 15:33:57,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 210150ms 2018-05-24 15:33:58,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266746ms 2018-05-24 15:33:58,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257331ms 2018-05-24 15:33:58,214 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54842ms 2018-05-24 15:33:58,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190093ms 2018-05-24 15:33:58,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228742ms 2018-05-24 15:33:58,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192224ms 2018-05-24 15:33:58,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183205ms 2018-05-24 15:33:58,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224960ms 2018-05-24 15:33:58,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195351ms 2018-05-24 15:33:58,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 223453ms 2018-05-24 15:33:59,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 92596ms 2018-05-24 15:33:59,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195671ms 2018-05-24 15:33:59,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188405ms 2018-05-24 15:33:59,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37399ms 2018-05-24 15:33:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:33:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:33:59,415 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207583ms 2018-05-24 15:33:59,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 111288ms 2018-05-24 15:33:59,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54388ms 2018-05-24 15:33:59,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:33:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:33:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:33:59,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:33:59,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 90869ms 2018-05-24 15:33:59,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286494ms 2018-05-24 15:33:59,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 192690ms 2018-05-24 15:34:00,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203433ms 2018-05-24 15:34:00,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119994ms 2018-05-24 15:34:00,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51436ms 2018-05-24 15:34:00,315 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203475ms 2018-05-24 15:34:00,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224122ms 2018-05-24 15:34:00,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212438ms 2018-05-24 15:34:00,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145902ms 2018-05-24 15:34:00,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 271047ms 2018-05-24 15:34:00,815 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58286ms 2018-05-24 15:34:00,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196655ms 2018-05-24 15:34:01,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265005ms 2018-05-24 15:34:01,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64141ms 2018-05-24 15:34:01,159 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:01,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45540ms 2018-05-24 15:34:01,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91624ms 2018-05-24 15:34:01,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57311ms 2018-05-24 15:34:01,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290104ms 2018-05-24 15:34:01,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140832ms 2018-05-24 15:34:01,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237227ms 2018-05-24 15:34:01,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133987ms 2018-05-24 15:34:01,915 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177695ms 2018-05-24 15:34:02,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110016ms 2018-05-24 15:34:02,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31160ms 2018-05-24 15:34:02,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58859ms 2018-05-24 15:34:02,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 51169ms 2018-05-24 15:34:02,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 76076ms 2018-05-24 15:34:02,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119434ms 2018-05-24 15:34:02,616 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102036ms 2018-05-24 15:34:02,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50425ms 2018-05-24 15:34:02,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 114572ms 2018-05-24 15:34:02,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224162ms 2018-05-24 15:34:03,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91697ms 2018-05-24 15:34:03,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 175577ms 2018-05-24 15:34:03,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151220ms 2018-05-24 15:34:03,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 262035ms 2018-05-24 15:34:03,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42950ms 2018-05-24 15:34:03,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152646ms 2018-05-24 15:34:03,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 86586ms 2018-05-24 15:34:03,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 116777ms 2018-05-24 15:34:03,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 79888ms 2018-05-24 15:34:03,910 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179856ms 2018-05-24 15:34:04,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41895ms 2018-05-24 15:34:04,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286390ms 2018-05-24 15:34:04,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195266ms 2018-05-24 15:34:04,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 297260ms 2018-05-24 15:34:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:04,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:04,416 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 81004ms 2018-05-24 15:34:04,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91098ms 2018-05-24 15:34:04,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 247818ms 2018-05-24 15:34:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:04,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32880ms 2018-05-24 15:34:04,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 201932ms 2018-05-24 15:34:04,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209839ms 2018-05-24 15:34:05,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286130ms 2018-05-24 15:34:05,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 212075ms 2018-05-24 15:34:05,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170039ms 2018-05-24 15:34:05,308 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19759ms 2018-05-24 15:34:05,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200322ms 2018-05-24 15:34:05,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205374ms 2018-05-24 15:34:05,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 150072ms 2018-05-24 15:34:05,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103874ms 2018-05-24 15:34:05,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129154ms 2018-05-24 15:34:05,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246619ms 2018-05-24 15:34:06,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 188068ms 2018-05-24 15:34:06,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277319ms 2018-05-24 15:34:06,160 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:06,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169821ms 2018-05-24 15:34:06,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11096ms 2018-05-24 15:34:06,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 227730ms 2018-05-24 15:34:06,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:34:06,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44958ms 2018-05-24 15:34:06,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65378ms 2018-05-24 15:34:06,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 298896ms 2018-05-24 15:34:06,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19626ms 2018-05-24 15:34:06,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 101616ms 2018-05-24 15:34:07,012 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 194212ms 2018-05-24 15:34:07,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75159ms 2018-05-24 15:34:07,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 129078ms 2018-05-24 15:34:07,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147772ms 2018-05-24 15:34:07,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244513ms 2018-05-24 15:34:07,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 168599ms 2018-05-24 15:34:07,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46197ms 2018-05-24 15:34:07,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185632ms 2018-05-24 15:34:07,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283840ms 2018-05-24 15:34:07,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258892ms 2018-05-24 15:34:08,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199566ms 2018-05-24 15:34:08,110 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12351ms 2018-05-24 15:34:08,212 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288275ms 2018-05-24 15:34:08,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289240ms 2018-05-24 15:34:08,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 219810ms 2018-05-24 15:34:08,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59220ms 2018-05-24 15:34:08,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68124ms 2018-05-24 15:34:08,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157059ms 2018-05-24 15:34:08,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 152762ms 2018-05-24 15:34:08,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 37908ms 2018-05-24 15:34:09,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177132ms 2018-05-24 15:34:09,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 35955ms 2018-05-24 15:34:09,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 245535ms 2018-05-24 15:34:09,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214009ms 2018-05-24 15:34:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:09,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 122503ms 2018-05-24 15:34:09,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93508ms 2018-05-24 15:34:09,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 8169ms 2018-05-24 15:34:09,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:09,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:09,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 181105ms 2018-05-24 15:34:09,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70147ms 2018-05-24 15:34:09,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11397ms 2018-05-24 15:34:10,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138255ms 2018-05-24 15:34:10,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274241ms 2018-05-24 15:34:10,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73806ms 2018-05-24 15:34:10,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252207ms 2018-05-24 15:34:10,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202173ms 2018-05-24 15:34:10,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273879ms 2018-05-24 15:34:10,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 155599ms 2018-05-24 15:34:10,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88450ms 2018-05-24 15:34:10,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45188ms 2018-05-24 15:34:10,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187979ms 2018-05-24 15:34:11,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 133605ms 2018-05-24 15:34:11,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254397ms 2018-05-24 15:34:11,161 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:11,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202347ms 2018-05-24 15:34:11,311 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 163793ms 2018-05-24 15:34:11,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207021ms 2018-05-24 15:34:11,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231866ms 2018-05-24 15:34:11,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88323ms 2018-05-24 15:34:11,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 140157ms 2018-05-24 15:34:11,816 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 178623ms 2018-05-24 15:34:11,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179524ms 2018-05-24 15:34:12,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13080ms 2018-05-24 15:34:12,113 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184435ms 2018-05-24 15:34:12,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 217783ms 2018-05-24 15:34:12,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200982ms 2018-05-24 15:34:12,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3363ms 2018-05-24 15:34:12,512 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258379ms 2018-05-24 15:34:12,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50449ms 2018-05-24 15:34:12,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258545ms 2018-05-24 15:34:12,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62012ms 2018-05-24 15:34:12,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230398ms 2018-05-24 15:34:13,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256589ms 2018-05-24 15:34:13,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 159481ms 2018-05-24 15:34:13,213 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 222733ms 2018-05-24 15:34:13,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 243663ms 2018-05-24 15:34:13,408 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233747ms 2018-05-24 15:34:13,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 142572ms 2018-05-24 15:34:13,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215842ms 2018-05-24 15:34:13,714 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 42968ms 2018-05-24 15:34:13,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242384ms 2018-05-24 15:34:13,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 56705ms 2018-05-24 15:34:14,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257693ms 2018-05-24 15:34:14,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 105392ms 2018-05-24 15:34:14,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 203070ms 2018-05-24 15:34:14,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214649ms 2018-05-24 15:34:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:14,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156838ms 2018-05-24 15:34:14,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77462ms 2018-05-24 15:34:14,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202433ms 2018-05-24 15:34:14,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:14,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2724ms 2018-05-24 15:34:14,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 279871ms 2018-05-24 15:34:14,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214877ms 2018-05-24 15:34:15,013 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29646ms 2018-05-24 15:34:15,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229524ms 2018-05-24 15:34:15,215 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 13749ms 2018-05-24 15:34:15,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128564ms 2018-05-24 15:34:15,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 78598ms 2018-05-24 15:34:15,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211734ms 2018-05-24 15:34:15,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67378ms 2018-05-24 15:34:15,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 182673ms 2018-05-24 15:34:15,812 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256992ms 2018-05-24 15:34:15,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193394ms 2018-05-24 15:34:16,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108592ms 2018-05-24 15:34:16,108 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225561ms 2018-05-24 15:34:16,163 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:16,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107429ms 2018-05-24 15:34:16,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27743ms 2018-05-24 15:34:16,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220392ms 2018-05-24 15:34:16,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270030ms 2018-05-24 15:34:16,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269749ms 2018-05-24 15:34:16,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 215107ms 2018-05-24 15:34:16,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 24392ms 2018-05-24 15:34:16,914 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 139606ms 2018-05-24 15:34:17,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 46727ms 2018-05-24 15:34:17,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232839ms 2018-05-24 15:34:17,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231779ms 2018-05-24 15:34:17,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82404ms 2018-05-24 15:34:17,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 167853ms 2018-05-24 15:34:17,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 296180ms 2018-05-24 15:34:17,613 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270019ms 2018-05-24 15:34:17,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80293ms 2018-05-24 15:34:17,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44502ms 2018-05-24 15:34:17,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 908ms 2018-05-24 15:34:18,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260825ms 2018-05-24 15:34:18,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183369ms 2018-05-24 15:34:18,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240813ms 2018-05-24 15:34:18,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228231ms 2018-05-24 15:34:18,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130517ms 2018-05-24 15:34:18,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19563ms 2018-05-24 15:34:18,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 136478ms 2018-05-24 15:34:18,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 281832ms 2018-05-24 15:34:18,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 57169ms 2018-05-24 15:34:18,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49759ms 2018-05-24 15:34:19,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 211161ms 2018-05-24 15:34:19,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128699ms 2018-05-24 15:34:19,208 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61895ms 2018-05-24 15:34:19,316 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 259128ms 2018-05-24 15:34:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:19,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185167ms 2018-05-24 15:34:19,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 292685ms 2018-05-24 15:34:19,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187428ms 2018-05-24 15:34:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:19,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44339ms 2018-05-24 15:34:19,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 207417ms 2018-05-24 15:34:19,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43112ms 2018-05-24 15:34:20,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 184724ms 2018-05-24 15:34:20,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7299ms 2018-05-24 15:34:20,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 75481ms 2018-05-24 15:34:20,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 39050ms 2018-05-24 15:34:20,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 260796ms 2018-05-24 15:34:20,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218489ms 2018-05-24 15:34:20,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102904ms 2018-05-24 15:34:20,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87425ms 2018-05-24 15:34:20,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104710ms 2018-05-24 15:34:20,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108304ms 2018-05-24 15:34:21,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 41262ms 2018-05-24 15:34:21,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6853ms 2018-05-24 15:34:21,164 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:21,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251639ms 2018-05-24 15:34:21,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45907ms 2018-05-24 15:34:21,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 228927ms 2018-05-24 15:34:21,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 97553ms 2018-05-24 15:34:21,614 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287101ms 2018-05-24 15:34:21,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 64300ms 2018-05-24 15:34:21,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147907ms 2018-05-24 15:34:21,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 14176ms 2018-05-24 15:34:22,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205668ms 2018-05-24 15:34:22,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 17801ms 2018-05-24 15:34:22,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28446ms 2018-05-24 15:34:22,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 146848ms 2018-05-24 15:34:22,412 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195719ms 2018-05-24 15:34:22,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 252045ms 2018-05-24 15:34:22,612 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 214830ms 2018-05-24 15:34:22,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195158ms 2018-05-24 15:34:22,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266564ms 2018-05-24 15:34:22,908 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 58512ms 2018-05-24 15:34:23,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237348ms 2018-05-24 15:34:23,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 7214ms 2018-05-24 15:34:23,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29544ms 2018-05-24 15:34:23,310 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231092ms 2018-05-24 15:34:23,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171881ms 2018-05-24 15:34:23,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9436ms 2018-05-24 15:34:23,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288234ms 2018-05-24 15:34:23,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2437ms 2018-05-24 15:34:23,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100769ms 2018-05-24 15:34:23,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 186676ms 2018-05-24 15:34:24,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 127892ms 2018-05-24 15:34:24,109 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9292ms 2018-05-24 15:34:24,209 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77037ms 2018-05-24 15:34:24,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299746ms 2018-05-24 15:34:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:24,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:24,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98587ms 2018-05-24 15:34:24,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249649ms 2018-05-24 15:34:24,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 36362ms 2018-05-24 15:34:24,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:24,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3079ms 2018-05-24 15:34:24,808 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 62000ms 2018-05-24 15:34:24,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 174378ms 2018-05-24 15:34:25,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102679ms 2018-05-24 15:34:25,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12657ms 2018-05-24 15:34:25,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 204750ms 2018-05-24 15:34:25,305 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45124ms 2018-05-24 15:34:25,414 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 94741ms 2018-05-24 15:34:25,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 288630ms 2018-05-24 15:34:25,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 26964ms 2018-05-24 15:34:25,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 196652ms 2018-05-24 15:34:25,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 242087ms 2018-05-24 15:34:25,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 110829ms 2018-05-24 15:34:26,014 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286445ms 2018-05-24 15:34:26,112 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 5787ms 2018-05-24 15:34:26,166 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:26,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43320ms 2018-05-24 15:34:26,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 202825ms 2018-05-24 15:34:26,409 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 65258ms 2018-05-24 15:34:26,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:34:26,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 55452ms 2018-05-24 15:34:26,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170715ms 2018-05-24 15:34:26,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 106930ms 2018-05-24 15:34:26,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66002ms 2018-05-24 15:34:26,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1467ms 2018-05-24 15:34:27,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 18414ms 2018-05-24 15:34:27,111 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 96482ms 2018-05-24 15:34:27,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88336ms 2018-05-24 15:34:27,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 72556ms 2018-05-24 15:34:27,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 195064ms 2018-05-24 15:34:27,510 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119961ms 2018-05-24 15:34:27,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 283434ms 2018-05-24 15:34:27,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185493ms 2018-05-24 15:34:27,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 30993ms 2018-05-24 15:34:27,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3325ms 2018-05-24 15:34:28,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 63858ms 2018-05-24 15:34:28,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 299353ms 2018-05-24 15:34:28,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 143009ms 2018-05-24 15:34:28,312 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 250769ms 2018-05-24 15:34:28,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277045ms 2018-05-24 15:34:28,506 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 44642ms 2018-05-24 15:34:28,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 40672ms 2018-05-24 15:34:28,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230897ms 2018-05-24 15:34:28,810 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239408ms 2018-05-24 15:34:28,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 286922ms 2018-05-24 15:34:29,010 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246909ms 2018-05-24 15:34:29,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 67399ms 2018-05-24 15:34:29,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 135267ms 2018-05-24 15:34:29,314 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2278ms 2018-05-24 15:34:29,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:29,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:29,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 185530ms 2018-05-24 15:34:29,505 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 277646ms 2018-05-24 15:34:29,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 21886ms 2018-05-24 15:34:29,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:29,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:29,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:29,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 28336ms 2018-05-24 15:34:29,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20597ms 2018-05-24 15:34:29,916 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 88161ms 2018-05-24 15:34:30,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 273336ms 2018-05-24 15:34:30,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 54479ms 2018-05-24 15:34:30,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 265473ms 2018-05-24 15:34:30,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 59966ms 2018-05-24 15:34:30,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 98078ms 2018-05-24 15:34:30,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 165861ms 2018-05-24 15:34:30,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 239282ms 2018-05-24 15:34:30,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20220ms 2018-05-24 15:34:30,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 12840ms 2018-05-24 15:34:30,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 11637ms 2018-05-24 15:34:31,009 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189944ms 2018-05-24 15:34:31,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254662ms 2018-05-24 15:34:31,168 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:31,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93287ms 2018-05-24 15:34:31,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 258927ms 2018-05-24 15:34:31,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293603ms 2018-05-24 15:34:31,508 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289875ms 2018-05-24 15:34:31,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 177403ms 2018-05-24 15:34:31,706 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 287545ms 2018-05-24 15:34:31,809 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10053ms 2018-05-24 15:34:31,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91523ms 2018-05-24 15:34:32,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 25633ms 2018-05-24 15:34:32,115 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 170235ms 2018-05-24 15:34:32,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 112469ms 2018-05-24 15:34:32,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 256057ms 2018-05-24 15:34:32,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 85066ms 2018-05-24 15:34:32,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 38855ms 2018-05-24 15:34:32,615 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 27855ms 2018-05-24 15:34:32,709 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 93872ms 2018-05-24 15:34:32,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 264134ms 2018-05-24 15:34:32,907 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 233380ms 2018-05-24 15:34:33,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 69880ms 2018-05-24 15:34:33,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 68763ms 2018-05-24 15:34:33,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187231ms 2018-05-24 15:34:33,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83574ms 2018-05-24 15:34:33,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237408ms 2018-05-24 15:34:33,514 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 29948ms 2018-05-24 15:34:33,610 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 274019ms 2018-05-24 15:34:33,710 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132139ms 2018-05-24 15:34:33,814 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 209696ms 2018-05-24 15:34:33,913 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263680ms 2018-05-24 15:34:34,008 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 229336ms 2018-05-24 15:34:34,116 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 180228ms 2018-05-24 15:34:34,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205827ms 2018-05-24 15:34:34,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 238902ms 2018-05-24 15:34:34,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:34,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:34,406 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 285812ms 2018-05-24 15:34:34,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 183230ms 2018-05-24 15:34:34,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 157121ms 2018-05-24 15:34:34,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:34,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:34,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:34,712 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 119786ms 2018-05-24 15:34:34,806 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169637ms 2018-05-24 15:34:34,909 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 156540ms 2018-05-24 15:34:35,007 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 176838ms 2018-05-24 15:34:35,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 289027ms 2018-05-24 15:34:35,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31050ms 2018-05-24 15:34:35,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 200883ms 2018-05-24 15:34:35,413 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 218770ms 2018-05-24 15:34:35,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 77109ms 2018-05-24 15:34:35,605 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6597ms 2018-05-24 15:34:35,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 257969ms 2018-05-24 15:34:35,811 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 1913ms 2018-05-24 15:34:35,912 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 169507ms 2018-05-24 15:34:36,011 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19912ms 2018-05-24 15:34:36,114 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230027ms 2018-05-24 15:34:36,169 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:36,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 225354ms 2018-05-24 15:34:36,313 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 249205ms 2018-05-24 15:34:36,410 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 199052ms 2018-05-24 15:34:36,513 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 60642ms 2018-05-24 15:34:36,606 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 120909ms 2018-05-24 15:34:36,707 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 145393ms 2018-05-24 15:34:36,805 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270785ms 2018-05-24 15:34:36,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 293425ms 2018-05-24 15:34:37,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89478ms 2018-05-24 15:34:37,106 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 61689ms 2018-05-24 15:34:37,211 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 102048ms 2018-05-24 15:34:37,307 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70582ms 2018-05-24 15:34:37,407 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 244086ms 2018-05-24 15:34:37,511 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 130209ms 2018-05-24 15:34:37,608 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128700ms 2018-05-24 15:34:37,713 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82906ms 2018-05-24 15:34:37,807 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235072ms 2018-05-24 15:34:37,905 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 149004ms 2018-05-24 15:34:38,006 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 100214ms 2018-05-24 15:34:38,105 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197407ms 2018-05-24 15:34:38,207 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 9033ms 2018-05-24 15:34:38,306 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 31362ms 2018-05-24 15:34:38,405 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190928ms 2018-05-24 15:34:38,507 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 20773ms 2018-05-24 15:34:38,607 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 291513ms 2018-05-24 15:34:38,705 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45264ms 2018-05-24 15:34:38,813 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 138649ms 2018-05-24 15:34:38,906 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 173369ms 2018-05-24 15:34:39,005 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 66110ms 2018-05-24 15:34:39,107 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] regionserver.HRegionServer$PeriodicMemStoreFlusher(1775): MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 160732ms 2018-05-24 15:34:39,109 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy(70): Since none of the CFs were above the size, flushing all. 2018-05-24 15:34:39,109 INFO [MemStoreFlusher.0] regionserver.HRegion(2572): Flushing 3/3 column families, dataSize=5.51 KB heapSize=9.35 KB 2018-05-24 15:34:39,134 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741846_1022{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:34:39,134 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741846_1022{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|FINALIZED]]} size 0 2018-05-24 15:34:39,135 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=5.13 KB at sequenceid=22 (bloomFilter=false), to=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/info/fe84b0781c6747cb9bab3d132535a46a 2018-05-24 15:34:39,135 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741846_1022 size 8187 2018-05-24 15:34:39,159 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741847_1023{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|FINALIZED]]} size 0 2018-05-24 15:34:39,159 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741847_1023 size 4996 2018-05-24 15:34:39,160 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=222 B at sequenceid=22 (bloomFilter=false), to=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/rep_barrier/5c54d0e515f349d5829334c3d709c9de 2018-05-24 15:34:39,160 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741847_1023 size 4996 2018-05-24 15:34:39,182 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741848_1024{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:34:39,182 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741848_1024{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:34:39,183 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741848_1024{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|FINALIZED]]} size 0 2018-05-24 15:34:39,184 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher(85): Flushed memstore data size=172 B at sequenceid=22 (bloomFilter=false), to=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/table/84f3afdb84044083ae5b51e5e28f3f47 2018-05-24 15:34:39,199 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/info/fe84b0781c6747cb9bab3d132535a46a as hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/info/fe84b0781c6747cb9bab3d132535a46a 2018-05-24 15:34:39,206 INFO [MemStoreFlusher.0] regionserver.HStore(1070): Added hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/info/fe84b0781c6747cb9bab3d132535a46a, entries=30, sequenceid=22, filesize=8.0 K 2018-05-24 15:34:39,208 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/rep_barrier/5c54d0e515f349d5829334c3d709c9de as hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/rep_barrier/5c54d0e515f349d5829334c3d709c9de 2018-05-24 15:34:39,215 INFO [MemStoreFlusher.0] regionserver.HStore(1070): Added hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/rep_barrier/5c54d0e515f349d5829334c3d709c9de, entries=2, sequenceid=22, filesize=4.9 K 2018-05-24 15:34:39,216 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem(464): Committing hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/.tmp/table/84f3afdb84044083ae5b51e5e28f3f47 as hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/table/84f3afdb84044083ae5b51e5e28f3f47 2018-05-24 15:34:39,223 INFO [MemStoreFlusher.0] regionserver.HStore(1070): Added hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/table/84f3afdb84044083ae5b51e5e28f3f47, entries=4, sequenceid=22, filesize=4.7 K 2018-05-24 15:34:39,224 INFO [MemStoreFlusher.0] regionserver.HRegion(2781): Finished flush of dataSize ~5.51 KB/5642, heapSize ~9.98 KB/10224, currentSize=0 B/0 for 1588230740 in 115ms, sequenceid=22, compaction requested=false 2018-05-24 15:34:39,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:39,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:39,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:39,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:39,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:41,170 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:44,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:44,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:44,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:44,672 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:44,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:44,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:46,172 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:34:49,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:49,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:49,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:49,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:49,674 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:49,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:51,173 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:53,379 DEBUG [Thread-157-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(427): index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-24 15:34:53,379 DEBUG [Thread-157-MemStoreChunkPool Statistics] regionserver.ChunkCreator$MemStoreChunkPool$StatisticsThread(427): data stats (chunk size=2097152): current pool size=9, created chunk count=13, reused chunk count=1, reuseRatio=7.14% 2018-05-24 15:34:54,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:54,373 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:54,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:54,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:54,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:34:54,845 DEBUG [master/zhangduo-ubuntu:0.Chore.1] replication.ZKReplicationQueueStorage(517): Didn't find a RegionServer that replicates, won't prevent deletions. 2018-05-24 15:34:54,846 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(475): Cleaning under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:34:54,864 INFO [IPC Server handler 8 on 41639] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:45859 127.0.0.1:34749 127.0.0.1:40385 2018-05-24 15:34:54,864 INFO [IPC Server handler 6 on 41639] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:45859 127.0.0.1:40385 127.0.0.1:34749 2018-05-24 15:34:54,865 INFO [IPC Server handler 7 on 41639] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741839_1015 127.0.0.1:45859 127.0.0.1:40385 127.0.0.1:34749 2018-05-24 15:34:54,866 INFO [IPC Server handler 5 on 41639] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:45859 127.0.0.1:34749 127.0.0.1:40385 2018-05-24 15:34:56,059 INFO [master/zhangduo-ubuntu:0.Chore.1] master.HMaster(1423): Not running balancer because 1 region(s) in transition: [rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8] 2018-05-24 15:34:56,061 INFO [RS-EventLoopGroup-3-5] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:34:56,062 INFO [RS-EventLoopGroup-3-5] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 43216 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:34:56,064 DEBUG [ForkJoinPool-1-worker-1] cleaner.CleanerChore$CleanerTask(475): Cleaning under hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/archive 2018-05-24 15:34:56,066 WARN [master/zhangduo-ubuntu:0.Chore.1] master.CatalogJanitor(121): CatalogJanitor is disabled! Enabled=true, maintenanceMode=false, am=org.apache.hadoop.hbase.master.assignment.AssignmentManager@70b690c7, failoverCleanupDone=true, hasRIT=true 2018-05-24 15:34:56,174 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:34:56,512 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:45859 to delete [blk_1073741831_1007, blk_1073741833_1009, blk_1073741838_1014, blk_1073741839_1015] 2018-05-24 15:34:59,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:34:59,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:34:59,498 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(475): Cleaning under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:34:59,502 INFO [IPC Server handler 3 on 38079] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:45001 127.0.0.1:34351 127.0.0.1:39253 2018-05-24 15:34:59,502 INFO [IPC Server handler 0 on 38079] blockmanagement.BlockManager(1169): BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:34351 127.0.0.1:45001 127.0.0.1:39253 2018-05-24 15:34:59,513 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:34749 to delete [blk_1073741831_1007, blk_1073741833_1009, blk_1073741838_1014, blk_1073741839_1015] 2018-05-24 15:34:59,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:34:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:34:59,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:34:59,684 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:00,942 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1d5e5bc6] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:45001 to delete [blk_1073741832_1008, blk_1073741833_1009] 2018-05-24 15:35:01,098 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(528): Auth successful for zhangduo (auth:SIMPLE) 2018-05-24 15:35:01,098 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(558): Connection from 127.0.0.1 port: 46934 with version info: version: "3.0.0-SNAPSHOT" url: "git://zhangduo-ubuntu/home/zhangduo/hbase/code" revision: "ee540c9f9ec83def56ad15138b636271c761ed3a" user: "zhangduo" date: "Thu May 24 11:02:06 CST 2018" src_checksum: "f2113fe5436c7f414d4c6fb07bd0575d" version_major: 3 version_minor: 0 2018-05-24 15:35:01,104 DEBUG [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(295): RegionReplicaHostCostFunction not needed 2018-05-24 15:35:01,104 DEBUG [master/zhangduo-ubuntu:0.Chore.1] balancer.StochasticLoadBalancer(295): RegionReplicaRackCostFunction not needed 2018-05-24 15:35:01,114 DEBUG [ForkJoinPool-1-worker-0] cleaner.CleanerChore$CleanerTask(475): Cleaning under hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/archive 2018-05-24 15:35:01,175 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:01,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2018-05-24 15:35:02,514 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@4666bf81] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:40385 to delete [blk_1073741831_1007, blk_1073741833_1009, blk_1073741838_1014, blk_1073741839_1015] 2018-05-24 15:35:03,943 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1d5e5bc6] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:39253 to delete [blk_1073741832_1008, blk_1073741833_1009] 2018-05-24 15:35:04,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:35:04,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:35:04,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:35:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:35:04,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:35:04,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:06,175 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:06,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46811] master.MasterRpcServices(1143): Checking to see if procedure is done pid=27 2018-05-24 15:35:06,945 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1d5e5bc6] blockmanagement.BlockManager(3483): BLOCK* BlockManager: ask 127.0.0.1:34351 to delete [blk_1073741832_1008, blk_1073741833_1009] 2018-05-24 15:35:09,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:35:09,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:35:09,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:35:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:35:09,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:35:09,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:11,175 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:14,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:35:14,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:35:14,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:35:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:35:14,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:35:14,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:16,176 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:19,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:35:19,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:35:19,646 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:35:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:35:19,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:35:19,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:21,177 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:24,366 INFO [zhangduo-ubuntu:46367Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C46367%2C1527146693128]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,46367,1527146693128/zhangduo-ubuntu%2C46367%2C1527146693128.1527146695399 at position: -1 2018-05-24 15:35:24,372 INFO [zhangduo-ubuntu:38897Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C38897%2C1527146693212]: currently replicating from: hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/WALs/zhangduo-ubuntu,38897,1527146693212/zhangduo-ubuntu%2C38897%2C1527146693212.1527146695401 at position: -1 2018-05-24 15:35:24,647 INFO [zhangduo-ubuntu:42271Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C42271%2C1527146699039]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,42271,1527146699039/zhangduo-ubuntu%2C42271%2C1527146699039.1527146708027 at position: -1 2018-05-24 15:35:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C34061%2C1527146698952]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,34061,1527146698952/zhangduo-ubuntu%2C34061%2C1527146698952.1527146708017 at position: -1 2018-05-24 15:35:24,673 INFO [zhangduo-ubuntu:34061Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Sink: age in ms of last applied edit: 0, total replicated edits: 1 2018-05-24 15:35:24,683 INFO [zhangduo-ubuntu:37499Replication Statistics #0] regionserver.Replication$ReplicationStatisticsTask(250): Normal source for cluster 1: Total replicated edits: 0, current progress: walGroup [zhangduo-ubuntu%2C37499%2C1527146699007]: currently replicating from: hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/WALs/zhangduo-ubuntu,37499,1527146699007/zhangduo-ubuntu%2C37499%2C1527146699007.1527146708034 at position: -1 2018-05-24 15:35:26,179 WARN [ProcExecTimeout] assignment.AssignmentManager(1201): STUCK Region-In-Transition rit=CLOSING, location=zhangduo-ubuntu,39191,1527146693279, table=SyncRep, region=12bc853c9c26f021bc64e25ae2f0bff8 2018-05-24 15:35:26,435 INFO [Time-limited test] hbase.HBaseTestingUtility(1094): Shutting down minicluster 2018-05-24 15:35:26,435 INFO [Time-limited test] client.ConnectionImplementation(1763): Closing master protocol: MasterService 2018-05-24 15:35:26,436 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x5e8870bc to localhost:59029 2018-05-24 15:35:26,436 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,436 DEBUG [Time-limited test] util.JVMClusterUtil(238): Shutting down HBase Cluster 2018-05-24 15:35:26,436 INFO [Time-limited test] master.ServerManager(958): Cluster shutdown requested of master=zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:35:26,439 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/running 2018-05-24 15:35:26,439 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/running 2018-05-24 15:35:26,439 INFO [Time-limited test] procedure2.ProcedureExecutor(588): Stopping 2018-05-24 15:35:26,439 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/running 2018-05-24 15:35:26,439 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:35:26,441 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x6b3915ea to localhost:59029 2018-05-24 15:35:26,441 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:35:26,441 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/running 2018-05-24 15:35:26,441 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,443 INFO [Time-limited test] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,46367,1527146693128' ***** 2018-05-24 15:35:26,443 INFO [Time-limited test] regionserver.HRegionServer(2163): STOPPED: Shutdown requested 2018-05-24 15:35:26,443 INFO [Time-limited test] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,38897,1527146693212' ***** 2018-05-24 15:35:26,443 INFO [Time-limited test] regionserver.HRegionServer(2163): STOPPED: Shutdown requested 2018-05-24 15:35:26,443 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:35:26,443 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:35:26,443 INFO [SplitLogWorker-zhangduo-ubuntu:46367] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:35:26,443 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:35:26,443 INFO [SplitLogWorker-zhangduo-ubuntu:46367] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,46367,1527146693128 exiting 2018-05-24 15:35:26,444 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:35:26,443 INFO [SplitLogWorker-zhangduo-ubuntu:38897] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:35:26,444 INFO [SplitLogWorker-zhangduo-ubuntu:38897] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,38897,1527146693212 exiting 2018-05-24 15:35:26,443 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:35:26,444 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:35:26,444 INFO [RS:1;zhangduo-ubuntu:38897] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager gracefully. 2018-05-24 15:35:26,444 INFO [RS:1;zhangduo-ubuntu:38897] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2018-05-24 15:35:26,444 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:35:26,444 DEBUG [RS:1;zhangduo-ubuntu:38897] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:26,444 INFO [RS:0;zhangduo-ubuntu:46367] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager gracefully. 2018-05-24 15:35:26,446 INFO [RS:0;zhangduo-ubuntu:46367] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2018-05-24 15:35:26,444 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:35:26,446 INFO [RS:1;zhangduo-ubuntu:38897] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x6079590f to localhost:59029 2018-05-24 15:35:26,446 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:35:26,446 DEBUG [RS:0;zhangduo-ubuntu:46367] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:26,446 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:35:26,446 INFO [RS:0;zhangduo-ubuntu:46367] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x0b61cf03 to localhost:59029 2018-05-24 15:35:26,447 DEBUG [RS:0;zhangduo-ubuntu:46367] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,446 DEBUG [RS:1;zhangduo-ubuntu:38897] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,448 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:35:26,448 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:35:26,448 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:35:26,448 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,38897,1527146693212; all regions closed. 2018-05-24 15:35:26,448 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 9de803c8ab8fedb0c6b8072a4649d9cd, disabling compactions & flushes 2018-05-24 15:35:26,449 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:35:26,449 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1400): Waiting on 2 regions to close 2018-05-24 15:35:26,450 DEBUG [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1404): Online Regions={9de803c8ab8fedb0c6b8072a4649d9cd=hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd., 1588230740=hbase:meta,,1.1588230740} 2018-05-24 15:35:26,450 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 1588230740, disabling compactions & flushes 2018-05-24 15:35:26,450 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region hbase:meta,,1.1588230740 2018-05-24 15:35:26,463 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741830_1006{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,463 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741830_1006{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,468 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741830_1006{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-2a788e78-421e-43b8-b8a8-c19fa49f729a:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-0fbf65d7-e2f6-4d52-84da-3db1aade4fdd:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-e0952bf6-c8a5-4968-a264-e4885ae83da0:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,479 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=17 2018-05-24 15:35:26,484 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:35:26,485 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:41639/user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/data/hbase/namespace/9de803c8ab8fedb0c6b8072a4649d9cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2018-05-24 15:35:26,485 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(288): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-24 15:35:26,487 DEBUG [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(860): Moved 1 WAL file(s) to /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:35:26,487 INFO [RS:1;zhangduo-ubuntu:38897] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C38897%2C1527146693212:(num 1527146695401) 2018-05-24 15:35:26,487 DEBUG [RS:1;zhangduo-ubuntu:38897] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,488 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.Leases(149): Closed leases 2018-05-24 15:35:26,488 INFO [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed hbase:meta,,1.1588230740 2018-05-24 15:35:26,488 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed hbase:meta,,1.1588230740 2018-05-24 15:35:26,489 INFO [RS:1;zhangduo-ubuntu:38897] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,38897,1527146693212 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 100 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:26,494 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:35:26,494 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:35:26,494 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed hbase:namespace,,1527146696083.9de803c8ab8fedb0c6b8072a4649d9cd. 2018-05-24 15:35:26,494 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:35:26,495 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:35:26,495 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:35:26,495 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:35:26,495 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C38897%2C1527146693212,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:35:26,499 INFO [RS:1;zhangduo-ubuntu:38897] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x75daa34b to localhost:59029 2018-05-24 15:35:26,500 DEBUG [RS:1;zhangduo-ubuntu:38897] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,502 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C38897%2C1527146693212,1 terminated 2018-05-24 15:35:26,503 INFO [RS:1;zhangduo-ubuntu:38897] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:38897 2018-05-24 15:35:26,509 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(180): Chore: MemstoreFlusherChore was stopped 2018-05-24 15:35:26,510 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:35:26,510 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:35:26,510 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,38897,1527146693212] 2018-05-24 15:35:26,511 INFO [Time-limited test-EventThread] master.ServerManager(589): Cluster shutdown set; zhangduo-ubuntu,38897,1527146693212 expired; onlineServers=1 2018-05-24 15:35:26,511 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:35:26,510 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:35:26,510 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,38897,1527146693212 2018-05-24 15:35:26,511 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:38897-0x16391092ecc0002, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:35:26,513 INFO [RS:1;zhangduo-ubuntu:38897] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,38897,1527146693212; zookeeper connection closed. 2018-05-24 15:35:26,514 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on existing znode=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:35:26,514 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2062dc3b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2062dc3b 2018-05-24 15:35:26,527 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:35:26,651 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,46367,1527146693128; all regions closed. 2018-05-24 15:35:26,662 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:35:26,662 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:35:26,664 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 0 2018-05-24 15:35:26,668 DEBUG [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(860): Moved 1 WAL file(s) to /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:35:26,668 INFO [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C46367%2C1527146693128.meta:.meta(num 1527146719267) 2018-05-24 15:35:26,674 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,674 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,674 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741832_1008{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW], ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW]]} size 0 2018-05-24 15:35:26,677 DEBUG [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(860): Moved 1 WAL file(s) to /user/zhangduo/test-data/0541544e-fcee-4679-b836-939cacc32e77/oldWALs 2018-05-24 15:35:26,677 INFO [RS:0;zhangduo-ubuntu:46367] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C46367%2C1527146693128:(num 1527146695399) 2018-05-24 15:35:26,677 DEBUG [RS:0;zhangduo-ubuntu:46367] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,677 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.Leases(149): Closed leases 2018-05-24 15:35:26,678 INFO [RS:0;zhangduo-ubuntu:46367] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,46367,1527146693128 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:26,678 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:35:26,679 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:35:26,679 WARN [RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.wal-reader.zhangduo-ubuntu%2C46367%2C1527146693128,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:35:26,683 INFO [RS:0;zhangduo-ubuntu:46367] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x0e0fe6a7 to localhost:59029 2018-05-24 15:35:26,684 DEBUG [RS:0;zhangduo-ubuntu:46367] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,685 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.ReplicationSource(507): ReplicationSourceWorker RS_REFRESH_PEER-regionserver/zhangduo-ubuntu:0-1.replicationSource,1.replicationSource.shipperzhangduo-ubuntu%2C46367%2C1527146693128,1 terminated 2018-05-24 15:35:26,686 INFO [RS:0;zhangduo-ubuntu:46367] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:46367 2018-05-24 15:35:26,690 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:46367-0x16391092ecc0001, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:35:26,690 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/rs/zhangduo-ubuntu,46367,1527146693128 2018-05-24 15:35:26,690 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,46367,1527146693128] 2018-05-24 15:35:26,690 INFO [Time-limited test-EventThread] master.ServerManager(589): Cluster shutdown set; zhangduo-ubuntu,46367,1527146693128 expired; onlineServers=0 2018-05-24 15:35:26,690 INFO [Time-limited test-EventThread] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,46811,1527146692264' ***** 2018-05-24 15:35:26,690 INFO [Time-limited test-EventThread] regionserver.HRegionServer(2163): STOPPED: Cluster shutdown set; onlineServer=0 2018-05-24 15:35:26,691 DEBUG [M:0;zhangduo-ubuntu:46811] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6878a45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:35:26,692 INFO [M:0;zhangduo-ubuntu:46811] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,46811,1527146692264 2018-05-24 15:35:26,692 DEBUG [M:0;zhangduo-ubuntu:46811] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:26,692 INFO [M:0;zhangduo-ubuntu:46811] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,46811,1527146692264; all regions closed. 2018-05-24 15:35:26,692 DEBUG [M:0;zhangduo-ubuntu:46811] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:26,692 INFO [M:0;zhangduo-ubuntu:46811] hbase.ChoreService(327): Chore service for: master/zhangduo-ubuntu:0 had [[ScheduledChore: Name: zhangduo-ubuntu,46811,1527146692264-ExpiredMobFileCleanerChore Period: 86400 Unit: SECONDS], [ScheduledChore: Name: zhangduo-ubuntu,46811,1527146692264-RegionNormalizerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,46811,1527146692264-BalancerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: LogsCleaner Period: 600000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,46811,1527146692264-MobCompactionChore Period: 604800 Unit: SECONDS], [ScheduledChore: Name: ReplicationBarrierCleaner Period: 43200000 Unit: MILLISECONDS], [ScheduledChore: Name: HFileCleaner Period: 600000 Unit: MILLISECONDS], [ScheduledChore: Name: CatalogJanitor-zhangduo-ubuntu:46811 Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,46811,1527146692264-ClusterStatusChore Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:26,692 INFO [M:0;zhangduo-ubuntu:46811] master.MasterMobCompactionThread(175): Waiting for Mob Compaction Thread to finish... 2018-05-24 15:35:26,692 INFO [M:0;zhangduo-ubuntu:46811] master.MasterMobCompactionThread(175): Waiting for Region Server Mob Compaction Thread to finish... 2018-05-24 15:35:26,692 DEBUG [M:0;zhangduo-ubuntu:46811] master.HMaster(1228): Stopping service threads 2018-05-24 15:35:26,692 DEBUG [OldWALsCleaner-0] cleaner.LogCleaner(176): Exiting cleaner. 2018-05-24 15:35:26,692 DEBUG [Thread-157-HFileCleaner.small.0-1527146694069] cleaner.HFileCleaner(253): Exit Thread[Thread-157-HFileCleaner.small.0-1527146694069,5,FailOnTimeoutGroup] 2018-05-24 15:35:26,692 DEBUG [Thread-157-HFileCleaner.large.0-1527146694059] cleaner.HFileCleaner(253): Exit Thread[Thread-157-HFileCleaner.large.0-1527146694059,5,FailOnTimeoutGroup] 2018-05-24 15:35:26,692 DEBUG [OldWALsCleaner-1] cleaner.LogCleaner(176): Exiting cleaner. 2018-05-24 15:35:26,694 INFO [RS:0;zhangduo-ubuntu:46367] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,46367,1527146693128; zookeeper connection closed. 2018-05-24 15:35:26,695 INFO [M:0;zhangduo-ubuntu:46811] assignment.AssignmentManager(234): Stopping assignment manager 2018-05-24 15:35:26,695 DEBUG [Time-limited test-EventThread] zookeeper.RecoverableZooKeeper(176): Node /cluster1/master already deleted, retry=false 2018-05-24 15:35:26,696 DEBUG [Time-limited test-EventThread] master.ActiveMasterManager(280): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Failed delete of our master address node; KeeperErrorCode = NoNode for /cluster1/master 2018-05-24 15:35:26,696 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster1/rs 2018-05-24 15:35:26,696 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster1/master 2018-05-24 15:35:26,696 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@405c0ece] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@405c0ece 2018-05-24 15:35:26,698 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): master:46811-0x16391092ecc0000, quorum=localhost:59029, baseZNode=/cluster1 Set watcher on znode that does not yet exist, /cluster1/master 2018-05-24 15:35:26,698 INFO [Time-limited test] util.JVMClusterUtil(326): Shutdown of 1 master(s) and 3 regionserver(s) complete 2018-05-24 15:35:26,699 INFO [M:0;zhangduo-ubuntu:46811] procedure2.RemoteProcedureDispatcher(116): Stopping procedure remote dispatcher 2018-05-24 15:35:26,700 INFO [M:0;zhangduo-ubuntu:46811] wal.WALProcedureStore(290): Stopping the WAL Procedure Store, isAbort=false 2018-05-24 15:35:26,710 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45859 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 214 2018-05-24 15:35:26,713 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34749 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 214 2018-05-24 15:35:26,713 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:40385 is added to blk_1073741829_1005{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-77a0454e-e42a-47c6-abf9-5d05341de1b8:NORMAL:127.0.0.1:45859|RBW], ReplicaUC[[DISK]DS-65746aac-e5e4-4474-b835-d3d17c2bfc20:NORMAL:127.0.0.1:40385|RBW], ReplicaUC[[DISK]DS-08830373-3d87-445b-b412-c1b527de7a64:NORMAL:127.0.0.1:34749|RBW]]} size 214 2018-05-24 15:35:26,716 INFO [M:0;zhangduo-ubuntu:46811] hbase.ChoreService(327): Chore service for: master/zhangduo-ubuntu:0.splitLogManager. had [[ScheduledChore: Name: SplitLogManager Timeout Monitor Period: 1000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:26,716 INFO [M:0;zhangduo-ubuntu:46811] flush.MasterFlushTableProcedureManager(81): stop: server shutting down. 2018-05-24 15:35:26,717 INFO [M:0;zhangduo-ubuntu:46811] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:46811 2018-05-24 15:35:26,720 DEBUG [M:0;zhangduo-ubuntu:46811] zookeeper.RecoverableZooKeeper(176): Node /cluster1/rs/zhangduo-ubuntu,46811,1527146692264 already deleted, retry=false 2018-05-24 15:35:26,722 INFO [M:0;zhangduo-ubuntu:46811] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,46811,1527146692264; zookeeper connection closed. 2018-05-24 15:35:26,723 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:26,729 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:26,833 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:41639] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:26,833 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:41639] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-746025523-127.0.1.1-1527146689183 (Datanode Uuid a1f333d7-dd6a-42f5-89c1-4bdd87d38d9e) service to localhost/127.0.0.1:41639 2018-05-24 15:35:26,835 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:26,841 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:26,943 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:41639] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:26,943 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:41639] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-746025523-127.0.1.1-1527146689183 (Datanode Uuid 8678fa9b-2fa8-4b26-9691-42c75c7ec67c) service to localhost/127.0.0.1:41639 2018-05-24 15:35:26,944 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:26,949 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:27,051 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:41639] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:27,051 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/31e02660-1366-4769-a83c-59eb1107206a/cluster_9a2f2917-e55c-4c6f-b4ba-589315ca838d/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:41639] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-746025523-127.0.1.1-1527146689183 (Datanode Uuid 07d13644-69cc-4676-aa76-1b28cca0517a) service to localhost/127.0.0.1:41639 2018-05-24 15:35:27,069 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:27,186 INFO [Time-limited test] hbase.HBaseTestingUtility(1105): Minicluster is down 2018-05-24 15:35:27,187 INFO [Time-limited test] hbase.HBaseTestingUtility(1094): Shutting down minicluster 2018-05-24 15:35:27,187 INFO [Time-limited test] client.ConnectionImplementation(1763): Closing master protocol: MasterService 2018-05-24 15:35:27,187 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x49ac7b18 to localhost:59029 2018-05-24 15:35:27,187 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,187 DEBUG [Time-limited test] util.JVMClusterUtil(238): Shutting down HBase Cluster 2018-05-24 15:35:27,187 INFO [Time-limited test] master.ServerManager(958): Cluster shutdown requested of master=zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/running 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/running 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/running 2018-05-24 15:35:27,188 INFO [Time-limited test] procedure2.ProcedureExecutor(588): Stopping 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/running 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:35:27,188 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:35:27,189 INFO [Time-limited test] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x7b004625 to localhost:59029 2018-05-24 15:35:27,193 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/running 2018-05-24 15:35:27,193 DEBUG [Time-limited test] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,193 INFO [Time-limited test] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,34061,1527146698952' ***** 2018-05-24 15:35:27,193 INFO [Time-limited test] regionserver.HRegionServer(2163): STOPPED: Shutdown requested 2018-05-24 15:35:27,194 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:35:27,194 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:35:27,194 INFO [Time-limited test] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,37499,1527146699007' ***** 2018-05-24 15:35:27,194 INFO [SplitLogWorker-zhangduo-ubuntu:34061] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:35:27,194 INFO [SplitLogWorker-zhangduo-ubuntu:34061] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,34061,1527146698952 exiting 2018-05-24 15:35:27,194 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:35:27,194 INFO [Time-limited test] regionserver.HRegionServer(2163): STOPPED: Shutdown requested 2018-05-24 15:35:27,197 INFO [Time-limited test] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,42271,1527146699039' ***** 2018-05-24 15:35:27,197 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:35:27,197 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:35:27,197 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:35:27,197 INFO [RS:1;zhangduo-ubuntu:37499] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager gracefully. 2018-05-24 15:35:27,197 INFO [RS:1;zhangduo-ubuntu:37499] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2018-05-24 15:35:27,198 INFO [SplitLogWorker-zhangduo-ubuntu:37499] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:35:27,198 INFO [SplitLogWorker-zhangduo-ubuntu:37499] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,37499,1527146699007 exiting 2018-05-24 15:35:27,198 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:35:27,198 DEBUG [RS:1;zhangduo-ubuntu:37499] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:27,198 INFO [RS:1;zhangduo-ubuntu:37499] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x6e960057 to localhost:59029 2018-05-24 15:35:27,198 DEBUG [RS:1;zhangduo-ubuntu:37499] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,199 INFO [Time-limited test] regionserver.HRegionServer(2163): STOPPED: Shutdown requested 2018-05-24 15:35:27,199 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.SplitLogWorker(241): Sending interrupt to stop the worker thread 2018-05-24 15:35:27,199 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HeapMemoryManager(221): Stopping 2018-05-24 15:35:27,199 INFO [SplitLogWorker-zhangduo-ubuntu:42271] regionserver.SplitLogWorker(223): SplitLogWorker interrupted. Exiting. 2018-05-24 15:35:27,199 INFO [SplitLogWorker-zhangduo-ubuntu:42271] regionserver.SplitLogWorker(232): SplitLogWorker zhangduo-ubuntu,42271,1527146699039 exiting 2018-05-24 15:35:27,199 INFO [RS:2;zhangduo-ubuntu:42271] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager gracefully. 2018-05-24 15:35:27,199 INFO [RS:2;zhangduo-ubuntu:42271] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2018-05-24 15:35:27,201 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:35:27,201 DEBUG [RS:2;zhangduo-ubuntu:42271] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:27,201 INFO [RS:0;zhangduo-ubuntu:34061] flush.RegionServerFlushTableProcedureManager(116): Stopping region server flush procedure manager gracefully. 2018-05-24 15:35:27,201 INFO [RS:2;zhangduo-ubuntu:42271] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x382bdaa4 to localhost:59029 2018-05-24 15:35:27,201 DEBUG [RS:2;zhangduo-ubuntu:42271] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,201 INFO [RS:0;zhangduo-ubuntu:34061] snapshot.RegionServerSnapshotManager(136): Stopping RegionServerSnapshotManager gracefully. 2018-05-24 15:35:27,202 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:35:27,202 DEBUG [RS:0;zhangduo-ubuntu:34061] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:27,202 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:35:27,202 INFO [RS:0;zhangduo-ubuntu:34061] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x3ce1e6d8 to localhost:59029 2018-05-24 15:35:27,202 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:35:27,202 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.1 exiting 2018-05-24 15:35:27,202 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,204 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1400): Waiting on 1 regions to close 2018-05-24 15:35:27,204 DEBUG [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1404): Online Regions={338f611b3d7ef43c4ac40748d46eac23=SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23.} 2018-05-24 15:35:27,204 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 338f611b3d7ef43c4ac40748d46eac23, disabling compactions & flushes 2018-05-24 15:35:27,205 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:35:27,206 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:35:27,206 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:35:27,206 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:35:27,206 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1400): Waiting on 1 regions to close 2018-05-24 15:35:27,206 DEBUG [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1404): Online Regions={1588230740=hbase:meta,,1.1588230740} 2018-05-24 15:35:27,205 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing d77868aa490028a29e5134871d432554, disabling compactions & flushes 2018-05-24 15:35:27,205 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1400): Waiting on 1 regions to close 2018-05-24 15:35:27,206 DEBUG [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1404): Online Regions={d77868aa490028a29e5134871d432554=hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554.} 2018-05-24 15:35:27,206 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1515): Closing 1588230740, disabling compactions & flushes 2018-05-24 15:35:27,206 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region hbase:meta,,1.1588230740 2018-05-24 15:35:27,205 INFO [regionserver/zhangduo-ubuntu:0.Chore.2] hbase.ScheduledChore(180): Chore: MemstoreFlusherChore was stopped 2018-05-24 15:35:27,204 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(383): MemStoreFlusher.0 exiting 2018-05-24 15:35:27,207 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1555): Updates disabled for region hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:35:27,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.3] hbase.ScheduledChore(180): Chore: MemstoreFlusherChore was stopped 2018-05-24 15:35:27,206 INFO [regionserver/zhangduo-ubuntu:0.Chore.1] hbase.ScheduledChore(180): Chore: MemstoreFlusherChore was stopped 2018-05-24 15:35:27,222 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,228 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/default/SyncRep/338f611b3d7ef43c4ac40748d46eac23/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=8 2018-05-24 15:35:27,228 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/namespace/d77868aa490028a29e5134871d432554/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=9 2018-05-24 15:35:27,230 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:35:27,231 INFO [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:35:27,231 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed SyncRep,,1527146703589.338f611b3d7ef43c4ac40748d46eac23. 2018-05-24 15:35:27,231 DEBUG [RS_CLOSE_REGION-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed hbase:namespace,,1527146701100.d77868aa490028a29e5134871d432554. 2018-05-24 15:35:27,232 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,233 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] wal.WALSplitter(677): Wrote file=hdfs://localhost:38079/user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/data/hbase/meta/1588230740/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2018-05-24 15:35:27,234 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] coprocessor.CoprocessorHost(288): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-24 15:35:27,234 INFO [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] regionserver.HRegion(1669): Closed hbase:meta,,1.1588230740 2018-05-24 15:35:27,234 DEBUG [RS_CLOSE_META-regionserver/zhangduo-ubuntu:0-0] handler.CloseRegionHandler(124): Closed hbase:meta,,1.1588230740 2018-05-24 15:35:27,280 INFO [regionserver/zhangduo-ubuntu:0.leaseChecker] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,405 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,37499,1527146699007; all regions closed. 2018-05-24 15:35:27,406 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,42271,1527146699039; all regions closed. 2018-05-24 15:35:27,408 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,34061,1527146698952; all regions closed. 2018-05-24 15:35:27,409 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:35:27,409 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:35:27,412 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741840_1016{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 0 2018-05-24 15:35:27,419 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741842_1018{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:35:27,421 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741842_1018 size 4265 2018-05-24 15:35:27,421 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741842_1018 size 4265 2018-05-24 15:35:27,421 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:35:27,422 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:35:27,426 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741839_1015{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW]]} size 0 2018-05-24 15:35:27,427 DEBUG [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(860): Moved 1 WAL file(s) to /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:35:27,427 INFO [RS:1;zhangduo-ubuntu:37499] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C37499%2C1527146699007:(num 1527146708034) 2018-05-24 15:35:27,427 DEBUG [RS:1;zhangduo-ubuntu:37499] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,427 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,428 INFO [RS:1;zhangduo-ubuntu:37499] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,37499,1527146699007 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:27,428 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:35:27,428 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:35:27,428 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:35:27,429 DEBUG [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(860): Moved 2 WAL file(s) to /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:35:27,429 INFO [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C42271%2C1527146699039.meta:.meta(num 1527146708333) 2018-05-24 15:35:27,429 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:35:27,430 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:35:27,430 WARN [regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.wal-reader.zhangduo-ubuntu%2C37499%2C1527146699007,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:35:27,431 DEBUG [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(860): Moved 1 WAL file(s) to /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:35:27,431 INFO [RS:0;zhangduo-ubuntu:34061] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C34061%2C1527146698952:(num 1527146708017) 2018-05-24 15:35:27,431 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,431 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,431 INFO [RS:0;zhangduo-ubuntu:34061] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,34061,1527146698952 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:27,433 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.CompactSplit(394): Waiting for Split Thread to finish... 2018-05-24 15:35:27,433 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.CompactSplit(394): Waiting for Large Compaction Thread to finish... 2018-05-24 15:35:27,433 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.CompactSplit(394): Waiting for Small Compaction Thread to finish... 2018-05-24 15:35:27,433 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:35:27,434 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:35:27,434 INFO [RS:1;zhangduo-ubuntu:37499] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x0a52ac6a to localhost:59029 2018-05-24 15:35:27,434 DEBUG [RS:1;zhangduo-ubuntu:37499] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,434 WARN [regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.wal-reader.zhangduo-ubuntu%2C34061%2C1527146698952,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:35:27,437 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.ReplicationSource(507): ReplicationSourceWorker regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.shipperzhangduo-ubuntu%2C37499%2C1527146699007,1 terminated 2018-05-24 15:35:27,440 INFO [RS:0;zhangduo-ubuntu:34061] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x49961abb to localhost:59029 2018-05-24 15:35:27,440 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,442 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.ReplicationSource(507): ReplicationSourceWorker regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.shipperzhangduo-ubuntu%2C34061%2C1527146698952,1 terminated 2018-05-24 15:35:27,442 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:35:27,442 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:35:27,441 INFO [RS:1;zhangduo-ubuntu:37499] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:37499 2018-05-24 15:35:27,442 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741841_1017{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-3b396433-7c05-4241-ac25-f012e6c4eb69:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-85003ea0-aa94-4757-8e9e-555a470316f1:NORMAL:127.0.0.1:34351|RBW], ReplicaUC[[DISK]DS-fd88ada0-288d-40c1-a32e-9ccc11be7f88:NORMAL:127.0.0.1:45001|RBW]]} size 0 2018-05-24 15:35:27,442 INFO [RS:0;zhangduo-ubuntu:34061] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x6cea8634 to localhost:59029 2018-05-24 15:35:27,442 DEBUG [RS:0;zhangduo-ubuntu:34061] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,446 INFO [RS:0;zhangduo-ubuntu:34061] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:34061 2018-05-24 15:35:27,447 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:35:27,447 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:35:27,448 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:35:27,448 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:35:27,448 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,37499,1527146699007] 2018-05-24 15:35:27,448 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,37499,1527146699007 2018-05-24 15:35:27,448 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:37499-0x16391092ecc000c, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:35:27,449 INFO [Time-limited test-EventThread] master.ServerManager(589): Cluster shutdown set; zhangduo-ubuntu,37499,1527146699007 expired; onlineServers=2 2018-05-24 15:35:27,448 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:35:27,449 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:35:27,449 INFO [RS:1;zhangduo-ubuntu:37499] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,37499,1527146699007; zookeeper connection closed. 2018-05-24 15:35:27,450 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:34061-0x16391092ecc000b, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:35:27,450 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:35:27,450 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4cdc0891] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4cdc0891 2018-05-24 15:35:27,451 INFO [RS:0;zhangduo-ubuntu:34061] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,34061,1527146698952; zookeeper connection closed. 2018-05-24 15:35:27,452 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(355): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on existing znode=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:35:27,452 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76fb7dcc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76fb7dcc 2018-05-24 15:35:27,452 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,34061,1527146698952 2018-05-24 15:35:27,452 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,34061,1527146698952] 2018-05-24 15:35:27,452 INFO [Time-limited test-EventThread] master.ServerManager(589): Cluster shutdown set; zhangduo-ubuntu,34061,1527146698952 expired; onlineServers=1 2018-05-24 15:35:27,455 DEBUG [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(860): Moved 2 WAL file(s) to /user/zhangduo/test-data/492e14d0-40fb-4c26-90e4-e5e2030ff12d/oldWALs 2018-05-24 15:35:27,455 INFO [RS:2;zhangduo-ubuntu:42271] wal.AbstractFSWAL(863): Closed WAL: AsyncFSWAL zhangduo-ubuntu%2C42271%2C1527146699039:(num 1527146708027) 2018-05-24 15:35:27,455 DEBUG [RS:2;zhangduo-ubuntu:42271] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,455 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.Leases(149): Closed leases 2018-05-24 15:35:27,455 INFO [RS:2;zhangduo-ubuntu:42271] hbase.ChoreService(327): Chore service for: regionserver/zhangduo-ubuntu:0 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region zhangduo-ubuntu,42271,1527146699039 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:27,456 INFO [regionserver/zhangduo-ubuntu:0.logRoller] regionserver.LogRoller(222): LogRoller exiting. 2018-05-24 15:35:27,456 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.ReplicationSource(481): Closing source 1 because: Region server is closing 2018-05-24 15:35:27,459 WARN [regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.wal-reader.zhangduo-ubuntu%2C42271%2C1527146699039,1] util.Threads(150): sleep interrupted java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.util.Threads.sleep(Threads.java:148) at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:130) 2018-05-24 15:35:27,459 INFO [RS:2;zhangduo-ubuntu:42271] zookeeper.ReadOnlyZKClient(350): Close zookeeper connection 0x06a8c374 to localhost:59029 2018-05-24 15:35:27,460 DEBUG [RS:2;zhangduo-ubuntu:42271] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,461 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.ReplicationSource(507): ReplicationSourceWorker regionserver/zhangduo-ubuntu:0.logRoller.replicationSource.shipperzhangduo-ubuntu%2C42271%2C1527146699039,1 terminated 2018-05-24 15:35:27,461 INFO [RS:2;zhangduo-ubuntu:42271] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:42271 2018-05-24 15:35:27,464 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): regionserver:42271-0x16391092ecc000d, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:35:27,464 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/rs/zhangduo-ubuntu,42271,1527146699039 2018-05-24 15:35:27,464 INFO [Time-limited test-EventThread] master.RegionServerTracker(132): RegionServer ephemeral node deleted, processing expiration [zhangduo-ubuntu,42271,1527146699039] 2018-05-24 15:35:27,464 INFO [Time-limited test-EventThread] master.ServerManager(589): Cluster shutdown set; zhangduo-ubuntu,42271,1527146699039 expired; onlineServers=0 2018-05-24 15:35:27,464 INFO [Time-limited test-EventThread] regionserver.HRegionServer(2149): ***** STOPPING region server 'zhangduo-ubuntu,39993,1527146698913' ***** 2018-05-24 15:35:27,464 INFO [Time-limited test-EventThread] regionserver.HRegionServer(2163): STOPPED: Cluster shutdown set; onlineServer=0 2018-05-24 15:35:27,465 DEBUG [M:0;zhangduo-ubuntu:39993] ipc.AbstractRpcClient(200): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ff60d8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=zhangduo-ubuntu/127.0.1.1:0 2018-05-24 15:35:27,465 INFO [M:0;zhangduo-ubuntu:39993] regionserver.HRegionServer(1069): stopping server zhangduo-ubuntu,39993,1527146698913 2018-05-24 15:35:27,465 DEBUG [M:0;zhangduo-ubuntu:39993] zookeeper.MetaTableLocator(641): Stopping MetaTableLocator 2018-05-24 15:35:27,465 INFO [M:0;zhangduo-ubuntu:39993] regionserver.HRegionServer(1097): stopping server zhangduo-ubuntu,39993,1527146698913; all regions closed. 2018-05-24 15:35:27,466 DEBUG [M:0;zhangduo-ubuntu:39993] ipc.AbstractRpcClient(483): Stopping rpc client 2018-05-24 15:35:27,466 INFO [M:0;zhangduo-ubuntu:39993] hbase.ChoreService(327): Chore service for: master/zhangduo-ubuntu:0 had [[ScheduledChore: Name: ReplicationBarrierCleaner Period: 43200000 Unit: MILLISECONDS], [ScheduledChore: Name: HFileCleaner Period: 600000 Unit: MILLISECONDS], [ScheduledChore: Name: CatalogJanitor-zhangduo-ubuntu:39993 Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,39993,1527146698913-RegionNormalizerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: LogsCleaner Period: 600000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,39993,1527146698913-BalancerChore Period: 300000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,39993,1527146698913-ClusterStatusChore Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: zhangduo-ubuntu,39993,1527146698913-ExpiredMobFileCleanerChore Period: 86400 Unit: SECONDS], [ScheduledChore: Name: zhangduo-ubuntu,39993,1527146698913-MobCompactionChore Period: 604800 Unit: SECONDS]] on shutdown 2018-05-24 15:35:27,466 INFO [RS:2;zhangduo-ubuntu:42271] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,42271,1527146699039; zookeeper connection closed. 2018-05-24 15:35:27,466 INFO [M:0;zhangduo-ubuntu:39993] master.MasterMobCompactionThread(175): Waiting for Mob Compaction Thread to finish... 2018-05-24 15:35:27,466 INFO [M:0;zhangduo-ubuntu:39993] master.MasterMobCompactionThread(175): Waiting for Region Server Mob Compaction Thread to finish... 2018-05-24 15:35:27,466 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5089a692] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(221): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5089a692 2018-05-24 15:35:27,466 DEBUG [M:0;zhangduo-ubuntu:39993] master.HMaster(1228): Stopping service threads 2018-05-24 15:35:27,466 DEBUG [OldWALsCleaner-1] cleaner.LogCleaner(176): Exiting cleaner. 2018-05-24 15:35:27,466 DEBUG [Thread-406-HFileCleaner.small.0-1527146699492] cleaner.HFileCleaner(253): Exit Thread[Thread-406-HFileCleaner.small.0-1527146699492,5,FailOnTimeoutGroup] 2018-05-24 15:35:27,467 INFO [Time-limited test] util.JVMClusterUtil(326): Shutdown of 1 master(s) and 3 regionserver(s) complete 2018-05-24 15:35:27,466 DEBUG [OldWALsCleaner-0] cleaner.LogCleaner(176): Exiting cleaner. 2018-05-24 15:35:27,467 DEBUG [M:0;zhangduo-ubuntu:39993] zookeeper.ZKUtil(614): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Unable to get data of znode /cluster2/master because node does not exist (not an error) 2018-05-24 15:35:27,467 WARN [M:0;zhangduo-ubuntu:39993] master.ActiveMasterManager(271): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2018-05-24 15:35:27,467 INFO [M:0;zhangduo-ubuntu:39993] assignment.AssignmentManager(234): Stopping assignment manager 2018-05-24 15:35:27,467 DEBUG [Thread-406-HFileCleaner.large.0-1527146699491] cleaner.HFileCleaner(253): Exit Thread[Thread-406-HFileCleaner.large.0-1527146699491,5,FailOnTimeoutGroup] 2018-05-24 15:35:27,467 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/cluster2/rs 2018-05-24 15:35:27,467 DEBUG [Time-limited test-EventThread] zookeeper.ZKWatcher(478): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/cluster2/master 2018-05-24 15:35:27,469 INFO [M:0;zhangduo-ubuntu:39993] procedure2.RemoteProcedureDispatcher(116): Stopping procedure remote dispatcher 2018-05-24 15:35:27,469 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(357): master:39993-0x16391092ecc000a, quorum=localhost:59029, baseZNode=/cluster2 Set watcher on znode that does not yet exist, /cluster2/master 2018-05-24 15:35:27,470 INFO [M:0;zhangduo-ubuntu:39993] wal.WALProcedureStore(290): Stopping the WAL Procedure Store, isAbort=false 2018-05-24 15:35:27,479 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:34351 is added to blk_1073741830_1006{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-dc755e38-4b2d-4079-9d67-5bab8270103f:NORMAL:127.0.0.1:39253|RBW], ReplicaUC[[DISK]DS-550921cf-1c28-4a21-845a-1f6f8dad6fd4:NORMAL:127.0.0.1:45001|RBW], ReplicaUC[[DISK]DS-b37460aa-1473-46d5-826f-abc526fd58b1:NORMAL:127.0.0.1:34351|RBW]]} size 51169 2018-05-24 15:35:27,479 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:45001 is added to blk_1073741830_1006 size 51169 2018-05-24 15:35:27,479 INFO [Block report processor] blockmanagement.BlockManager(2648): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39253 is added to blk_1073741830_1006 size 51169 2018-05-24 15:35:27,882 INFO [M:0;zhangduo-ubuntu:39993] hbase.ChoreService(327): Chore service for: master/zhangduo-ubuntu:0.splitLogManager. had [[ScheduledChore: Name: SplitLogManager Timeout Monitor Period: 1000 Unit: MILLISECONDS]] on shutdown 2018-05-24 15:35:27,882 INFO [M:0;zhangduo-ubuntu:39993] flush.MasterFlushTableProcedureManager(81): stop: server shutting down. 2018-05-24 15:35:27,882 INFO [M:0;zhangduo-ubuntu:39993] ipc.NettyRpcServer(143): Stopping server on /127.0.1.1:39993 2018-05-24 15:35:27,886 DEBUG [M:0;zhangduo-ubuntu:39993] zookeeper.RecoverableZooKeeper(176): Node /cluster2/rs/zhangduo-ubuntu,39993,1527146698913 already deleted, retry=false 2018-05-24 15:35:27,887 INFO [M:0;zhangduo-ubuntu:39993] regionserver.HRegionServer(1153): Exiting; stopping=zhangduo-ubuntu,39993,1527146698913; zookeeper connection closed. 2018-05-24 15:35:27,888 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:27,896 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:28,002 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:38079] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:28,002 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data5/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:38079] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-1394976965-127.0.1.1-1527146697548 (Datanode Uuid c16eaf65-6efe-4a59-810e-e4de07365c07) service to localhost/127.0.0.1:38079 2018-05-24 15:35:28,006 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:28,014 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:28,121 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:38079] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:28,121 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data3/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:38079] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-1394976965-127.0.1.1-1527146697548 (Datanode Uuid f94a33a7-5224-407f-87c5-a1b6e29eb241) service to localhost/127.0.0.1:38079 2018-05-24 15:35:28,125 WARN [Time-limited test] datanode.DirectoryScanner(529): DirectoryScanner: shutdown has been called 2018-05-24 15:35:28,132 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:28,234 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:38079] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2018-05-24 15:35:28,234 WARN [DataNode: [[[DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data1/, [DISK]file:/home/zhangduo/hbase/code/hbase-server/target/test-data/9763be0d-8541-414b-a1a1-bc46ab0afba8/cluster_09846fc8-4484-44af-9915-5972fc53fd03/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:38079] datanode.BPServiceActor(670): Ending block pool service for: Block pool BP-1394976965-127.0.1.1-1527146697548 (Datanode Uuid 2007c688-9835-4ef8-af24-d266953a1238) service to localhost/127.0.0.1:38079 2018-05-24 15:35:28,248 INFO [Time-limited test] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2018-05-24 15:35:28,357 INFO [Time-limited test] hbase.HBaseTestingUtility(1105): Minicluster is down 2018-05-24 15:35:28,358 ERROR [Time-limited test] server.ZooKeeperServer(472): ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes 2018-05-24 15:35:28,360 INFO [Time-limited test] zookeeper.MiniZooKeeperCluster(324): Shutdown MiniZK cluster with all ZK servers 2018-05-24 15:35:28,363 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,363 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished. 2018-05-24 15:35:28,363 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,363 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished. 2018-05-24 15:35:28,363 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished. 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished. 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished. 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(112): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@27d5ece9 2018-05-24 15:35:28,364 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(121): Starting fs shutdown hook thread. 2018-05-24 15:35:28,365 INFO [Thread-4] regionserver.ShutdownHook$ShutdownHookThread(135): Shutdown hook finished.