Stacktrace java.lang.NullPointerException: null at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:604) at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:578) at org.apache.hadoop.hbase.master.TestDistributedLogSplitting.testSameVersionUpdatesRecoveryWithCompaction(TestDistributedLogSplitting.java:1377) Standard Output 2017-02-23 21:35:57,649 INFO [main] hbase.HBaseTestingUtility(471): Created new mini-cluster data directory: /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10, deleteOnExit=true 2017-02-23 21:35:57,653 INFO [main] hbase.HBaseTestingUtility(718): Setting test.cache.data to /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/cache_data in system properties and HBase conf 2017-02-23 21:35:57,654 INFO [main] hbase.HBaseTestingUtility(718): Setting hadoop.tmp.dir to /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/hadoop_tmp in system properties and HBase conf 2017-02-23 21:35:57,655 INFO [main] hbase.HBaseTestingUtility(718): Setting hadoop.log.dir to /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/hadoop_logs in system properties and HBase conf 2017-02-23 21:35:57,656 INFO [main] hbase.HBaseTestingUtility(718): Setting mapreduce.cluster.local.dir to /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/mapred_local in system properties and HBase conf 2017-02-23 21:35:57,657 INFO [main] hbase.HBaseTestingUtility(718): Setting mapreduce.cluster.temp.dir to /xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/mapred_temp in system properties and HBase conf 2017-02-23 21:35:57,657 INFO [main] hbase.HBaseTestingUtility(709): read short circuit is OFF 2017-02-23 21:35:57,829 WARN [main] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2017-02-23 21:35:58,241 DEBUG [main] fs.HFileSystem(225): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2017-02-23 21:35:59,123 WARN [main] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2017-02-23 21:35:59,307 INFO [main] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2017-02-23 21:35:59,381 INFO [main] log.Slf4jLog(67): jetty-6.1.26.hwx 2017-02-23 21:35:59,422 INFO [main] log.Slf4jLog(67): Extract jar:file:/grid/0/nobody/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.3.2.6.0.0-SNAPSHOT/hadoop-hdfs-2.7.3.2.6.0.0-SNAPSHOT-tests.jar!/webapps/hdfs to /tmp/Jetty_localhost_33238_hdfs____vm1hsx/webapp 2017-02-23 21:35:59,642 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33238 2017-02-23 21:36:00,200 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:36:00,515 INFO [main] log.Slf4jLog(67): jetty-6.1.26.hwx 2017-02-23 21:36:00,523 INFO [main] log.Slf4jLog(67): Extract jar:file:/xxx/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.3.2.6.0.0-SNAPSHOT/hadoop-hdfs-2.7.3.2.6.0.0-SNAPSHOT-tests.jar!/webapps/datanode to /tmp/Jetty_localhost_57929_datanode____.1nbm4b/webapp 2017-02-23 21:36:00,652 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57929 2017-02-23 21:36:01,841 INFO [Block report processor] blockmanagement.BlockManager(1978): BLOCK* processReport: from storage DS-414f876d-9b6f-4f79-af36-2995e0a9711d node DatanodeRegistration(127.0.0.1:55464, datanodeUuid=40d30814-e58a-4e86-bee1-a12aaedcca73, infoPort=54272, infoSecurePort=0, ipcPort=40257, storageInfo=lv=-56;cid=testClusterID;nsid=87605037;c=0), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2017-02-23 21:36:01,842 INFO [Block report processor] blockmanagement.BlockManager(1978): BLOCK* processReport: from storage DS-858f1ba5-02eb-4912-b482-c5c00cfba630 node DatanodeRegistration(127.0.0.1:55464, datanodeUuid=40d30814-e58a-4e86-bee1-a12aaedcca73, infoPort=54272, infoSecurePort=0, ipcPort=40257, storageInfo=lv=-56;cid=testClusterID;nsid=87605037;c=0), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2017-02-23 21:36:01,894 INFO [main] zookeeper.MiniZooKeeperCluster(276): Started MiniZooKeeperCluster and ran successful 'stat' on client port=55483 2017-02-23 21:36:01,945 INFO [main] hbase.ResourceChecker(147): before: master.TestDistributedLogSplitting#testMasterStartsUpWithLogSplittingWork Thread=76, OpenFileDescriptor=658, MaxFileDescriptor=1024000, SystemLoadAverage=1064, ProcessCount=11, AvailableMemoryMB=34741, ConnectionCount=0 2017-02-23 21:36:01,974 INFO [Time-limited test] master.TestDistributedLogSplitting(459): testMasterStartsUpWithLogSplittingWork 2017-02-23 21:36:01,976 INFO [Time-limited test] master.TestDistributedLogSplitting(165): Starting cluster 2017-02-23 21:36:01,992 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:01,995 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:02,688 INFO [Time-limited test] util.FSUtils(763): Created version file at hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669 with version=8 2017-02-23 21:36:02,737 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:36:02,896 INFO [Time-limited test] client.ConnectionUtils(104): master/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:36:02,907 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:36:02,915 INFO [Time-limited test] ipc.RpcServer$Listener(608): master/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:36:02,955 INFO [Time-limited test] hfile.CacheConfig(530): Allocating LruBlockCache size=995.58 MB, blockSize=64 KB 2017-02-23 21:36:02,961 DEBUG [Time-limited test] hfile.CacheConfig(544): Trying to use Internal l2 cache 2017-02-23 21:36:02,962 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:02,963 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:02,966 INFO [Time-limited test] mob.MobFileCache(121): MobFileCache is initialized, and the cache size is 1000 2017-02-23 21:36:02,969 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:02,977 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,039 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=master:44091 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:36:03,135 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:440910x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:36:03,137 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): master:44091-0x15a6ce6fd4d0000 connected 2017-02-23 21:36:03,201 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:36:03,290 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:36:03,291 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:36:03,294 INFO [RpcServer.listener,port=44091] ipc.RpcServer$Listener(739): RpcServer.listener,port=44091: starting 2017-02-23 21:36:03,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=44091 2017-02-23 21:36:03,294 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:36:03,295 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=44091 2017-02-23 21:36:03,295 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=44091 2017-02-23 21:36:03,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=44091 2017-02-23 21:36:03,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=44091 2017-02-23 21:36:03,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=44091 2017-02-23 21:36:03,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=44091 2017-02-23 21:36:03,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=44091 2017-02-23 21:36:03,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=44091 2017-02-23 21:36:03,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=44091 2017-02-23 21:36:03,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=44091 2017-02-23 21:36:03,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=44091 2017-02-23 21:36:03,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=44091 2017-02-23 21:36:03,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=44091 2017-02-23 21:36:03,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=44091 2017-02-23 21:36:03,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=44091 2017-02-23 21:36:03,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=44091 2017-02-23 21:36:03,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=44091 2017-02-23 21:36:03,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=44091 2017-02-23 21:36:03,300 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=44091 2017-02-23 21:36:03,300 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=44091 2017-02-23 21:36:03,300 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=44091 2017-02-23 21:36:03,300 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=44091 2017-02-23 21:36:03,301 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=44091 2017-02-23 21:36:03,301 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=44091 2017-02-23 21:36:03,301 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=44091 2017-02-23 21:36:03,301 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=44091 2017-02-23 21:36:03,301 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=44091 2017-02-23 21:36:03,302 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=44091 2017-02-23 21:36:03,302 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=44091 2017-02-23 21:36:03,302 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=44091 2017-02-23 21:36:03,302 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=44091 2017-02-23 21:36:03,303 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=44091 2017-02-23 21:36:03,303 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=44091 2017-02-23 21:36:03,303 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=44091 2017-02-23 21:36:03,303 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=44091 2017-02-23 21:36:03,304 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=44091 2017-02-23 21:36:03,304 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=44091 2017-02-23 21:36:03,304 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=44091 2017-02-23 21:36:03,304 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=44091 2017-02-23 21:36:03,305 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=44091 2017-02-23 21:36:03,305 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=44091 2017-02-23 21:36:03,305 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=44091 2017-02-23 21:36:03,305 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=44091 2017-02-23 21:36:03,306 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=44091 2017-02-23 21:36:03,306 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=44091 2017-02-23 21:36:03,306 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=44091 2017-02-23 21:36:03,306 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=44091 2017-02-23 21:36:03,307 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=44091 2017-02-23 21:36:03,310 INFO [Time-limited test] master.HMaster(429): hbase.rootdir=hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669, hbase.cluster.distributed=false 2017-02-23 21:36:03,317 DEBUG [Time-limited test] impl.BackupManager(136): Added log cleaner: org.apache.hadoop.hbase.backup.master.BackupLogCleaner 2017-02-23 21:36:03,317 DEBUG [Time-limited test] impl.BackupManager(137): Added master procedure manager: org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager 2017-02-23 21:36:03,317 DEBUG [Time-limited test] impl.BackupManager(138): Added master observer: org.apache.hadoop.hbase.backup.master.BackupController 2017-02-23 21:36:03,325 INFO [Time-limited test] master.HMaster(1897): Adding backup master ZNode /hbase/backup-masters/xxx.hwx.site,44091,1487885762942 2017-02-23 21:36:03,349 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/xxx.hwx.site,44091,1487885762942 2017-02-23 21:36:03,353 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:36:03,354 INFO [Time-limited test] client.ConnectionUtils(104): master/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:36:03,355 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:36:03,358 INFO [Time-limited test] ipc.RpcServer$Listener(608): master/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:36:03,359 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,359 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,361 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,364 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,367 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=master:53880 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:36:03,374 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2017-02-23 21:36:03,398 DEBUG [xxx:44091.activeMasterManager] zookeeper.ZKUtil(367): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:03,398 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:538800x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:36:03,400 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): master:53880-0x15a6ce6fd4d0001 connected 2017-02-23 21:36:03,414 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(367): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:03,415 DEBUG [Time-limited test] zookeeper.RecoverableZooKeeper(584): Node /hbase already exists 2017-02-23 21:36:03,415 DEBUG [Time-limited test-EventThread] master.ActiveMasterManager(126): A master is now available 2017-02-23 21:36:03,415 INFO [xxx:44091.activeMasterManager] master.ActiveMasterManager(170): Deleting ZNode for /hbase/backup-masters/xxx.hwx.site,44091,1487885762942 from backup master directory 2017-02-23 21:36:03,431 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:44091-0x15a6ce6fd4d0000, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/xxx.hwx.site,44091,1487885762942 2017-02-23 21:36:03,432 WARN [xxx:44091.activeMasterManager] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2017-02-23 21:36:03,433 INFO [xxx:44091.activeMasterManager] master.ActiveMasterManager(179): Registered Active Master=xxx.hwx.site,44091,1487885762942 2017-02-23 21:36:03,437 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:53880-0x15a6ce6fd4d0001, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:03,439 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:53880-0x15a6ce6fd4d0001, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:36:03,440 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:36:03,440 INFO [RpcServer.listener,port=53880] ipc.RpcServer$Listener(739): RpcServer.listener,port=53880: starting 2017-02-23 21:36:03,440 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=53880 2017-02-23 21:36:03,441 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=53880 2017-02-23 21:36:03,442 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=53880 2017-02-23 21:36:03,442 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=53880 2017-02-23 21:36:03,442 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=53880 2017-02-23 21:36:03,443 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=53880 2017-02-23 21:36:03,443 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=53880 2017-02-23 21:36:03,443 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=53880 2017-02-23 21:36:03,444 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=53880 2017-02-23 21:36:03,444 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=53880 2017-02-23 21:36:03,444 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=53880 2017-02-23 21:36:03,444 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=53880 2017-02-23 21:36:03,445 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=53880 2017-02-23 21:36:03,445 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=53880 2017-02-23 21:36:03,445 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=53880 2017-02-23 21:36:03,446 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=53880 2017-02-23 21:36:03,446 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=53880 2017-02-23 21:36:03,446 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=53880 2017-02-23 21:36:03,447 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=53880 2017-02-23 21:36:03,447 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=53880 2017-02-23 21:36:03,447 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=53880 2017-02-23 21:36:03,448 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=53880 2017-02-23 21:36:03,448 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=53880 2017-02-23 21:36:03,448 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=53880 2017-02-23 21:36:03,448 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=53880 2017-02-23 21:36:03,449 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=53880 2017-02-23 21:36:03,449 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=53880 2017-02-23 21:36:03,450 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=53880 2017-02-23 21:36:03,450 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=53880 2017-02-23 21:36:03,450 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=53880 2017-02-23 21:36:03,450 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=53880 2017-02-23 21:36:03,451 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=53880 2017-02-23 21:36:03,451 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=53880 2017-02-23 21:36:03,451 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=53880 2017-02-23 21:36:03,452 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=53880 2017-02-23 21:36:03,452 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=53880 2017-02-23 21:36:03,452 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=53880 2017-02-23 21:36:03,452 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=53880 2017-02-23 21:36:03,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=53880 2017-02-23 21:36:03,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=53880 2017-02-23 21:36:03,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=53880 2017-02-23 21:36:03,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=53880 2017-02-23 21:36:03,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=53880 2017-02-23 21:36:03,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=53880 2017-02-23 21:36:03,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=53880 2017-02-23 21:36:03,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=53880 2017-02-23 21:36:03,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=53880 2017-02-23 21:36:03,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=53880 2017-02-23 21:36:03,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=53880 2017-02-23 21:36:03,456 INFO [Time-limited test] master.HMaster(429): hbase.rootdir=hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669, hbase.cluster.distributed=false 2017-02-23 21:36:03,456 DEBUG [Time-limited test] impl.BackupManager(136): Added log cleaner: org.apache.hadoop.hbase.backup.master.BackupLogCleaner 2017-02-23 21:36:03,457 DEBUG [Time-limited test] impl.BackupManager(137): Added master procedure manager: org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager 2017-02-23 21:36:03,457 DEBUG [Time-limited test] impl.BackupManager(138): Added master observer: org.apache.hadoop.hbase.backup.master.BackupController 2017-02-23 21:36:03,457 INFO [Time-limited test] master.HMaster(1897): Adding backup master ZNode /hbase/backup-masters/xxx.hwx.site,53880,1487885763358 2017-02-23 21:36:03,465 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:53880-0x15a6ce6fd4d0001, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/xxx.hwx.site,53880,1487885763358 2017-02-23 21:36:03,481 DEBUG [xxx:53880.activeMasterManager] zookeeper.RecoverableZooKeeper(584): Node /hbase/master already exists 2017-02-23 21:36:03,482 DEBUG [xxx:53880.activeMasterManager] zookeeper.ZKUtil(367): master:53880-0x15a6ce6fd4d0001, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:03,483 INFO [xxx:53880.activeMasterManager] master.ActiveMasterManager(216): Another master is the active master, xxx.hwx.site,44091,1487885762942; waiting to become the next active master 2017-02-23 21:36:03,517 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:36:03,519 INFO [Time-limited test] client.ConnectionUtils(104): regionserver/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:36:03,519 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:36:03,523 INFO [Time-limited test] ipc.RpcServer$Listener(608): regionserver/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:36:03,530 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,530 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,534 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,537 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,539 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:58318 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:36:03,557 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:583180x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:36:03,557 DEBUG [xxx:44091.activeMasterManager] util.FSUtils(915): Created cluster ID file at hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669/hbase.id with ID: ae72c006-06ce-4e30-86eb-cccd79afd834 2017-02-23 21:36:03,557 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): regionserver:58318-0x15a6ce6fd4d0002 connected 2017-02-23 21:36:03,558 DEBUG [Time-limited test] zookeeper.ZKUtil(367): regionserver:58318-0x15a6ce6fd4d0002, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:03,559 DEBUG [Time-limited test] zookeeper.ZKUtil(369): regionserver:58318-0x15a6ce6fd4d0002, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:36:03,560 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:36:03,560 INFO [RpcServer.listener,port=58318] ipc.RpcServer$Listener(739): RpcServer.listener,port=58318: starting 2017-02-23 21:36:03,560 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=58318 2017-02-23 21:36:03,561 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=58318 2017-02-23 21:36:03,562 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=58318 2017-02-23 21:36:03,562 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=58318 2017-02-23 21:36:03,563 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=58318 2017-02-23 21:36:03,563 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=58318 2017-02-23 21:36:03,564 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=58318 2017-02-23 21:36:03,564 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=58318 2017-02-23 21:36:03,565 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=58318 2017-02-23 21:36:03,565 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=58318 2017-02-23 21:36:03,566 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=58318 2017-02-23 21:36:03,566 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=58318 2017-02-23 21:36:03,567 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=58318 2017-02-23 21:36:03,567 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=58318 2017-02-23 21:36:03,568 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=58318 2017-02-23 21:36:03,568 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=58318 2017-02-23 21:36:03,568 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=58318 2017-02-23 21:36:03,569 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=58318 2017-02-23 21:36:03,569 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=58318 2017-02-23 21:36:03,569 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=58318 2017-02-23 21:36:03,570 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=58318 2017-02-23 21:36:03,570 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=58318 2017-02-23 21:36:03,570 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=58318 2017-02-23 21:36:03,570 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=58318 2017-02-23 21:36:03,571 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=58318 2017-02-23 21:36:03,571 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=58318 2017-02-23 21:36:03,571 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=58318 2017-02-23 21:36:03,572 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=58318 2017-02-23 21:36:03,572 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=58318 2017-02-23 21:36:03,572 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=58318 2017-02-23 21:36:03,573 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=58318 2017-02-23 21:36:03,573 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=58318 2017-02-23 21:36:03,573 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=58318 2017-02-23 21:36:03,574 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=58318 2017-02-23 21:36:03,574 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=58318 2017-02-23 21:36:03,574 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=58318 2017-02-23 21:36:03,574 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=58318 2017-02-23 21:36:03,575 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=58318 2017-02-23 21:36:03,575 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=58318 2017-02-23 21:36:03,575 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=58318 2017-02-23 21:36:03,576 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=58318 2017-02-23 21:36:03,576 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=58318 2017-02-23 21:36:03,576 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=58318 2017-02-23 21:36:03,576 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=58318 2017-02-23 21:36:03,577 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=58318 2017-02-23 21:36:03,577 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=58318 2017-02-23 21:36:03,577 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=58318 2017-02-23 21:36:03,578 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=58318 2017-02-23 21:36:03,578 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=58318 2017-02-23 21:36:03,584 INFO [Time-limited test] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2017-02-23 21:36:03,586 INFO [Time-limited test] http.HttpServer(852): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2017-02-23 21:36:03,587 INFO [Time-limited test] http.HttpServer(830): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2017-02-23 21:36:03,587 INFO [Time-limited test] http.HttpServer(837): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2017-02-23 21:36:03,588 INFO [Time-limited test] http.HttpServer(837): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2017-02-23 21:36:03,591 INFO [Time-limited test] http.HttpServer(1083): Jetty bound to port 60793 2017-02-23 21:36:03,592 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26.hwx 2017-02-23 21:36:03,601 INFO [xxx:44091.activeMasterManager] master.MasterFileSystem(560): BOOTSTRAP: creating hbase:meta region 2017-02-23 21:36:03,604 INFO [xxx:44091.activeMasterManager] regionserver.HRegion(6360): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => 'FOREVER', MIN_VERSIONS => '0', CACHE_DATA_IN_L1 => 'true', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669 Table name == hbase:meta 2017-02-23 21:36:03,895 INFO [xxx:44091.activeMasterManager] wal.WALFactory(145): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.DefaultWALProvider 2017-02-23 21:36:03,907 INFO [Time-limited test] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:60793 2017-02-23 21:36:03,917 INFO [xxx:44091.activeMasterManager] wal.FSHLog(581): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=hregion-95502263.default, suffix=, logDir=hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669/WALs/hregion-95502263, archiveDir=hdfs://localhost:47833/user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669/oldWALs 2017-02-23 21:36:03,940 INFO [xxx:44091.activeMasterManager] wal.FSHLog(1620): Slow sync cost: 9 ms, current pipeline: [] 2017-02-23 21:36:03,941 INFO [xxx:44091.activeMasterManager] wal.FSHLog(1048): New WAL /user/nobody/test-data/b692c81c-3d54-4f46-ab81-065efbaba669/WALs/hregion-95502263/hregion-95502263.default.1487885763917 2017-02-23 21:36:03,954 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:36:03,956 INFO [Time-limited test] client.ConnectionUtils(104): regionserver/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:36:03,956 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:36:03,960 INFO [Time-limited test] ipc.RpcServer$Listener(608): regionserver/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:36:03,961 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,961 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:36:03,964 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,966 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:36:03,968 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:39700 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:36:03,972 DEBUG [xxx:44091.activeMasterManager] regionserver.HRegion(797): Instantiated hbase:meta,,1.1588230740 2017-02-23 21:36:04,016 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:397000x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:36:04,016 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): regionserver:39700-0x15a6ce6fd4d0003 connected 2017-02-23 21:36:04,017 DEBUG [Time-limited test] zookeeper.ZKUtil(367): regionserver:39700-0x15a6ce6fd4d0003, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:36:04,019 DEBUG [Time-limited test] zookeeper.ZKUtil(369): regionserver:39700-0x15a6ce6fd4d0003, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:36:04,019 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:36:04,019 INFO [RpcServer.listener,port=39700] ipc.RpcServer$Listener(739): RpcServer.listener,port=39700: starting 2017-02-23 21:36:04,019 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=39700 2017-02-23 21:36:04,021 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=39700 2017-02-23 21:36:04,021 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=39700 2017-02-23 21:36:04,021 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=39700 2017-02-23 21:36:04,021 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=39700 2017-02-23 21:36:04,022 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=39700 2017-02-23 21:36:04,022 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=39700 2017-02-23 21:36:04,022 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=39700 2017-02-23 21:36:04,023 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=39700 2017-02-23 21:36:04,023 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=39700 2017-02-23 21:36:04,023 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=39700 2017-02-23 21:36:04,023 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=39700 2017-02-23 21:36:04,024 DEBUG [Time-limited test] ipc.RpcExecutor(1 ...[truncated 31493988 bytes]... ): master:37627-0x15a6ce6fd4d0167, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2017-02-23 21:44:09,688 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:49998-0x15a6ce6fd4d0166, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2017-02-23 21:44:09,688 INFO [M:0;xxx:49998] client.ConnectionManager$HConnectionImplementation(1687): Closing zookeeper sessionid=0x15a6ce6fd4d0176 2017-02-23 21:44:09,688 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(369): master:37627-0x15a6ce6fd4d0167, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:44:09,688 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(369): master:49998-0x15a6ce6fd4d0166, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:44:09,696 DEBUG [M:0;xxx:49998] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:44:09,707 INFO [M:0;xxx:49998] hbase.ChoreService(302): Chore service for: xxx.hwx.site,49998,1487886237456_splitLogManager_ had [] on shutdown 2017-02-23 21:44:09,707 INFO [M:0;xxx:49998] master.LogRollMasterProcedureManager(55): stop: server shutting down. 2017-02-23 21:44:09,707 INFO [M:0;xxx:49998] flush.MasterFlushTableProcedureManager(79): stop: server shutting down. 2017-02-23 21:44:09,708 INFO [M:0;xxx:49998] ipc.RpcServer(2248): Stopping server on 49998 2017-02-23 21:44:09,709 INFO [RpcServer.listener,port=49998] ipc.RpcServer$Listener(786): RpcServer.listener,port=49998: stopping 2017-02-23 21:44:09,709 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:44:09,710 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:44:09,721 INFO [M:0;xxx:49998] zookeeper.RecoverableZooKeeper(188): Node /hbase/rs/xxx.hwx.site,49998,1487886237456 already deleted, retry=false 2017-02-23 21:44:09,730 INFO [M:0;xxx:49998] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,49998,1487886237456; zookeeper connection closed. 2017-02-23 21:44:09,730 INFO [M:0;xxx:49998] regionserver.HRegionServer(1141): M:0;xxx:49998 exiting 2017-02-23 21:44:12,286 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:44:14,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-02-23 21:44:15,287 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:44:18,288 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:44:19,370 INFO [M:1;xxx:37627] regionserver.HRegionServer(807): ClusterId : bc7c6de0-63fb-4762-95c6-d7a0eef9bb8b 2017-02-23 21:44:19,370 INFO [M:1;xxx:37627] regionserver.HRegionServer(1066): stopping server xxx.hwx.site,37627,1487886237589 2017-02-23 21:44:19,370 DEBUG [M:1;xxx:37627] zookeeper.MetaTableLocator(627): Stopping MetaTableLocator 2017-02-23 21:44:19,370 INFO [M:1;xxx:37627] client.ConnectionManager$HConnectionImplementation(1687): Closing zookeeper sessionid=0x15a6ce6fd4d016f 2017-02-23 21:44:19,391 DEBUG [M:1;xxx:37627] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:44:19,391 INFO [M:1;xxx:37627] regionserver.HRegionServer(1094): stopping server xxx.hwx.site,37627,1487886237589; all regions closed. 2017-02-23 21:44:19,391 INFO [M:1;xxx:37627] hbase.ChoreService(302): Chore service for: xxx.hwx.site,37627,1487886237589 had [] on shutdown 2017-02-23 21:44:19,391 DEBUG [M:1;xxx:37627] master.HMaster(1243): Stopping service threads 2017-02-23 21:44:19,392 DEBUG [M:1;xxx:37627] zookeeper.ZKUtil(626): master:37627-0x15a6ce6fd4d0167, quorum=localhost:55483, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2017-02-23 21:44:19,392 WARN [M:1;xxx:37627] master.ActiveMasterManager(269): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2017-02-23 21:44:19,394 INFO [M:1;xxx:37627] ipc.RpcServer(2248): Stopping server on 37627 2017-02-23 21:44:19,396 INFO [RpcServer.listener,port=37627] ipc.RpcServer$Listener(786): RpcServer.listener,port=37627: stopping 2017-02-23 21:44:19,396 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:44:19,396 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:44:19,416 INFO [M:1;xxx:37627] zookeeper.RecoverableZooKeeper(188): Node /hbase/rs/xxx.hwx.site,37627,1487886237589 already deleted, retry=false 2017-02-23 21:44:19,424 INFO [M:1;xxx:37627] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,37627,1487886237589; zookeeper connection closed. 2017-02-23 21:44:19,424 INFO [M:1;xxx:37627] regionserver.HRegionServer(1141): M:1;xxx:37627 exiting 2017-02-23 21:44:19,424 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:37627-0x15a6ce6fd4d0167, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/xxx.hwx.site,37627,1487886237589 2017-02-23 21:44:19,426 INFO [main] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:44:19,431 INFO [main] zookeeper.RecoverableZooKeeper(120): Process identifier=testing utility connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:44:19,470 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility0x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:44:19,471 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(578): testing utility-0x15a6ce6fd4d017c connected 2017-02-23 21:44:19,471 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2017-02-23 21:44:19,471 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master-maintenance 2017-02-23 21:44:19,471 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc 2017-02-23 21:44:19,471 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters 2017-02-23 21:44:19,472 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/switch 2017-02-23 21:44:19,472 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table 2017-02-23 21:44:19,472 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/draining 2017-02-23 21:44:19,472 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/region-in-transition 2017-02-23 21:44:19,472 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock 2017-02-23 21:44:19,473 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/balancer 2017-02-23 21:44:19,473 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace 2017-02-23 21:44:19,473 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/hbaseid 2017-02-23 21:44:19,473 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot 2017-02-23 21:44:19,473 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication 2017-02-23 21:44:19,474 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/splitWAL 2017-02-23 21:44:19,474 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/recovering-regions 2017-02-23 21:44:19,474 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs 2017-02-23 21:44:19,474 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc 2017-02-23 21:44:19,475 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/acquired 2017-02-23 21:44:19,475 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/abort 2017-02-23 21:44:19,475 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/reached 2017-02-23 21:44:19,475 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:meta 2017-02-23 21:44:19,476 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:namespace 2017-02-23 21:44:19,476 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:backup 2017-02-23 21:44:19,476 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock/hbase:namespace 2017-02-23 21:44:19,476 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock/hbase:backup 2017-02-23 21:44:19,477 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace/default 2017-02-23 21:44:19,477 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace/hbase 2017-02-23 21:44:19,477 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired 2017-02-23 21:44:19,478 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/abort 2017-02-23 21:44:19,478 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached 2017-02-23 21:44:19,478 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication/peers 2017-02-23 21:44:19,478 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication/rs 2017-02-23 21:44:19,479 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired 2017-02-23 21:44:19,479 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/abort 2017-02-23 21:44:19,479 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached 2017-02-23 21:44:19,491 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached 2017-02-23 21:44:19,491 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc 2017-02-23 21:44:19,491 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort 2017-02-23 21:44:19,491 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2017-02-23 21:44:19,492 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs 2017-02-23 21:44:19,492 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/replication 2017-02-23 21:44:19,492 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/peers 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/hbase 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/default 2017-02-23 21:44:19,496 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock/hbase:backup 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/table-lock 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock/hbase:namespace 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:backup 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/table 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:namespace 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:meta 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/reached 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rolllog-proc 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/abort 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/acquired 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/recovering-regions 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication 2017-02-23 21:44:19,497 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/hbaseid 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/balancer 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/draining 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/switch 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master-maintenance 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2017-02-23 21:44:19,498 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase 2017-02-23 21:44:19,506 INFO [main] hbase.ResourceChecker(171): after: master.TestDistributedLogSplitting#testMetaRecoveryInZK Thread=330 (was 332), OpenFileDescriptor=892 (was 957), MaxFileDescriptor=1024000 (was 1024000), SystemLoadAverage=1043 (was 1125), ProcessCount=11 (was 11), AvailableMemoryMB=31254 (was 31580), ConnectionCount=0 (was 0) 2017-02-23 21:44:19,513 INFO [main] zookeeper.MiniZooKeeperCluster(319): Shutdown MiniZK cluster with all ZK servers 2017-02-23 21:44:19,513 WARN [main] datanode.DirectoryScanner(380): DirectoryScanner: shutdown has been called 2017-02-23 21:44:19,527 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2017-02-23 21:44:19,607 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x20fe7cc8-0x15a6ce6fd4d00ec, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,608 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x20fe7cc8-0x15a6ce6fd4d00ec, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,608 DEBUG [xxx:47159.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0080, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,608 DEBUG [xxx:53880.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0017, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,608 DEBUG [xxx:53880.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0017, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,608 DEBUG [xxx:47159.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0080, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,608 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0xc50025c-0x15a6ce6fd4d0073, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,608 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0xc50025c-0x15a6ce6fd4d0073, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [xxx:43663.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0113, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [xxx:43663.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0113, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(583): testing utility-0x15a6ce6fd4d017c, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [xxx:38400.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d00fc, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [xxx:38400.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d00fc, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [xxx:50312.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0163, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): table-creation-0x15a6ce6fd4d0074, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): table-creation-0x15a6ce6fd4d0074, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): table-creation-0x15a6ce6fd4d0083, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x54927c72-0x15a6ce6fd4d0147, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [xxx:49998.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0177, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): table-creation-0x15a6ce6fd4d0148, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x71f13e15-0x15a6ce6fd4d00bf, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x71f13e15-0x15a6ce6fd4d00bf, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x2a9efa0d-0x15a6ce6fd4d00b2, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x2a9efa0d-0x15a6ce6fd4d00b2, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x54c1511-0x15a6ce6fd4d015f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [xxx:47473.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d00b0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [xxx:47473.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d00b0, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x7e41ff70-0x15a6ce6fd4d0082, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x7e41ff70-0x15a6ce6fd4d0082, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x3d4c782-0x15a6ce6fd4d0099, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x3d4c782-0x15a6ce6fd4d0099, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x63fa35f9-0x15a6ce6fd4d0179, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x63fa35f9-0x15a6ce6fd4d0179, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:44091.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0011, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [xxx:47091.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0145, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [xxx:47748.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0043, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): table-creation-0x15a6ce6fd4d0148, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x49f51394-0x15a6ce6fd4d00fe, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,612 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x49f51394-0x15a6ce6fd4d00fe, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): table-creation-0x15a6ce6fd4d00ff, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0xea5d537-0x15a6ce6fd4d00d4, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,612 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0xea5d537-0x15a6ce6fd4d00d4, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,612 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x19a4d462-0x15a6ce6fd4d0115, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,612 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x19a4d462-0x15a6ce6fd4d0115, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x54927c72-0x15a6ce6fd4d0147, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [xxx:53616.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d002a, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,613 DEBUG [xxx:53616.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d002a, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [xxx:49998.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0177, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x6172cee-0x15a6ce6fd4d002c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,613 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x6172cee-0x15a6ce6fd4d002c, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x6b39249c-0x15a6ce6fd4d0045, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,613 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x6b39249c-0x15a6ce6fd4d0045, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): table-creation-0x15a6ce6fd4d005c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [xxx:53825.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d012c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): table-creation-0x15a6ce6fd4d0083, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x1be6a51c-0x15a6ce6fd4d0013, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,609 DEBUG [xxx:39463.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d00d2, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,614 DEBUG [xxx:39463.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d00d2, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,609 DEBUG [xxx:50312.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0163, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,614 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x1be6a51c-0x15a6ce6fd4d0013, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,614 DEBUG [xxx:53825.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d012c, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,614 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): table-creation-0x15a6ce6fd4d005c, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,612 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): table-creation-0x15a6ce6fd4d00ff, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:47748.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0043, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:47091.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0145, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:44091.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0011, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:38299.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0071, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,615 DEBUG [xxx:38299.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0071, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x2e6e0f0f-0x15a6ce6fd4d005b, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,615 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x2e6e0f0f-0x15a6ce6fd4d005b, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:32844.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d015d, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,615 DEBUG [xxx:32844.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d015d, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:44392.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0097, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,615 DEBUG [xxx:44392.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0097, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,611 DEBUG [xxx:40406.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d0059, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): hconnection-0x1e6c6c65-0x15a6ce6fd4d012e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [xxx:52642.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d00bd, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,611 DEBUG [xxx:60119.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(515): replicationLogCleaner-0x15a6ce6fd4d00ea, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2017-02-23 21:44:19,615 DEBUG [xxx:60119.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d00ea, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,610 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x54c1511-0x15a6ce6fd4d015f, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,615 DEBUG [xxx:52642.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d00bd, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,615 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(583): hconnection-0x1e6c6c65-0x15a6ce6fd4d012e, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,615 DEBUG [xxx:40406.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(583): replicationLogCleaner-0x15a6ce6fd4d0059, quorum=localhost:55483, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2017-02-23 21:44:19,629 WARN [DataNode: [[[DISK]file:/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data1/, [DISK]file:/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:47833] datanode.IncrementalBlockReportManager(132): IncrementalBlockReportManager interrupted 2017-02-23 21:44:19,629 WARN [DataNode: [[[DISK]file:/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data1/, [DISK]file:/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:47833] datanode.BPServiceActor(796): Ending block pool service for: Block pool BP-296246468-xxx-1487885758777 (Datanode Uuid 40d30814-e58a-4e86-bee1-a12aaedcca73) service to localhost/127.0.0.1:47833 2017-02-23 21:44:19,640 WARN [refreshUsed-/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data1/current/BP-296246468-xxx-1487885758777] fs.CachingGetSpaceUsed$RefreshThread(180): Thread Interrupted waiting to refresh disk information: sleep interrupted 2017-02-23 21:44:19,640 WARN [refreshUsed-/xxx/hbase/hbase-server/target/test-data/d7460833-f14e-436f-8028-607baca939ee/dfscluster_f833d555-5f2c-4019-966d-f57a75116c10/dfs/data/data2/current/BP-296246468-xxx-1487885758777] fs.CachingGetSpaceUsed$RefreshThread(180): Thread Interrupted waiting to refresh disk information: sleep interrupted 2017-02-23 21:44:19,728 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 Standard Error 2017-02-23 21:37:55,476 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/abort 2017-02-23 21:37:55,477 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/acquired 2017-02-23 21:37:55,477 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc 2017-02-23 21:37:55,477 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2017-02-23 21:37:55,477 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/recovering-regions 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/hbaseid 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/balancer 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/draining 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table 2017-02-23 21:37:55,479 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/switch 2017-02-23 21:37:55,480 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters 2017-02-23 21:37:55,480 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc 2017-02-23 21:37:55,480 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master-maintenance 2017-02-23 21:37:55,480 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2017-02-23 21:37:55,480 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d0047, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase 2017-02-23 21:37:55,488 INFO [main] hbase.ResourceChecker(171): after: master.TestDistributedLogSplitting#testMarkRegionsRecoveringInZK Thread=243 (was 337), OpenFileDescriptor=819 (was 810) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=1024000 (was 1024000), SystemLoadAverage=1029 (was 1026) - SystemLoadAverage LEAK? -, ProcessCount=11 (was 11), AvailableMemoryMB=33295 (was 33159) - AvailableMemoryMB LEAK? -, ConnectionCount=0 (was 0) 2017-02-23 21:37:55,497 INFO [main] hbase.ResourceChecker(147): before: master.TestDistributedLogSplitting#testSameVersionUpdatesRecoveryWithCompaction Thread=242, OpenFileDescriptor=819, MaxFileDescriptor=1024000, SystemLoadAverage=1029, ProcessCount=11, AvailableMemoryMB=33295, ConnectionCount=0 2017-02-23 21:37:55,520 INFO [Time-limited test] master.TestDistributedLogSplitting(1299): testSameVersionUpdatesRecoveryWithWrites 2017-02-23 21:37:55,521 INFO [Time-limited test] master.TestDistributedLogSplitting(165): Starting cluster 2017-02-23 21:37:55,534 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:55,535 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:55,949 INFO [Time-limited test] util.FSUtils(763): Created version file at hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea with version=8 2017-02-23 21:37:55,952 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:37:55,953 INFO [Time-limited test] client.ConnectionUtils(104): master/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:37:55,953 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:37:55,956 INFO [Time-limited test] ipc.RpcServer$Listener(608): master/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:37:55,957 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:55,957 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:55,958 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:55,959 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:55,960 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=master:40406 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:37:55,984 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:404060x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:37:55,985 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): master:40406-0x15a6ce6fd4d0048 connected 2017-02-23 21:37:56,182 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:37:56,182 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:37:56,183 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:37:56,183 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=40406 2017-02-23 21:37:56,183 INFO [RpcServer.listener,port=40406] ipc.RpcServer$Listener(739): RpcServer.listener,port=40406: starting 2017-02-23 21:37:56,183 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=40406 2017-02-23 21:37:56,183 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=40406 2017-02-23 21:37:56,184 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=40406 2017-02-23 21:37:56,185 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=40406 2017-02-23 21:37:56,186 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=40406 2017-02-23 21:37:56,187 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=40406 2017-02-23 21:37:56,188 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=40406 2017-02-23 21:37:56,189 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=40406 2017-02-23 21:37:56,190 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=40406 2017-02-23 21:37:56,191 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=40406 2017-02-23 21:37:56,191 INFO [Time-limited test] master.HMaster(429): hbase.rootdir=hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea, hbase.cluster.distributed=false 2017-02-23 21:37:56,191 DEBUG [Time-limited test] impl.BackupManager(136): Added log cleaner: org.apache.hadoop.hbase.backup.master.BackupLogCleaner 2017-02-23 21:37:56,191 DEBUG [Time-limited test] impl.BackupManager(137): Added master procedure manager: org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager 2017-02-23 21:37:56,191 DEBUG [Time-limited test] impl.BackupManager(138): Added master observer: org.apache.hadoop.hbase.backup.master.BackupController 2017-02-23 21:37:56,191 INFO [Time-limited test] master.HMaster(1897): Adding backup master ZNode /hbase/backup-masters/xxx.hwx.site,40406,1487885875957 2017-02-23 21:37:56,207 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/xxx.hwx.site,40406,1487885875957 2017-02-23 21:37:56,208 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:37:56,210 INFO [Time-limited test] client.ConnectionUtils(104): master/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:37:56,210 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:37:56,212 INFO [Time-limited test] ipc.RpcServer$Listener(608): master/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:37:56,213 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,213 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,214 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,215 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,217 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=master:53646 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:37:56,223 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2017-02-23 21:37:56,246 DEBUG [xxx:40406.activeMasterManager] zookeeper.ZKUtil(367): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,246 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:536460x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:37:56,248 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): master:53646-0x15a6ce6fd4d0049 connected 2017-02-23 21:37:56,265 DEBUG [Time-limited test] zookeeper.RecoverableZooKeeper(584): Node /hbase already exists 2017-02-23 21:37:56,265 INFO [xxx:40406.activeMasterManager] master.ActiveMasterManager(170): Deleting ZNode for /hbase/backup-masters/xxx.hwx.site,40406,1487885875957 from backup master directory 2017-02-23 21:37:56,265 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(367): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,266 DEBUG [Time-limited test-EventThread] master.ActiveMasterManager(126): A master is now available 2017-02-23 21:37:56,282 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/xxx.hwx.site,40406,1487885875957 2017-02-23 21:37:56,282 WARN [xxx:40406.activeMasterManager] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2017-02-23 21:37:56,282 INFO [xxx:40406.activeMasterManager] master.ActiveMasterManager(179): Registered Active Master=xxx.hwx.site,40406,1487885875957 2017-02-23 21:37:56,284 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,284 DEBUG [Time-limited test] zookeeper.ZKUtil(369): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:37:56,284 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:37:56,284 INFO [RpcServer.listener,port=53646] ipc.RpcServer$Listener(739): RpcServer.listener,port=53646: starting 2017-02-23 21:37:56,285 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=53646 2017-02-23 21:37:56,285 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=53646 2017-02-23 21:37:56,285 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=53646 2017-02-23 21:37:56,285 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=53646 2017-02-23 21:37:56,285 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=53646 2017-02-23 21:37:56,286 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=53646 2017-02-23 21:37:56,288 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=53646 2017-02-23 21:37:56,288 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=53646 2017-02-23 21:37:56,289 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=53646 2017-02-23 21:37:56,289 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=53646 2017-02-23 21:37:56,289 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=53646 2017-02-23 21:37:56,290 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=53646 2017-02-23 21:37:56,290 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=53646 2017-02-23 21:37:56,291 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=53646 2017-02-23 21:37:56,291 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=53646 2017-02-23 21:37:56,291 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=53646 2017-02-23 21:37:56,292 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=53646 2017-02-23 21:37:56,292 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=53646 2017-02-23 21:37:56,292 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=53646 2017-02-23 21:37:56,292 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=53646 2017-02-23 21:37:56,293 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=53646 2017-02-23 21:37:56,293 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=53646 2017-02-23 21:37:56,293 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=53646 2017-02-23 21:37:56,293 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=53646 2017-02-23 21:37:56,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=53646 2017-02-23 21:37:56,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=53646 2017-02-23 21:37:56,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=53646 2017-02-23 21:37:56,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=53646 2017-02-23 21:37:56,294 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=53646 2017-02-23 21:37:56,295 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=53646 2017-02-23 21:37:56,295 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=53646 2017-02-23 21:37:56,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=53646 2017-02-23 21:37:56,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=53646 2017-02-23 21:37:56,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=53646 2017-02-23 21:37:56,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=53646 2017-02-23 21:37:56,296 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=53646 2017-02-23 21:37:56,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=53646 2017-02-23 21:37:56,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=53646 2017-02-23 21:37:56,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=53646 2017-02-23 21:37:56,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=53646 2017-02-23 21:37:56,297 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=53646 2017-02-23 21:37:56,298 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=53646 2017-02-23 21:37:56,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=53646 2017-02-23 21:37:56,299 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=53646 2017-02-23 21:37:56,299 INFO [Time-limited test] master.HMaster(429): hbase.rootdir=hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea, hbase.cluster.distributed=false 2017-02-23 21:37:56,299 DEBUG [Time-limited test] impl.BackupManager(136): Added log cleaner: org.apache.hadoop.hbase.backup.master.BackupLogCleaner 2017-02-23 21:37:56,299 DEBUG [Time-limited test] impl.BackupManager(137): Added master procedure manager: org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager 2017-02-23 21:37:56,299 DEBUG [Time-limited test] impl.BackupManager(138): Added master observer: org.apache.hadoop.hbase.backup.master.BackupController 2017-02-23 21:37:56,299 INFO [Time-limited test] master.HMaster(1897): Adding backup master ZNode /hbase/backup-masters/xxx.hwx.site,53646,1487885876213 2017-02-23 21:37:56,315 DEBUG [Time-limited test] zookeeper.ZKUtil(367): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/xxx.hwx.site,53646,1487885876213 2017-02-23 21:37:56,332 DEBUG [xxx:53646.activeMasterManager] zookeeper.RecoverableZooKeeper(584): Node /hbase/master already exists 2017-02-23 21:37:56,332 DEBUG [xxx:53646.activeMasterManager] zookeeper.ZKUtil(367): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,332 INFO [xxx:53646.activeMasterManager] master.ActiveMasterManager(216): Another master is the active master, xxx.hwx.site,40406,1487885875957; waiting to become the next active master 2017-02-23 21:37:56,337 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:37:56,339 INFO [Time-limited test] client.ConnectionUtils(104): regionserver/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:37:56,339 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:37:56,342 INFO [Time-limited test] ipc.RpcServer$Listener(608): regionserver/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:37:56,342 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,343 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,344 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,345 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,346 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:34240 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:37:56,367 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:342400x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:37:56,369 DEBUG [Time-limited test] zookeeper.ZKUtil(367): regionserver:342400x0, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,369 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): regionserver:34240-0x15a6ce6fd4d004a connected 2017-02-23 21:37:56,369 DEBUG [Time-limited test] zookeeper.ZKUtil(369): regionserver:34240-0x15a6ce6fd4d004a, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:37:56,370 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:37:56,370 INFO [RpcServer.listener,port=34240] ipc.RpcServer$Listener(739): RpcServer.listener,port=34240: starting 2017-02-23 21:37:56,370 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=34240 2017-02-23 21:37:56,370 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=34240 2017-02-23 21:37:56,370 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=34240 2017-02-23 21:37:56,370 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=34240 2017-02-23 21:37:56,371 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=34240 2017-02-23 21:37:56,372 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=34240 2017-02-23 21:37:56,373 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=18,queue=0,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=19,queue=1,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=20,queue=0,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=21,queue=1,port=34240 2017-02-23 21:37:56,374 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=22,queue=0,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=23,queue=1,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=24,queue=0,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=25,queue=1,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=26,queue=0,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=27,queue=1,port=34240 2017-02-23 21:37:56,375 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=28,queue=0,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=29,queue=1,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=30,queue=0,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=31,queue=1,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=32,queue=0,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=33,queue=1,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=34,queue=0,port=34240 2017-02-23 21:37:56,376 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=35,queue=1,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=36,queue=0,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=37,queue=1,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=38,queue=0,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=39,queue=1,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=0,queue=0,port=34240 2017-02-23 21:37:56,377 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=1,queue=0,port=34240 2017-02-23 21:37:56,378 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.replication.handler=2,queue=0,port=34240 2017-02-23 21:37:56,378 INFO [Time-limited test] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2017-02-23 21:37:56,379 INFO [Time-limited test] http.HttpServer(852): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2017-02-23 21:37:56,380 INFO [Time-limited test] http.HttpServer(830): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2017-02-23 21:37:56,380 INFO [Time-limited test] http.HttpServer(837): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2017-02-23 21:37:56,380 INFO [Time-limited test] http.HttpServer(837): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2017-02-23 21:37:56,381 INFO [Time-limited test] http.HttpServer(1083): Jetty bound to port 39943 2017-02-23 21:37:56,381 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26.hwx 2017-02-23 21:37:56,398 INFO [Time-limited test] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:39943 2017-02-23 21:37:56,426 DEBUG [Time-limited test] impl.BackupManager(160): Added region procedure manager: org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager 2017-02-23 21:37:56,428 INFO [Time-limited test] client.ConnectionUtils(104): regionserver/xxx.hwx.site/xxx:0 server-side HConnection retries=350 2017-02-23 21:37:56,428 INFO [Time-limited test] ipc.SimpleRpcScheduler(196): Using fifo as user call queue, count=1 2017-02-23 21:37:56,430 INFO [Time-limited test] ipc.RpcServer$Listener(608): regionserver/xxx.hwx.site/xxx:0: started 10 reader(s). 2017-02-23 21:37:56,431 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,431 INFO [Time-limited test] hfile.CacheConfig(278): blockCache=LruBlockCache{blockCount=0, currentSize=1071760, freeSize=1042864304, maxSize=1043936064, heapSize=1071760, minSize=991739264, minFactor=0.95, multiSize=495869632, multiFactor=0.5, singleSize=247934816, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2017-02-23 21:37:56,432 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,433 INFO [Time-limited test] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:37:56,434 INFO [Time-limited test] zookeeper.RecoverableZooKeeper(120): Process identifier=regionserver:33605 connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:37:56,451 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:336050x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:37:56,452 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(578): regionserver:33605-0x15a6ce6fd4d004b connected 2017-02-23 21:37:56,452 DEBUG [Time-limited test] zookeeper.ZKUtil(367): regionserver:33605-0x15a6ce6fd4d004b, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2017-02-23 21:37:56,452 DEBUG [Time-limited test] zookeeper.ZKUtil(369): regionserver:33605-0x15a6ce6fd4d004b, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2017-02-23 21:37:56,453 INFO [RpcServer.responder] ipc.RpcServer$Responder(927): RpcServer.responder: starting 2017-02-23 21:37:56,453 INFO [RpcServer.listener,port=33605] ipc.RpcServer$Listener(739): RpcServer.listener,port=33605: starting 2017-02-23 21:37:56,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=0,queue=0,port=33605 2017-02-23 21:37:56,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=1,queue=0,port=33605 2017-02-23 21:37:56,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=2,queue=0,port=33605 2017-02-23 21:37:56,453 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=4,queue=0,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.default.handler=5,queue=0,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=0,queue=0,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=1,queue=1,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=2,queue=0,port=33605 2017-02-23 21:37:56,454 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=3,queue=1,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=4,queue=0,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=5,queue=1,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=6,queue=0,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=7,queue=1,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=8,queue=0,port=33605 2017-02-23 21:37:56,455 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=9,queue=1,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=10,queue=0,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=11,queue=1,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=12,queue=0,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=13,queue=1,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=14,queue=0,port=33605 2017-02-23 21:37:56,456 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=15,queue=1,port=33605 2017-02-23 21:37:56,457 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=16,queue=0,port=33605 2017-02-23 21:37:56,457 DEBUG [Time-limited test] ipc.RpcExecutor(129): Started RpcServer.FifoWFPBQ.priority.handler=17,queue=1,port=33605 2017-02-23 21:37:56,457 DEBUG [Time-limited test] ipc.RpcE ...[truncated 1847429 chars]... 1-000009:34412] wal.FSHLog(1203): Moved 1 WAL file(s) to /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/oldWALs 2017-02-23 21:38:16,271 INFO [RS:5;xxx:34412] wal.FSHLog(1206): Closed WAL: FSHLog xxx.hwx.site%2C34412%2C1487885876734.default:(num 1487885879728) 2017-02-23 21:38:16,271 DEBUG [RpcServer.reader=2,bindAddress=xxx.hwx.site,port=40406] ipc.RpcServer$Listener(882): RpcServer.listener,port=40406: DISCONNECTING client xxx:34399 because read count=-1. Number of active connections: 5 2017-02-23 21:38:16,271 DEBUG [RS:5;xxx:34412] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:38:16,271 DEBUG [RpcServer.reader=3,bindAddress=xxx.hwx.site,port=40406] ipc.RpcServer$Listener(882): RpcServer.listener,port=40406: DISCONNECTING client xxx:44260 because read count=-1. Number of active connections: 4 2017-02-23 21:38:16,281 INFO [RS:3;xxx:34528] regionserver.Leases(146): RS:3;xxx:34528 closing leases 2017-02-23 21:38:16,281 INFO [RS:3;xxx:34528] regionserver.Leases(149): RS:3;xxx:34528 closed leases 2017-02-23 21:38:16,281 INFO [RS:3;xxx:34528] hbase.ChoreService(302): Chore service for: xxx.hwx.site,34528,1487885876581 had [[ScheduledChore: Name: MovedRegionsCleaner for region xxx.hwx.site,34528,1487885876581 Period: 120000 Unit: MILLISECONDS]] on shutdown 2017-02-23 21:38:16,281 INFO [RS:5;xxx:34412] regionserver.Leases(146): RS:5;xxx:34412 closing leases 2017-02-23 21:38:16,281 INFO [RS:3;xxx:34528] regionserver.CompactSplitThread(413): Waiting for Split Thread to finish... 2017-02-23 21:38:16,281 INFO [RS:5;xxx:34412] regionserver.Leases(149): RS:5;xxx:34412 closed leases 2017-02-23 21:38:16,281 INFO [RS:3;xxx:34528] regionserver.CompactSplitThread(413): Waiting for Merge Thread to finish... 2017-02-23 21:38:16,282 INFO [RS:3;xxx:34528] regionserver.CompactSplitThread(413): Waiting for Large Compaction Thread to finish... 2017-02-23 21:38:16,282 INFO [RS:3;xxx:34528] regionserver.CompactSplitThread(413): Waiting for Small Compaction Thread to finish... 2017-02-23 21:38:16,282 INFO [RS:5;xxx:34412] hbase.ChoreService(302): Chore service for: xxx.hwx.site,34412,1487885876734 had [[ScheduledChore: Name: MovedRegionsCleaner for region xxx.hwx.site,34412,1487885876734 Period: 120000 Unit: MILLISECONDS]] on shutdown 2017-02-23 21:38:16,282 INFO [RS:5;xxx:34412] regionserver.CompactSplitThread(413): Waiting for Split Thread to finish... 2017-02-23 21:38:16,282 INFO [RS:5;xxx:34412] regionserver.CompactSplitThread(413): Waiting for Merge Thread to finish... 2017-02-23 21:38:16,282 INFO [RS:5;xxx:34412] regionserver.CompactSplitThread(413): Waiting for Large Compaction Thread to finish... 2017-02-23 21:38:16,283 INFO [RS:5;xxx:34412] regionserver.CompactSplitThread(413): Waiting for Small Compaction Thread to finish... 2017-02-23 21:38:16,288 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34528-0x15a6ce6fd4d004d, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,289 INFO [RS:3;xxx:34528] ipc.RpcServer(2248): Stopping server on 34528 2017-02-23 21:38:16,289 INFO [RpcServer.listener,port=34528] ipc.RpcServer$Listener(786): RpcServer.listener,port=34528: stopping 2017-02-23 21:38:16,292 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:16,293 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:16,297 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34412-0x15a6ce6fd4d004f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,297 INFO [RS:5;xxx:34412] ipc.RpcServer(2248): Stopping server on 34412 2017-02-23 21:38:16,297 INFO [RpcServer.listener,port=34412] ipc.RpcServer$Listener(786): RpcServer.listener,port=34412: stopping 2017-02-23 21:38:16,298 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:16,298 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:16,305 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,305 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34528-0x15a6ce6fd4d004d, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,305 INFO [Time-limited test-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [xxx.hwx.site,34528,1487885876581] 2017-02-23 21:38:16,305 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:43262-0x15a6ce6fd4d004e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,305 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34412-0x15a6ce6fd4d004f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,305 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:50723-0x15a6ce6fd4d004c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34528,1487885876581 2017-02-23 21:38:16,305 INFO [Time-limited test-EventThread] master.ServerManager(615): Cluster shutdown set; xxx.hwx.site,34528,1487885876581 expired; onlineServers=3 2017-02-23 21:38:16,306 INFO [RS_CLOSE_META-xxx:43262-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=199, memsize=6.6 K, hasBloomFilter=false, into tmp file hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/data/hbase/meta/1588230740/.tmp/717131babdd04922974772801498396a 2017-02-23 21:38:16,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34528-0x15a6ce6fd4d004d, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,313 INFO [Time-limited test-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [xxx.hwx.site,34412,1487885876734] 2017-02-23 21:38:16,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:34412-0x15a6ce6fd4d004f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:50723-0x15a6ce6fd4d004c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:43262-0x15a6ce6fd4d004e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,34412,1487885876734 2017-02-23 21:38:16,313 INFO [Time-limited test-EventThread] master.ServerManager(615): Cluster shutdown set; xxx.hwx.site,34412,1487885876734 expired; onlineServers=2 2017-02-23 21:38:16,314 DEBUG [RS_CLOSE_META-xxx:43262-0] regionserver.HRegionFileSystem(384): Committing store file hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/data/hbase/meta/1588230740/.tmp/717131babdd04922974772801498396a as hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/data/hbase/meta/1588230740/info/717131babdd04922974772801498396a 2017-02-23 21:38:16,321 INFO [RS_CLOSE_META-xxx:43262-0] regionserver.HStore(1011): Added hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/data/hbase/meta/1588230740/info/717131babdd04922974772801498396a, entries=27, sequenceid=199, filesize=7.9 K 2017-02-23 21:38:16,321 INFO [RS:3;xxx:34528] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,34528,1487885876581; zookeeper connection closed. 2017-02-23 21:38:16,322 INFO [RS:3;xxx:34528] regionserver.HRegionServer(1141): RS:3;xxx:34528 exiting 2017-02-23 21:38:16,322 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4848d5df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4848d5df 2017-02-23 21:38:16,322 INFO [RS_CLOSE_META-xxx:43262-0] regionserver.HRegion(2578): Finished memstore flush of ~6.62 KB/6776, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 456ms, sequenceid=199, compaction requested=true 2017-02-23 21:38:16,325 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(917): Closed info 2017-02-23 21:38:16,329 DEBUG [RS_CLOSE_META-xxx:43262-0] wal.WALSplitter(720): Wrote region seqId=hdfs://localhost:47833/user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/data/hbase/meta/1588230740/recovered.edits/202.seqid to file, newSeqId=202, maxSeqId=3 2017-02-23 21:38:16,330 INFO [RS:5;xxx:34412] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,34412,1487885876734; zookeeper connection closed. 2017-02-23 21:38:16,330 INFO [RS:5;xxx:34412] regionserver.HRegionServer(1141): RS:5;xxx:34412 exiting 2017-02-23 21:38:16,330 DEBUG [RS_CLOSE_META-xxx:43262-0] coprocessor.CoprocessorHost(273): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2017-02-23 21:38:16,330 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f3e3516] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f3e3516 2017-02-23 21:38:16,330 INFO [RS_CLOSE_META-xxx:43262-0] regionserver.HRegion(1581): Closed hbase:meta,,1.1588230740 2017-02-23 21:38:16,330 DEBUG [RS_CLOSE_META-xxx:43262-0] handler.CloseRegionHandler(164): Closed hbase:meta,,1.1588230740 2017-02-23 21:38:16,465 INFO [RS:4;xxx:43262] regionserver.HRegionServer(1094): stopping server xxx.hwx.site,43262,1487885876662; all regions closed. 2017-02-23 21:38:16,465 DEBUG [RS:4;xxx:43262] wal.FSHLog(1245): Closing WAL writer in /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/WALs/xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:16,503 DEBUG [RS:2;xxx:50723] wal.FSHLog(1203): Moved 1 WAL file(s) to /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/oldWALs 2017-02-23 21:38:16,503 INFO [RS:2;xxx:50723] wal.FSHLog(1206): Closed WAL: FSHLog xxx.hwx.site%2C50723%2C1487885876503.default:(num 1487885879728) 2017-02-23 21:38:16,503 DEBUG [RS:2;xxx:50723] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:38:16,503 DEBUG [RpcServer.reader=5,bindAddress=xxx.hwx.site,port=40406] ipc.RpcServer$Listener(882): RpcServer.listener,port=40406: DISCONNECTING client xxx:49134 because read count=-1. Number of active connections: 3 2017-02-23 21:38:16,513 INFO [RS:2;xxx:50723] regionserver.Leases(146): RS:2;xxx:50723 closing leases 2017-02-23 21:38:16,513 INFO [RS:2;xxx:50723] regionserver.Leases(149): RS:2;xxx:50723 closed leases 2017-02-23 21:38:16,514 INFO [RS:2;xxx:50723] hbase.ChoreService(302): Chore service for: xxx.hwx.site,50723,1487885876503 had [[ScheduledChore: Name: MovedRegionsCleaner for region xxx.hwx.site,50723,1487885876503 Period: 120000 Unit: MILLISECONDS]] on shutdown 2017-02-23 21:38:16,514 INFO [RS:2;xxx:50723] regionserver.CompactSplitThread(413): Waiting for Split Thread to finish... 2017-02-23 21:38:16,514 INFO [RS:2;xxx:50723] regionserver.CompactSplitThread(413): Waiting for Merge Thread to finish... 2017-02-23 21:38:16,514 INFO [RS:2;xxx:50723] regionserver.CompactSplitThread(413): Waiting for Large Compaction Thread to finish... 2017-02-23 21:38:16,514 INFO [RS:2;xxx:50723] regionserver.CompactSplitThread(413): Waiting for Small Compaction Thread to finish... 2017-02-23 21:38:16,522 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:50723-0x15a6ce6fd4d004c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/xxx.hwx.site,50723,1487885876503 2017-02-23 21:38:16,523 INFO [RS:2;xxx:50723] ipc.RpcServer(2248): Stopping server on 50723 2017-02-23 21:38:16,523 INFO [RpcServer.listener,port=50723] ipc.RpcServer$Listener(786): RpcServer.listener,port=50723: stopping 2017-02-23 21:38:16,527 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:16,529 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:16,546 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,50723,1487885876503 2017-02-23 21:38:16,546 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:43262-0x15a6ce6fd4d004e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,50723,1487885876503 2017-02-23 21:38:16,546 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:50723-0x15a6ce6fd4d004c, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,50723,1487885876503 2017-02-23 21:38:16,546 INFO [Time-limited test-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [xxx.hwx.site,50723,1487885876503] 2017-02-23 21:38:16,546 INFO [Time-limited test-EventThread] master.ServerManager(615): Cluster shutdown set; xxx.hwx.site,50723,1487885876503 expired; onlineServers=1 2017-02-23 21:38:16,579 INFO [RS:2;xxx:50723] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,50723,1487885876503; zookeeper connection closed. 2017-02-23 21:38:16,580 INFO [RS:2;xxx:50723] regionserver.HRegionServer(1141): RS:2;xxx:50723 exiting 2017-02-23 21:38:16,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d0f4760] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d0f4760 2017-02-23 21:38:16,873 WARN [HBase-Metrics2-1] impl.MetricsConfig(125): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2017-02-23 21:38:16,873 DEBUG [RS:4;xxx:43262] wal.FSHLog(1203): Moved 2 WAL file(s) to /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/oldWALs 2017-02-23 21:38:16,873 INFO [RS:4;xxx:43262] wal.FSHLog(1206): Closed WAL: FSHLog xxx.hwx.site%2C43262%2C1487885876662..meta:.meta(num 1487885891509) 2017-02-23 21:38:16,874 DEBUG [RS:4;xxx:43262] wal.FSHLog(1245): Closing WAL writer in /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/WALs/xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:16,981 INFO [M:0;xxx:40406] master.ServerManager(550): Waiting on regionserver(s) to go down xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:17,281 DEBUG [RS:4;xxx:43262] wal.FSHLog(1203): Moved 1 WAL file(s) to /user/nobody/test-data/349bb10c-fa22-4a3c-964f-8a1aa6cd7eea/oldWALs 2017-02-23 21:38:17,282 INFO [RS:4;xxx:43262] wal.FSHLog(1206): Closed WAL: FSHLog xxx.hwx.site%2C43262%2C1487885876662.default:(num 1487885879728) 2017-02-23 21:38:17,282 DEBUG [RS:4;xxx:43262] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:38:17,282 DEBUG [RpcServer.reader=1,bindAddress=xxx.hwx.site,port=40406] ipc.RpcServer$Listener(882): RpcServer.listener,port=40406: DISCONNECTING client xxx:51182 because read count=-1. Number of active connections: 2 2017-02-23 21:38:17,292 INFO [RS:4;xxx:43262] regionserver.Leases(146): RS:4;xxx:43262 closing leases 2017-02-23 21:38:17,292 INFO [RS:4;xxx:43262] regionserver.Leases(149): RS:4;xxx:43262 closed leases 2017-02-23 21:38:17,292 INFO [RS:4;xxx:43262] hbase.ChoreService(302): Chore service for: xxx.hwx.site,43262,1487885876662 had [[ScheduledChore: Name: MovedRegionsCleaner for region xxx.hwx.site,43262,1487885876662 Period: 120000 Unit: MILLISECONDS]] on shutdown 2017-02-23 21:38:17,313 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:43262-0x15a6ce6fd4d004e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:17,314 INFO [RS:4;xxx:43262] ipc.RpcServer(2248): Stopping server on 43262 2017-02-23 21:38:17,314 INFO [RpcServer.listener,port=43262] ipc.RpcServer$Listener(786): RpcServer.listener,port=43262: stopping 2017-02-23 21:38:17,315 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:17,315 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:17,330 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:17,331 INFO [Time-limited test-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [xxx.hwx.site,43262,1487885876662] 2017-02-23 21:38:17,331 INFO [Time-limited test-EventThread] master.ServerManager(615): Cluster shutdown set; xxx.hwx.site,43262,1487885876662 expired; onlineServers=0 2017-02-23 21:38:17,331 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): regionserver:43262-0x15a6ce6fd4d004e, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/xxx.hwx.site,43262,1487885876662 2017-02-23 21:38:17,331 DEBUG [M:0;xxx:40406] master.HMaster(1243): Stopping service threads 2017-02-23 21:38:17,339 INFO [RS:4;xxx:43262] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,43262,1487885876662; zookeeper connection closed. 2017-02-23 21:38:17,339 INFO [RS:4;xxx:43262] regionserver.HRegionServer(1141): RS:4;xxx:43262 exiting 2017-02-23 21:38:17,340 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66fb2eaa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(191): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66fb2eaa 2017-02-23 21:38:17,340 INFO [main] util.JVMClusterUtil(331): Shutdown of 2 master(s) and 6 regionserver(s) complete 2017-02-23 21:38:17,347 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2017-02-23 21:38:17,347 INFO [M:0;xxx:40406] client.ConnectionManager$HConnectionImplementation(1687): Closing zookeeper sessionid=0x15a6ce6fd4d0058 2017-02-23 21:38:17,347 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2017-02-23 21:38:17,347 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(369): master:40406-0x15a6ce6fd4d0048, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:38:17,355 DEBUG [M:0;xxx:40406] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:38:17,355 DEBUG [Time-limited test-EventThread] zookeeper.ZKUtil(369): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2017-02-23 21:38:17,366 INFO [M:0;xxx:40406] hbase.ChoreService(302): Chore service for: xxx.hwx.site,40406,1487885875957_splitLogManager_ had [] on shutdown 2017-02-23 21:38:17,366 INFO [M:0;xxx:40406] master.LogRollMasterProcedureManager(55): stop: server shutting down. 2017-02-23 21:38:17,367 INFO [M:0;xxx:40406] flush.MasterFlushTableProcedureManager(79): stop: server shutting down. 2017-02-23 21:38:17,367 INFO [M:0;xxx:40406] ipc.RpcServer(2248): Stopping server on 40406 2017-02-23 21:38:17,368 INFO [RpcServer.listener,port=40406] ipc.RpcServer$Listener(786): RpcServer.listener,port=40406: stopping 2017-02-23 21:38:17,368 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:17,368 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:17,380 INFO [M:0;xxx:40406] zookeeper.RecoverableZooKeeper(188): Node /hbase/rs/xxx.hwx.site,40406,1487885875957 already deleted, retry=false 2017-02-23 21:38:17,388 INFO [M:0;xxx:40406] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,40406,1487885875957; zookeeper connection closed. 2017-02-23 21:38:17,389 INFO [M:0;xxx:40406] regionserver.HRegionServer(1141): M:0;xxx:40406 exiting 2017-02-23 21:38:18,154 INFO [M:1;xxx:53646] regionserver.HRegionServer(807): ClusterId : fc8e9124-12b0-4951-8a7e-38d50435d742 2017-02-23 21:38:18,154 INFO [M:1;xxx:53646] regionserver.HRegionServer(1066): stopping server xxx.hwx.site,53646,1487885876213 2017-02-23 21:38:18,155 DEBUG [M:1;xxx:53646] zookeeper.MetaTableLocator(627): Stopping MetaTableLocator 2017-02-23 21:38:18,155 INFO [M:1;xxx:53646] client.ConnectionManager$HConnectionImplementation(1687): Closing zookeeper sessionid=0x15a6ce6fd4d0052 2017-02-23 21:38:18,164 DEBUG [M:1;xxx:53646] ipc.RpcClientImpl(1115): Stopping rpc client 2017-02-23 21:38:18,164 INFO [M:1;xxx:53646] regionserver.HRegionServer(1094): stopping server xxx.hwx.site,53646,1487885876213; all regions closed. 2017-02-23 21:38:18,164 INFO [M:1;xxx:53646] hbase.ChoreService(302): Chore service for: xxx.hwx.site,53646,1487885876213 had [] on shutdown 2017-02-23 21:38:18,164 DEBUG [M:1;xxx:53646] master.HMaster(1243): Stopping service threads 2017-02-23 21:38:18,164 DEBUG [M:1;xxx:53646] zookeeper.ZKUtil(626): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2017-02-23 21:38:18,164 WARN [M:1;xxx:53646] master.ActiveMasterManager(269): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2017-02-23 21:38:18,165 INFO [M:1;xxx:53646] ipc.RpcServer(2248): Stopping server on 53646 2017-02-23 21:38:18,166 INFO [RpcServer.listener,port=53646] ipc.RpcServer$Listener(786): RpcServer.listener,port=53646: stopping 2017-02-23 21:38:18,168 INFO [RpcServer.responder] ipc.RpcServer$Responder(1028): RpcServer.responder: stopped 2017-02-23 21:38:18,168 INFO [RpcServer.responder] ipc.RpcServer$Responder(931): RpcServer.responder: stopping 2017-02-23 21:38:18,172 INFO [M:1;xxx:53646] zookeeper.RecoverableZooKeeper(188): Node /hbase/rs/xxx.hwx.site,53646,1487885876213 already deleted, retry=false 2017-02-23 21:38:18,180 DEBUG [Time-limited test-EventThread] zookeeper.ZooKeeperWatcher(515): master:53646-0x15a6ce6fd4d0049, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/xxx.hwx.site,53646,1487885876213 2017-02-23 21:38:18,180 INFO [M:1;xxx:53646] regionserver.HRegionServer(1138): stopping server xxx.hwx.site,53646,1487885876213; zookeeper connection closed. 2017-02-23 21:38:18,181 INFO [M:1;xxx:53646] regionserver.HRegionServer(1141): M:1;xxx:53646 exiting 2017-02-23 21:38:18,181 INFO [main] fs.HFileSystem(256): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2017-02-23 21:38:18,188 INFO [main] zookeeper.RecoverableZooKeeper(120): Process identifier=testing utility connecting to ZooKeeper ensemble=localhost:55483 2017-02-23 21:38:18,197 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility0x0, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2017-02-23 21:38:18,197 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(578): testing utility-0x15a6ce6fd4d005f connected 2017-02-23 21:38:18,198 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/meta-region-server 2017-02-23 21:38:18,198 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master-maintenance 2017-02-23 21:38:18,198 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc 2017-02-23 21:38:18,199 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters 2017-02-23 21:38:18,199 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/switch 2017-02-23 21:38:18,199 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table 2017-02-23 21:38:18,199 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/draining 2017-02-23 21:38:18,200 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/region-in-transition 2017-02-23 21:38:18,200 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock 2017-02-23 21:38:18,200 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/balancer 2017-02-23 21:38:18,200 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace 2017-02-23 21:38:18,201 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/hbaseid 2017-02-23 21:38:18,201 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot 2017-02-23 21:38:18,201 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication 2017-02-23 21:38:18,201 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/splitWAL 2017-02-23 21:38:18,201 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/recovering-regions 2017-02-23 21:38:18,202 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs 2017-02-23 21:38:18,202 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc 2017-02-23 21:38:18,203 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/acquired 2017-02-23 21:38:18,203 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/abort 2017-02-23 21:38:18,203 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rolllog-proc/reached 2017-02-23 21:38:18,204 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:meta 2017-02-23 21:38:18,204 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/table 2017-02-23 21:38:18,204 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:namespace 2017-02-23 21:38:18,204 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table/hbase:backup 2017-02-23 21:38:18,205 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock/table 2017-02-23 21:38:18,205 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock/hbase:namespace 2017-02-23 21:38:18,205 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/table-lock/hbase:backup 2017-02-23 21:38:18,205 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace/default 2017-02-23 21:38:18,206 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace/hbase 2017-02-23 21:38:18,206 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired 2017-02-23 21:38:18,206 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/abort 2017-02-23 21:38:18,206 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached 2017-02-23 21:38:18,207 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication/peers 2017-02-23 21:38:18,207 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/replication/rs 2017-02-23 21:38:18,208 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired 2017-02-23 21:38:18,208 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/abort 2017-02-23 21:38:18,208 DEBUG [main] zookeeper.ZKUtil(367): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/replication 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/peers 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/hbase 2017-02-23 21:38:18,222 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/default 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock/hbase:backup 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/table-lock 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock/hbase:namespace 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock/table 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:backup 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/table 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:namespace 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/table 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table/hbase:meta 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/reached 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rolllog-proc 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/abort 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc/acquired 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/recovering-regions 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/hbaseid 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace 2017-02-23 21:38:18,223 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/balancer 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table-lock 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/region-in-transition 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/draining 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/table 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/switch 2017-02-23 21:38:18,224 INFO [org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@14f9a9d0] blockmanagement.BlockManager(1594): BLOCK* neededReplications = 0, pendingReplications = 0. 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rolllog-proc 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master-maintenance 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/meta-region-server 2017-02-23 21:38:18,224 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(515): testing utility-0x15a6ce6fd4d005f, quorum=localhost:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase