2014-12-01 14:57:38,978 INFO [main] hbase.HBaseTestingUtility(860): Starting up minicluster with 1 master(s) and 3 regionserver(s) and 3 datanode(s) 2014-12-01 14:57:39,001 INFO [main] hbase.HBaseTestingUtility(416): Created new mini-cluster data directory: /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408, deleteOnExit=true 2014-12-01 14:57:39,002 INFO [main] hbase.HBaseTestingUtility(647): Setting test.cache.data to /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/cache_data in system properties and HBase conf 2014-12-01 14:57:39,002 INFO [main] hbase.HBaseTestingUtility(647): Setting hadoop.tmp.dir to /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/hadoop_tmp in system properties and HBase conf 2014-12-01 14:57:39,003 INFO [main] hbase.HBaseTestingUtility(647): Setting hadoop.log.dir to /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/hadoop_logs in system properties and HBase conf 2014-12-01 14:57:39,003 INFO [main] hbase.HBaseTestingUtility(647): Setting mapreduce.cluster.local.dir to /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/mapred_local in system properties and HBase conf 2014-12-01 14:57:39,003 INFO [main] hbase.HBaseTestingUtility(647): Setting mapreduce.cluster.temp.dir to /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/mapred_temp in system properties and HBase conf 2014-12-01 14:57:39,003 INFO [main] hbase.HBaseTestingUtility(638): read short circuit is OFF 2014-12-01 14:57:39,129 WARN [main] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-12-01 14:57:39,300 DEBUG [main] fs.HFileSystem(221): The file system is not a DistributedFileSystem. Skipping on block location reordering Formatting using clusterid: testClusterID 2014-12-01 14:57:40,190 WARN [main] impl.MetricsConfig(124): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2014-12-01 14:57:40,319 INFO [main] log.Slf4jLog(67): Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2014-12-01 14:57:40,365 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:40,389 INFO [main] log.Slf4jLog(67): Extract jar:file:/Users/tyu/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.6.0/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to /var/folders/4g/2vdss5497xx9blpn2pbqc38r0000gn/T/Jetty_localhost_59531_hdfs____cqroih/webapp 2014-12-01 14:57:40,567 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59531 2014-12-01 14:57:40,975 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:40,983 INFO [main] log.Slf4jLog(67): Extract jar:file:/Users/tyu/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.6.0/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to /var/folders/4g/2vdss5497xx9blpn2pbqc38r0000gn/T/Jetty_localhost_59534_datanode____.vbxip3/webapp 2014-12-01 14:57:41,092 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59534 2014-12-01 14:57:41,162 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:41,166 INFO [main] log.Slf4jLog(67): Extract jar:file:/Users/tyu/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.6.0/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to /var/folders/4g/2vdss5497xx9blpn2pbqc38r0000gn/T/Jetty_localhost_59537_datanode____p54lng/webapp 2014-12-01 14:57:41,277 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59537 2014-12-01 14:57:41,310 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:41,314 INFO [main] log.Slf4jLog(67): Extract jar:file:/Users/tyu/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.6.0/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to /var/folders/4g/2vdss5497xx9blpn2pbqc38r0000gn/T/Jetty_localhost_59541_datanode____.p4vgln/webapp 2014-12-01 14:57:41,422 INFO [main] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59541 2014-12-01 14:57:41,520 INFO [IPC Server handler 9 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a node DatanodeRegistration(127.0.0.1, datanodeUuid=15c3c1fa-ed60-4106-a5be-c2df060414d1, infoPort=59537, ipcPort=59539, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs 2014-12-01 14:57:41,520 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8 node DatanodeRegistration(127.0.0.1, datanodeUuid=7768e998-7c86-4d6c-a3c8-3ae9df3f13d9, infoPort=59541, ipcPort=59542, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs 2014-12-01 14:57:41,520 INFO [IPC Server handler 9 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90 node DatanodeRegistration(127.0.0.1, datanodeUuid=15c3c1fa-ed60-4106-a5be-c2df060414d1, infoPort=59537, ipcPort=59539, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs 2014-12-01 14:57:41,520 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-506f875f-1ac9-49d8-9daf-ad78c098d008 node DatanodeRegistration(127.0.0.1, datanodeUuid=6a6985a0-336e-4771-8b7b-c07d6e1fabc3, infoPort=59534, ipcPort=59535, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs 2014-12-01 14:57:41,520 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-e0af5538-74ad-4501-be0f-92d1576a5756 node DatanodeRegistration(127.0.0.1, datanodeUuid=7768e998-7c86-4d6c-a3c8-3ae9df3f13d9, infoPort=59541, ipcPort=59542, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs 2014-12-01 14:57:41,520 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(1831): BLOCK* processReport: from storage DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece node DatanodeRegistration(127.0.0.1, datanodeUuid=6a6985a0-336e-4771-8b7b-c07d6e1fabc3, infoPort=59534, ipcPort=59535, storageInfo=lv=-56;cid=testClusterID;nsid=477668865;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs 2014-12-01 14:57:41,886 INFO [main] zookeeper.MiniZooKeeperCluster(198): Started MiniZooKeeperCluster and ran successful 'stat' on client port=63165 2014-12-01 14:57:42,077 INFO [IPC Server handler 6 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 7 2014-12-01 14:57:42,078 INFO [IPC Server handler 9 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741825_1001 size 7 2014-12-01 14:57:42,078 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741825_1001 size 7 2014-12-01 14:57:42,487 INFO [main] util.FSUtils(658): Created version file at hdfs://localhost:59532/user/tyu/hbase with version=8 2014-12-01 14:57:42,560 INFO [main] client.ConnectionUtils(102): master//10.11.6.43:0 server-side HConnection retries=350 2014-12-01 14:57:42,669 INFO [main] ipc.SimpleRpcScheduler(123): Using deadline as user call queue, count=1 2014-12-01 14:57:42,675 INFO [main] ipc.RpcServer$Listener(542): master//10.11.6.43:0: started 10 reader(s). 2014-12-01 14:57:42,707 INFO [main] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-12-01 14:57:42,740 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=master:59548 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:42,770 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:42,772 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): master:59548-0x14a0812ddeb0000 connected 2014-12-01 14:57:42,795 DEBUG [main] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-12-01 14:57:42,795 DEBUG [main] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:57:42,797 INFO [RpcServer.listener,port=59548] ipc.RpcServer$Listener(673): RpcServer.listener,port=59548: starting 2014-12-01 14:57:42,797 INFO [RpcServer.responder] ipc.RpcServer$Responder(861): RpcServer.responder: starting 2014-12-01 14:57:42,798 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=0 queue=0 2014-12-01 14:57:42,798 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=1 queue=0 2014-12-01 14:57:42,798 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=0 queue=0 2014-12-01 14:57:42,798 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=1 queue=0 2014-12-01 14:57:42,798 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=0 queue=0 2014-12-01 14:57:42,799 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=1 queue=0 2014-12-01 14:57:42,799 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=2 queue=0 2014-12-01 14:57:42,803 INFO [main] http.HttpRequestLog(69): Http request log for http.requests.master is not defined 2014-12-01 14:57:42,804 INFO [main] http.HttpServer(817): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-12-01 14:57:42,805 INFO [main] http.HttpServer(795): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2014-12-01 14:57:42,805 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-12-01 14:57:42,805 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-12-01 14:57:42,812 INFO [main] http.HttpServer(1009): Jetty bound to port 59550 2014-12-01 14:57:42,812 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:42,837 INFO [main] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:59550 2014-12-01 14:57:42,840 INFO [main] master.HMaster(279): hbase.rootdir=hdfs://localhost:59532/user/tyu/hbase, hbase.cluster.distributed=false 2014-12-01 14:57:42,847 INFO [main] master.HMaster(1282): Adding backup master ZNode /hbase/backup-masters/10.11.6.43,59548,1417474662690 2014-12-01 14:57:42,853 DEBUG [main] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/10.11.6.43,59548,1417474662690 2014-12-01 14:57:42,865 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2014-12-01 14:57:42,865 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-12-01 14:57:42,866 INFO [10.11.6.43:59548.activeMasterManager] master.ActiveMasterManager(166): Deleting ZNode for /hbase/backup-masters/10.11.6.43,59548,1417474662690 from backup master directory 2014-12-01 14:57:42,868 DEBUG [main-EventThread] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-12-01 14:57:42,869 DEBUG [main-EventThread] master.ActiveMasterManager(122): A master is now available 2014-12-01 14:57:42,869 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/10.11.6.43,59548,1417474662690 2014-12-01 14:57:42,870 WARN [10.11.6.43:59548.activeMasterManager] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-12-01 14:57:42,870 INFO [10.11.6.43:59548.activeMasterManager] master.ActiveMasterManager(175): Registered Active Master=10.11.6.43,59548,1417474662690 2014-12-01 14:57:42,904 INFO [main] client.ConnectionUtils(102): regionserver//10.11.6.43:0 server-side HConnection retries=350 2014-12-01 14:57:42,905 INFO [main] ipc.SimpleRpcScheduler(123): Using deadline as user call queue, count=1 2014-12-01 14:57:42,907 INFO [main] ipc.RpcServer$Listener(542): regionserver//10.11.6.43:0: started 10 reader(s). 2014-12-01 14:57:42,911 INFO [main] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-12-01 14:57:42,915 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=regionserver:59551 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:42,918 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:42,919 DEBUG [main] zookeeper.ZKUtil(424): regionserver:59551, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-12-01 14:57:42,920 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): regionserver:59551-0x14a0812ddeb0001 connected 2014-12-01 14:57:42,920 DEBUG [main] zookeeper.ZKUtil(426): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:57:42,920 INFO [RpcServer.responder] ipc.RpcServer$Responder(861): RpcServer.responder: starting 2014-12-01 14:57:42,921 INFO [RpcServer.listener,port=59551] ipc.RpcServer$Listener(673): RpcServer.listener,port=59551: starting 2014-12-01 14:57:42,921 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=0 queue=0 2014-12-01 14:57:42,921 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=1 queue=0 2014-12-01 14:57:42,922 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=0 queue=0 2014-12-01 14:57:42,922 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=1 queue=0 2014-12-01 14:57:42,922 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=0 queue=0 2014-12-01 14:57:42,922 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=1 queue=0 2014-12-01 14:57:42,923 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=2 queue=0 2014-12-01 14:57:42,923 INFO [main] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2014-12-01 14:57:42,924 INFO [main] http.HttpServer(817): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-12-01 14:57:42,924 INFO [main] http.HttpServer(795): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2014-12-01 14:57:42,924 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-12-01 14:57:42,924 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-12-01 14:57:42,926 INFO [main] http.HttpServer(1009): Jetty bound to port 59554 2014-12-01 14:57:42,926 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:42,944 INFO [IPC Server handler 2 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 0 2014-12-01 14:57:42,945 INFO [IPC Server handler 4 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:42,947 INFO [IPC Server handler 3 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|FINALIZED], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:42,949 INFO [main] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:59554 2014-12-01 14:57:42,950 DEBUG [10.11.6.43:59548.activeMasterManager] util.FSUtils(810): Created cluster ID file at hdfs://localhost:59532/user/tyu/hbase/hbase.id with ID: 8e638e47-44cd-46f2-bfed-8eb34b07ef1c 2014-12-01 14:57:42,975 INFO [10.11.6.43:59548.activeMasterManager] master.MasterFileSystem(502): BOOTSTRAP: creating hbase:meta region 2014-12-01 14:57:42,977 INFO [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(4571): creating HRegion hbase:meta HTD == 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => 'FOREVER', MIN_VERSIONS => '0', CACHE_DATA_IN_L1 => 'true', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE => 'false'} RootDir = hdfs://localhost:59532/user/tyu/hbase Table name == hbase:meta 2014-12-01 14:57:42,982 INFO [main] client.ConnectionUtils(102): regionserver//10.11.6.43:0 server-side HConnection retries=350 2014-12-01 14:57:42,983 INFO [main] ipc.SimpleRpcScheduler(123): Using deadline as user call queue, count=1 2014-12-01 14:57:42,985 INFO [main] ipc.RpcServer$Listener(542): regionserver//10.11.6.43:0: started 10 reader(s). 2014-12-01 14:57:42,989 INFO [main] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-12-01 14:57:42,993 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=regionserver:59559 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:42,996 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:42,997 DEBUG [main] zookeeper.ZKUtil(424): regionserver:59559, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-12-01 14:57:42,998 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): regionserver:59559-0x14a0812ddeb0002 connected 2014-12-01 14:57:42,998 DEBUG [main] zookeeper.ZKUtil(426): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:57:42,999 INFO [RpcServer.responder] ipc.RpcServer$Responder(861): RpcServer.responder: starting 2014-12-01 14:57:42,999 INFO [RpcServer.listener,port=59559] ipc.RpcServer$Listener(673): RpcServer.listener,port=59559: starting 2014-12-01 14:57:42,999 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=0 queue=0 2014-12-01 14:57:43,000 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=1 queue=0 2014-12-01 14:57:43,001 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=0 queue=0 2014-12-01 14:57:43,001 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=1 queue=0 2014-12-01 14:57:43,002 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=0 queue=0 2014-12-01 14:57:43,002 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=1 queue=0 2014-12-01 14:57:43,003 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=2 queue=0 2014-12-01 14:57:43,003 INFO [main] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2014-12-01 14:57:43,005 INFO [main] http.HttpServer(817): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-12-01 14:57:43,005 INFO [main] http.HttpServer(795): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2014-12-01 14:57:43,006 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-12-01 14:57:43,006 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-12-01 14:57:43,007 INFO [main] http.HttpServer(1009): Jetty bound to port 59564 2014-12-01 14:57:43,007 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:43,012 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW]]} size 0 2014-12-01 14:57:43,012 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:43,014 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,036 INFO [main] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:59564 2014-12-01 14:57:43,039 INFO [10.11.6.43:59548.activeMasterManager] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=hregion-65625892.default, suffix=, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/hregion-65625892, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,066 INFO [main] client.ConnectionUtils(102): regionserver//10.11.6.43:0 server-side HConnection retries=350 2014-12-01 14:57:43,066 INFO [10.11.6.43:59548.activeMasterManager] wal.FSHLog(1458): Slow sync cost: 14 ms, current pipeline: [] 2014-12-01 14:57:43,067 INFO [main] ipc.SimpleRpcScheduler(123): Using deadline as user call queue, count=1 2014-12-01 14:57:43,068 INFO [10.11.6.43:59548.activeMasterManager] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/hregion-65625892/hregion-65625892.default.1417474663040 2014-12-01 14:57:43,069 INFO [main] ipc.RpcServer$Listener(542): regionserver//10.11.6.43:0: started 10 reader(s). 2014-12-01 14:57:43,073 INFO [main] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-12-01 14:57:43,076 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=regionserver:59568 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,080 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,082 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): regionserver:59568-0x14a0812ddeb0003 connected 2014-12-01 14:57:43,082 DEBUG [main] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2014-12-01 14:57:43,088 DEBUG [main] zookeeper.ZKUtil(426): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:57:43,088 INFO [RpcServer.responder] ipc.RpcServer$Responder(861): RpcServer.responder: starting 2014-12-01 14:57:43,088 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=0 queue=0 2014-12-01 14:57:43,088 INFO [RpcServer.listener,port=59568] ipc.RpcServer$Listener(673): RpcServer.listener,port=59568: starting 2014-12-01 14:57:43,089 DEBUG [main] ipc.RpcExecutor(99): B.default Start Handler index=1 queue=0 2014-12-01 14:57:43,089 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=0 queue=0 2014-12-01 14:57:43,090 DEBUG [main] ipc.RpcExecutor(99): Priority Start Handler index=1 queue=0 2014-12-01 14:57:43,090 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=0 queue=0 2014-12-01 14:57:43,090 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=1 queue=0 2014-12-01 14:57:43,090 DEBUG [main] ipc.RpcExecutor(99): Replication Start Handler index=2 queue=0 2014-12-01 14:57:43,091 INFO [main] http.HttpRequestLog(69): Http request log for http.requests.regionserver is not defined 2014-12-01 14:57:43,091 INFO [main] http.HttpServer(817): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-12-01 14:57:43,092 INFO [main] http.HttpServer(795): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2014-12-01 14:57:43,092 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-12-01 14:57:43,092 INFO [main] http.HttpServer(802): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-12-01 14:57:43,093 INFO [main] http.HttpServer(1009): Jetty bound to port 59570 2014-12-01 14:57:43,094 INFO [main] log.Slf4jLog(67): jetty-6.1.26 2014-12-01 14:57:43,113 DEBUG [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(677): Instantiated hbase:meta,,1.1588230740 2014-12-01 14:57:43,117 INFO [main] log.Slf4jLog(67): Started SelectChannelConnector@0.0.0.0:59570 2014-12-01 14:57:43,154 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(470): Allocating LruBlockCache size=675.60 MB, blockSize=64 KB 2014-12-01 14:57:43,157 INFO [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x64cd041e connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,157 INFO [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x58a3b918 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,157 INFO [M:0;10.11.6.43:59548] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x4fc98145 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,157 INFO [RS:2;10.11.6.43:59568] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x5d3b2f61 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,161 DEBUG [RS:1;10.11.6.43:59559-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x64cd041e, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,162 DEBUG [RS:0;10.11.6.43:59551-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x58a3b918, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,162 DEBUG [M:0;10.11.6.43:59548-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x4fc98145, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,162 DEBUG [RS:2;10.11.6.43:59568-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x5d3b2f61, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,163 INFO [M:0;10.11.6.43:59548] client.ZooKeeperRegistry(85): ClusterId read in ZooKeeper is null 2014-12-01 14:57:43,163 DEBUG [RS:0;10.11.6.43:59551-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x58a3b918-0x14a0812ddeb0005 connected 2014-12-01 14:57:43,163 DEBUG [RS:1;10.11.6.43:59559-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x64cd041e-0x14a0812ddeb0004 connected 2014-12-01 14:57:43,162 INFO [RS:0;10.11.6.43:59551] client.ZooKeeperRegistry(85): ClusterId read in ZooKeeper is null 2014-12-01 14:57:43,162 INFO [RS:1;10.11.6.43:59559] client.ZooKeeperRegistry(85): ClusterId read in ZooKeeper is null 2014-12-01 14:57:43,164 DEBUG [RS:1;10.11.6.43:59559] client.ConnectionManager$HConnectionImplementation(821): clusterid came back null, using default default-cluster 2014-12-01 14:57:43,163 DEBUG [RS:0;10.11.6.43:59551] client.ConnectionManager$HConnectionImplementation(821): clusterid came back null, using default default-cluster 2014-12-01 14:57:43,163 DEBUG [M:0;10.11.6.43:59548-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x4fc98145-0x14a0812ddeb0006 connected 2014-12-01 14:57:43,163 DEBUG [M:0;10.11.6.43:59548] client.ConnectionManager$HConnectionImplementation(821): clusterid came back null, using default default-cluster 2014-12-01 14:57:43,163 INFO [RS:2;10.11.6.43:59568] client.ZooKeeperRegistry(85): ClusterId read in ZooKeeper is null 2014-12-01 14:57:43,164 DEBUG [RS:2;10.11.6.43:59568-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x5d3b2f61-0x14a0812ddeb0007 connected 2014-12-01 14:57:43,165 DEBUG [RS:2;10.11.6.43:59568] client.ConnectionManager$HConnectionImplementation(821): clusterid came back null, using default default-cluster 2014-12-01 14:57:43,168 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,170 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57f64238, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,170 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687597a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,170 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143272e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,170 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687597a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(93): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 604800000, major jitter 0.500000 2014-12-01 14:57:43,176 DEBUG [StoreOpener-1588230740-1] regionserver.HRegionFileSystem(197): No StoreFiles for: hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/info 2014-12-01 14:57:43,180 DEBUG [StoreOpener-1588230740-1] util.ChecksumType$2(70): org.apache.hadoop.util.PureJavaCrc32 available 2014-12-01 14:57:43,180 DEBUG [StoreOpener-1588230740-1] util.ChecksumType$3(113): org.apache.hadoop.util.PureJavaCrc32C available 2014-12-01 14:57:43,188 DEBUG [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(3388): Found 0 recovered edits file(s) under hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740 2014-12-01 14:57:43,197 INFO [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(787): Onlined 1588230740; next sequenceid=2 2014-12-01 14:57:43,197 DEBUG [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(1195): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-12-01 14:57:43,197 DEBUG [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(1222): Updates disabled for region hbase:meta,,1.1588230740 2014-12-01 14:57:43,198 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(830): Closed info 2014-12-01 14:57:43,198 INFO [10.11.6.43:59548.activeMasterManager] regionserver.HRegion(1310): Closed hbase:meta,,1.1588230740 2014-12-01 14:57:43,199 DEBUG [10.11.6.43:59548.activeMasterManager] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/hregion-65625892 2014-12-01 14:57:43,204 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 83 2014-12-01 14:57:43,204 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 83 2014-12-01 14:57:43,205 INFO [IPC Server handler 6 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 83 2014-12-01 14:57:43,212 DEBUG [10.11.6.43:59548.activeMasterManager] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:57:43,212 INFO [10.11.6.43:59548.activeMasterManager] wal.FSHLog(1075): Closed WAL: FSHLog hregion-65625892.default:(num 1417474663040) 2014-12-01 14:57:43,239 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:43,240 INFO [IPC Server handler 6 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:43,241 INFO [IPC Server handler 9 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|FINALIZED]]} size 0 2014-12-01 14:57:43,245 DEBUG [10.11.6.43:59548.activeMasterManager] util.FSTableDescriptors(719): Wrote descriptor into: hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2014-12-01 14:57:43,256 INFO [10.11.6.43:59548.activeMasterManager] fs.HFileSystem(252): Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-12-01 14:57:43,258 DEBUG [10.11.6.43:59548.activeMasterManager] coordination.ZKSplitLogManagerCoordination(870): Distributed log replay=true 2014-12-01 14:57:43,262 INFO [10.11.6.43:59548.activeMasterManager] coordination.ZKSplitLogManagerCoordination(598): Found 0 orphan tasks and 0 rescan nodes 2014-12-01 14:57:43,263 DEBUG [10.11.6.43:59548.activeMasterManager] util.FSTableDescriptors(223): Fetching table descriptors from the filesystem. 2014-12-01 14:57:43,275 INFO [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x375b9e1c connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,278 DEBUG [10.11.6.43:59548.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x375b9e1c, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,279 DEBUG [10.11.6.43:59548.activeMasterManager] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44cb07ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,279 DEBUG [10.11.6.43:59548.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x375b9e1c-0x14a0812ddeb0008 connected 2014-12-01 14:57:43,281 DEBUG [10.11.6.43:59548.activeMasterManager] master.TableStateManager(55): Adding table state: hbase:meta: ENABLED 2014-12-01 14:57:43,287 INFO [10.11.6.43:59548.activeMasterManager] balancer.StochasticLoadBalancer(135): loading config 2014-12-01 14:57:43,293 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2014-12-01 14:57:43,309 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-12-01 14:57:43,309 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-12-01 14:57:43,309 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-12-01 14:57:43,309 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2014-12-01 14:57:43,309 INFO [10.11.6.43:59548.activeMasterManager] master.HMaster(467): Server active/primary master=10.11.6.43,59548,1417474662690, sessionid=0x14a0812ddeb0000, setting cluster-up flag (Was=false) 2014-12-01 14:57:43,311 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(711): ClusterId : 8e638e47-44cd-46f2-bfed-8eb34b07ef1c 2014-12-01 14:57:43,311 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(711): ClusterId : 8e638e47-44cd-46f2-bfed-8eb34b07ef1c 2014-12-01 14:57:43,311 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(711): ClusterId : 8e638e47-44cd-46f2-bfed-8eb34b07ef1c 2014-12-01 14:57:43,311 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(711): ClusterId : 8e638e47-44cd-46f2-bfed-8eb34b07ef1c 2014-12-01 14:57:43,314 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-12-01 14:57:43,314 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-12-01 14:57:43,314 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-12-01 14:57:43,314 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(44): Procedure online-snapshot is initializing 2014-12-01 14:57:43,320 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot already exists 2014-12-01 14:57:43,320 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot already exists 2014-12-01 14:57:43,320 DEBUG [RS:2;10.11.6.43:59568] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot already exists 2014-12-01 14:57:43,321 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/acquired already exists 2014-12-01 14:57:43,321 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/acquired already exists 2014-12-01 14:57:43,321 DEBUG [RS:2;10.11.6.43:59568] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/acquired already exists 2014-12-01 14:57:43,321 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/acquired already exists 2014-12-01 14:57:43,323 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/reached already exists 2014-12-01 14:57:43,323 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/reached already exists 2014-12-01 14:57:43,323 DEBUG [RS:2;10.11.6.43:59568] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/reached already exists 2014-12-01 14:57:43,324 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/abort already exists 2014-12-01 14:57:43,325 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/abort already exists 2014-12-01 14:57:43,325 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/online-snapshot/abort already exists 2014-12-01 14:57:43,325 INFO [10.11.6.43:59548.activeMasterManager] procedure.ZKProcedureUtil(271): Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2014-12-01 14:57:43,325 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-12-01 14:57:43,325 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-12-01 14:57:43,325 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-12-01 14:57:43,325 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(46): Procedure online-snapshot is initialized 2014-12-01 14:57:43,326 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-12-01 14:57:43,326 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-12-01 14:57:43,325 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-12-01 14:57:43,325 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(44): Procedure flush-table-proc is initializing 2014-12-01 14:57:43,327 DEBUG [10.11.6.43:59548.activeMasterManager] procedure.ZKProcedureCoordinatorRpcs(238): Starting the controller for procedure member:10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,328 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc already exists 2014-12-01 14:57:43,328 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc already exists 2014-12-01 14:57:43,328 DEBUG [M:0;10.11.6.43:59548] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc already exists 2014-12-01 14:57:43,329 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/acquired already exists 2014-12-01 14:57:43,329 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/acquired already exists 2014-12-01 14:57:43,330 DEBUG [M:0;10.11.6.43:59548] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/acquired already exists 2014-12-01 14:57:43,331 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/reached already exists 2014-12-01 14:57:43,331 DEBUG [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/reached already exists 2014-12-01 14:57:43,331 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/acquired already exists 2014-12-01 14:57:43,333 DEBUG [M:0;10.11.6.43:59548] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/abort already exists 2014-12-01 14:57:43,333 DEBUG [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(531): Node /hbase/flush-table-proc/abort already exists 2014-12-01 14:57:43,333 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-12-01 14:57:43,333 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-12-01 14:57:43,333 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-12-01 14:57:43,333 INFO [10.11.6.43:59548.activeMasterManager] procedure.ZKProcedureUtil(271): Clearing all procedure znodes: /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-12-01 14:57:43,333 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(46): Procedure flush-table-proc is initialized 2014-12-01 14:57:43,335 DEBUG [10.11.6.43:59548.activeMasterManager] procedure.ZKProcedureCoordinatorRpcs(238): Starting the controller for procedure member:10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,336 INFO [RS:0;10.11.6.43:59551] regionserver.MemStoreFlusher(117): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-12-01 14:57:43,337 INFO [RS:2;10.11.6.43:59568] regionserver.MemStoreFlusher(117): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-12-01 14:57:43,336 INFO [M:0;10.11.6.43:59548] regionserver.MemStoreFlusher(117): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-12-01 14:57:43,336 INFO [RS:1;10.11.6.43:59559] regionserver.MemStoreFlusher(117): globalMemStoreLimit=675.6 M, globalMemStoreLimitLowMark=641.8 M, maxHeap=1.6 G 2014-12-01 14:57:43,340 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer$CompactionChecker(1420): CompactionChecker runs every 1sec 2014-12-01 14:57:43,340 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer$CompactionChecker(1420): CompactionChecker runs every 1sec 2014-12-01 14:57:43,340 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer$CompactionChecker(1420): CompactionChecker runs every 1sec 2014-12-01 14:57:43,340 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer$CompactionChecker(1420): CompactionChecker runs every 1sec 2014-12-01 14:57:43,343 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@99051d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=10.11.6.43/10.11.6.43:0 2014-12-01 14:57:43,344 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12461108, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=10.11.6.43/10.11.6.43:0 2014-12-01 14:57:43,344 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@569f64ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=10.11.6.43/10.11.6.43:0 2014-12-01 14:57:43,344 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c78b84d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=10.11.6.43/10.11.6.43:0 2014-12-01 14:57:43,346 DEBUG [RS:0;10.11.6.43:59551] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:0;10.11.6.43:59551 2014-12-01 14:57:43,346 DEBUG [RS:2;10.11.6.43:59568] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:2;10.11.6.43:59568 2014-12-01 14:57:43,346 DEBUG [M:0;10.11.6.43:59548] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:M:0;10.11.6.43:59548 2014-12-01 14:57:43,346 DEBUG [RS:1;10.11.6.43:59559] regionserver.ShutdownHook(87): Installed shutdown hook thread: Shutdownhook:RS:1;10.11.6.43:59559 2014-12-01 14:57:43,349 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-12-01 14:57:43,350 DEBUG [M:0;10.11.6.43:59548] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,350 DEBUG [RS:2;10.11.6.43:59568] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,350 DEBUG [RS:0;10.11.6.43:59551] zookeeper.ZKUtil(424): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,350 DEBUG [RS:1;10.11.6.43:59559] zookeeper.ZKUtil(424): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,351 DEBUG [main-EventThread] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,351 DEBUG [main-EventThread] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,352 DEBUG [main-EventThread] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,352 DEBUG [main-EventThread] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,353 DEBUG [main-EventThread] zookeeper.RegionServerTracker(93): Added tracking of RS /hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,354 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(2128): reportForDuty to master=10.11.6.43,59548,1417474662690 with port=59548, startcode=1417474662690 2014-12-01 14:57:43,354 DEBUG [main-EventThread] zookeeper.RegionServerTracker(93): Added tracking of RS /hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,355 DEBUG [main-EventThread] zookeeper.RegionServerTracker(93): Added tracking of RS /hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,355 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(2128): reportForDuty to master=10.11.6.43,59548,1417474662690 with port=59551, startcode=1417474662907 2014-12-01 14:57:43,355 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(2128): reportForDuty to master=10.11.6.43,59548,1417474662690 with port=59559, startcode=1417474662986 2014-12-01 14:57:43,355 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(2128): reportForDuty to master=10.11.6.43,59548,1417474662690 with port=59568, startcode=1417474663070 2014-12-01 14:57:43,355 DEBUG [main-EventThread] zookeeper.RegionServerTracker(93): Added tracking of RS /hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,356 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=MASTER_OPEN_REGION-10.11.6.43:59548, corePoolSize=5, maxPoolSize=5 2014-12-01 14:57:43,357 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=MASTER_CLOSE_REGION-10.11.6.43:59548, corePoolSize=5, maxPoolSize=5 2014-12-01 14:57:43,357 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=MASTER_SERVER_OPERATIONS-10.11.6.43:59548, corePoolSize=5, maxPoolSize=5 2014-12-01 14:57:43,357 DEBUG [M:0;10.11.6.43:59548] regionserver.HRegionServer(2144): Master is not running yet 2014-12-01 14:57:43,357 WARN [M:0;10.11.6.43:59548] regionserver.HRegionServer(828): reportForDuty failed; sleeping and then retrying. 2014-12-01 14:57:43,357 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=MASTER_META_SERVER_OPERATIONS-10.11.6.43:59548, corePoolSize=5, maxPoolSize=5 2014-12-01 14:57:43,357 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=M_LOG_REPLAY_OPS-10.11.6.43:59548, corePoolSize=10, maxPoolSize=10 2014-12-01 14:57:43,357 DEBUG [10.11.6.43:59548.activeMasterManager] executor.ExecutorService(91): Starting executor service name=MASTER_TABLE_OPERATIONS-10.11.6.43:59548, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,359 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2014-12-01 14:57:43,360 INFO [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(121): Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,362 DEBUG [10.11.6.43:59548.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(304): replicationLogCleaner, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,364 DEBUG [10.11.6.43:59548.activeMasterManager-EventThread] zookeeper.ZooKeeperWatcher(388): replicationLogCleaner-0x14a0812ddeb0009 connected 2014-12-01 14:57:43,368 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2014-12-01 14:57:43,370 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotLogCleaner 2014-12-01 14:57:43,371 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2014-12-01 14:57:43,372 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2014-12-01 14:57:43,372 DEBUG [10.11.6.43:59548.activeMasterManager] cleaner.CleanerChore(91): initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2014-12-01 14:57:43,373 INFO [10.11.6.43:59548.activeMasterManager] master.ServerManager(899): Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 3, maximum of 3, timeout of 4500 ms, interval of 1500 ms. 2014-12-01 14:57:43,373 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(2128): reportForDuty to master=10.11.6.43,59548,1417474662690 with port=59548, startcode=1417474662690 2014-12-01 14:57:43,378 INFO [M:0;10.11.6.43:59548] master.ServerManager(406): Registering server=10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,380 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1251): Config from master: hbase.rootdir=hdfs://localhost:59532/user/tyu/hbase 2014-12-01 14:57:43,380 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1251): Config from master: fs.defaultFS=hdfs://localhost:59532 2014-12-01 14:57:43,380 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1251): Config from master: hbase.master.info.port=59550 2014-12-01 14:57:43,381 WARN [M:0;10.11.6.43:59548] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-12-01 14:57:43,381 INFO [M:0;10.11.6.43:59548] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,381 DEBUG [M:0;10.11.6.43:59548] regionserver.HRegionServer(1517): logdir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,393 DEBUG [M:0;10.11.6.43:59548] regionserver.Replication(139): ReplicationStatisticsThread 300 2014-12-01 14:57:43,396 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service RegionServerStatusService, sasl=false 2014-12-01 14:57:43,396 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service RegionServerStatusService, sasl=false 2014-12-01 14:57:43,396 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service RegionServerStatusService, sasl=false 2014-12-01 14:57:43,398 INFO [M:0;10.11.6.43:59548] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=10.11.6.43%2C59548%2C1417474662690.default, suffix=, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,405 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:43,405 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:43,405 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:43,412 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59582; # active connections: 1 2014-12-01 14:57:43,412 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59583; # active connections: 2 2014-12-01 14:57:43,412 INFO [M:0;10.11.6.43:59548] wal.FSHLog(1458): Slow sync cost: 10 ms, current pipeline: [] 2014-12-01 14:57:43,413 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59584; # active connections: 3 2014-12-01 14:57:43,413 INFO [M:0;10.11.6.43:59548] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690/10.11.6.43%2C59548%2C1417474662690.default.1417474663398 2014-12-01 14:57:43,420 INFO [M:0;10.11.6.43:59548] regionserver.MetricsRegionServerWrapperImpl(110): Computing regionserver metrics every 5000 milliseconds 2014-12-01 14:57:43,422 INFO [B.defaultRpcServer.handler=1,queue=0,port=59548] master.ServerManager(406): Registering server=10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,422 INFO [B.defaultRpcServer.handler=0,queue=0,port=59548] master.ServerManager(406): Registering server=10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,423 INFO [10.11.6.43:59548.activeMasterManager] master.ServerManager(916): Finished waiting for region servers count to settle; checked in 3, slept for 50 ms, expecting minimum of 3, maximum of 3, master is running 2014-12-01 14:57:43,423 INFO [10.11.6.43:59548.activeMasterManager] master.ServerManager(406): Registering server=10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,423 INFO [10.11.6.43:59548.activeMasterManager] master.HMaster(569): Registered server found up in zk but who has not yet reported in: 10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,424 DEBUG [M:0;10.11.6.43:59548] executor.ExecutorService(91): Starting executor service name=RS_OPEN_REGION-10.11.6.43:59548, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,424 DEBUG [M:0;10.11.6.43:59548] executor.ExecutorService(91): Starting executor service name=RS_OPEN_META-10.11.6.43:59548, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,424 DEBUG [M:0;10.11.6.43:59548] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_REGION-10.11.6.43:59548, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,425 DEBUG [M:0;10.11.6.43:59548] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_META-10.11.6.43:59548, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,425 DEBUG [M:0;10.11.6.43:59548] executor.ExecutorService(91): Starting executor service name=RS_LOG_REPLAY_OPS-10.11.6.43:59548, corePoolSize=2, maxPoolSize=2 2014-12-01 14:57:43,427 INFO [10.11.6.43:59548.activeMasterManager] master.MasterFileSystem(253): Log folder hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690 belongs to an existing region server 2014-12-01 14:57:43,427 WARN [10.11.6.43:59548.activeMasterManager] wal.DefaultWALProvider(327): Cannot parse a server name from path=hdfs://localhost:59532/user/tyu/hbase/WALs/hregion-65625892; Not a host:port pair: hregion-65625892 2014-12-01 14:57:43,427 WARN [10.11.6.43:59548.activeMasterManager] master.MasterFileSystem(245): Log folder hdfs://localhost:59532/user/tyu/hbase/WALs/hregion-65625892 doesn't look like its name includes a region server name; leaving in place. If you see later errors about missing write ahead logs they may be saved in this location. 2014-12-01 14:57:43,427 DEBUG [M:0;10.11.6.43:59548] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,428 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1251): Config from master: hbase.rootdir=hdfs://localhost:59532/user/tyu/hbase 2014-12-01 14:57:43,428 INFO [B.defaultRpcServer.handler=0,queue=0,port=59548] master.ServerManager(406): Registering server=10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,429 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1251): Config from master: fs.defaultFS=hdfs://localhost:59532 2014-12-01 14:57:43,428 DEBUG [M:0;10.11.6.43:59548] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,428 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1251): Config from master: hbase.rootdir=hdfs://localhost:59532/user/tyu/hbase 2014-12-01 14:57:43,429 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1251): Config from master: hbase.master.info.port=59550 2014-12-01 14:57:43,429 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1251): Config from master: hbase.rootdir=hdfs://localhost:59532/user/tyu/hbase 2014-12-01 14:57:43,429 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1251): Config from master: fs.defaultFS=hdfs://localhost:59532 2014-12-01 14:57:43,430 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1251): Config from master: fs.defaultFS=hdfs://localhost:59532 2014-12-01 14:57:43,430 WARN [RS:1;10.11.6.43:59559] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-12-01 14:57:43,430 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.ZKUtil(683): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-12-01 14:57:43,430 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1251): Config from master: hbase.master.info.port=59550 2014-12-01 14:57:43,430 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1251): Config from master: hbase.master.info.port=59550 2014-12-01 14:57:43,430 DEBUG [M:0;10.11.6.43:59548] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,431 WARN [RS:0;10.11.6.43:59551] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-12-01 14:57:43,431 WARN [RS:2;10.11.6.43:59568] hbase.ZNodeClearer(58): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2014-12-01 14:57:43,430 INFO [RS:1;10.11.6.43:59559] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,431 DEBUG [M:0;10.11.6.43:59548] zookeeper.ZKUtil(424): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,431 INFO [RS:2;10.11.6.43:59568] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,431 INFO [RS:0;10.11.6.43:59551] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,432 DEBUG [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1517): logdir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,431 INFO [M:0;10.11.6.43:59548] regionserver.ReplicationSourceManager(226): Current list of replicators: [10.11.6.43,59548,1417474662690] other RSs: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] 2014-12-01 14:57:43,431 DEBUG [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1517): logdir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,432 DEBUG [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1517): logdir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,439 DEBUG [RS:2;10.11.6.43:59568] regionserver.Replication(139): ReplicationStatisticsThread 300 2014-12-01 14:57:43,440 DEBUG [RS:1;10.11.6.43:59559] regionserver.Replication(139): ReplicationStatisticsThread 300 2014-12-01 14:57:43,440 DEBUG [RS:0;10.11.6.43:59551] regionserver.Replication(139): ReplicationStatisticsThread 300 2014-12-01 14:57:43,445 INFO [RS:2;10.11.6.43:59568] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=10.11.6.43%2C59568%2C1417474663070.default, suffix=, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59568,1417474663070, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,446 INFO [RS:1;10.11.6.43:59559] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=10.11.6.43%2C59559%2C1417474662986.default, suffix=, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59559,1417474662986, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,446 INFO [RS:0;10.11.6.43:59551] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=10.11.6.43%2C59551%2C1417474662907.default, suffix=, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59551,1417474662907, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,470 INFO [RS:2;10.11.6.43:59568] wal.FSHLog(1458): Slow sync cost: 19 ms, current pipeline: [] 2014-12-01 14:57:43,471 INFO [RS:2;10.11.6.43:59568] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/10.11.6.43,59568,1417474663070/10.11.6.43%2C59568%2C1417474663070.default.1417474663446 2014-12-01 14:57:43,473 INFO [RS:0;10.11.6.43:59551] wal.FSHLog(1458): Slow sync cost: 21 ms, current pipeline: [] 2014-12-01 14:57:43,473 INFO [RS:2;10.11.6.43:59568] regionserver.MetricsRegionServerWrapperImpl(110): Computing regionserver metrics every 5000 milliseconds 2014-12-01 14:57:43,473 INFO [RS:1;10.11.6.43:59559] wal.FSHLog(1458): Slow sync cost: 20 ms, current pipeline: [] 2014-12-01 14:57:43,473 INFO [RS:0;10.11.6.43:59551] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/10.11.6.43,59551,1417474662907/10.11.6.43%2C59551%2C1417474662907.default.1417474663446 2014-12-01 14:57:43,473 INFO [RS:1;10.11.6.43:59559] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/10.11.6.43,59559,1417474662986/10.11.6.43%2C59559%2C1417474662986.default.1417474663446 2014-12-01 14:57:43,474 DEBUG [RS:2;10.11.6.43:59568] executor.ExecutorService(91): Starting executor service name=RS_OPEN_REGION-10.11.6.43:59568, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,474 DEBUG [RS:2;10.11.6.43:59568] executor.ExecutorService(91): Starting executor service name=RS_OPEN_META-10.11.6.43:59568, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,498 DEBUG [RS:2;10.11.6.43:59568] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_REGION-10.11.6.43:59568, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,499 DEBUG [RS:2;10.11.6.43:59568] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_META-10.11.6.43:59568, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,500 DEBUG [RS:2;10.11.6.43:59568] executor.ExecutorService(91): Starting executor service name=RS_LOG_REPLAY_OPS-10.11.6.43:59568, corePoolSize=2, maxPoolSize=2 2014-12-01 14:57:43,500 INFO [RS:0;10.11.6.43:59551] regionserver.MetricsRegionServerWrapperImpl(110): Computing regionserver metrics every 5000 milliseconds 2014-12-01 14:57:43,501 INFO [RS:1;10.11.6.43:59559] regionserver.MetricsRegionServerWrapperImpl(110): Computing regionserver metrics every 5000 milliseconds 2014-12-01 14:57:43,508 DEBUG [RS:0;10.11.6.43:59551] executor.ExecutorService(91): Starting executor service name=RS_OPEN_REGION-10.11.6.43:59551, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,508 DEBUG [RS:0;10.11.6.43:59551] executor.ExecutorService(91): Starting executor service name=RS_OPEN_META-10.11.6.43:59551, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,508 DEBUG [RS:0;10.11.6.43:59551] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_REGION-10.11.6.43:59551, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,509 DEBUG [RS:1;10.11.6.43:59559] executor.ExecutorService(91): Starting executor service name=RS_OPEN_REGION-10.11.6.43:59559, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,509 DEBUG [RS:0;10.11.6.43:59551] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_META-10.11.6.43:59551, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,509 DEBUG [RS:1;10.11.6.43:59559] executor.ExecutorService(91): Starting executor service name=RS_OPEN_META-10.11.6.43:59559, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,509 DEBUG [RS:0;10.11.6.43:59551] executor.ExecutorService(91): Starting executor service name=RS_LOG_REPLAY_OPS-10.11.6.43:59551, corePoolSize=2, maxPoolSize=2 2014-12-01 14:57:43,509 DEBUG [RS:1;10.11.6.43:59559] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_REGION-10.11.6.43:59559, corePoolSize=3, maxPoolSize=3 2014-12-01 14:57:43,510 DEBUG [RS:2;10.11.6.43:59568] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,510 DEBUG [RS:1;10.11.6.43:59559] executor.ExecutorService(91): Starting executor service name=RS_CLOSE_META-10.11.6.43:59559, corePoolSize=1, maxPoolSize=1 2014-12-01 14:57:43,510 DEBUG [RS:1;10.11.6.43:59559] executor.ExecutorService(91): Starting executor service name=RS_LOG_REPLAY_OPS-10.11.6.43:59559, corePoolSize=2, maxPoolSize=2 2014-12-01 14:57:43,510 DEBUG [RS:2;10.11.6.43:59568] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,511 DEBUG [RS:2;10.11.6.43:59568] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,512 DEBUG [RS:2;10.11.6.43:59568] zookeeper.ZKUtil(424): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,512 INFO [M:0;10.11.6.43:59548] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x62e39247 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,512 INFO [RS:2;10.11.6.43:59568] regionserver.ReplicationSourceManager(226): Current list of replicators: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] other RSs: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] 2014-12-01 14:57:43,515 DEBUG [RS:0;10.11.6.43:59551] zookeeper.ZKUtil(424): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,515 DEBUG [RS:1;10.11.6.43:59559] zookeeper.ZKUtil(424): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,516 DEBUG [M:0;10.11.6.43:59548-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x62e39247, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,516 DEBUG [RS:0;10.11.6.43:59551] zookeeper.ZKUtil(424): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,516 DEBUG [RS:1;10.11.6.43:59559] zookeeper.ZKUtil(424): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,517 DEBUG [RS:0;10.11.6.43:59551] zookeeper.ZKUtil(424): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,517 DEBUG [RS:1;10.11.6.43:59559] zookeeper.ZKUtil(424): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,518 DEBUG [M:0;10.11.6.43:59548-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x62e39247-0x14a0812ddeb000a connected 2014-12-01 14:57:43,518 DEBUG [RS:0;10.11.6.43:59551] zookeeper.ZKUtil(424): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,518 DEBUG [RS:1;10.11.6.43:59559] zookeeper.ZKUtil(424): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,518 INFO [RS:0;10.11.6.43:59551] regionserver.ReplicationSourceManager(226): Current list of replicators: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] other RSs: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] 2014-12-01 14:57:43,518 INFO [RS:1;10.11.6.43:59559] regionserver.ReplicationSourceManager(226): Current list of replicators: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] other RSs: [10.11.6.43,59551,1417474662907, 10.11.6.43,59548,1417474662690, 10.11.6.43,59568,1417474663070, 10.11.6.43,59559,1417474662986] 2014-12-01 14:57:43,518 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@29a39fe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,539 INFO [RS:2;10.11.6.43:59568] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x426fc3c connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,543 DEBUG [RS:2;10.11.6.43:59568-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x426fc3c, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,545 INFO [RS:0;10.11.6.43:59551] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x5da6c0e0 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,545 DEBUG [RS:2;10.11.6.43:59568-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x426fc3c-0x14a0812ddeb000b connected 2014-12-01 14:57:43,545 INFO [RS:1;10.11.6.43:59559] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x6ec0e228 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:43,546 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@77ba2ad8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,549 DEBUG [RS:0;10.11.6.43:59551-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x5da6c0e0, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,550 DEBUG [RS:1;10.11.6.43:59559-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x6ec0e228, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:43,551 DEBUG [RS:0;10.11.6.43:59551-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x5da6c0e0-0x14a0812ddeb000c connected 2014-12-01 14:57:43,552 DEBUG [RS:1;10.11.6.43:59559-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x6ec0e228-0x14a0812ddeb000d connected 2014-12-01 14:57:43,552 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@4d4afa76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,552 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodecWithTags@9234157, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:43,552 INFO [SplitLogWorker-10.11.6.43:59548] regionserver.SplitLogWorker(134): SplitLogWorker 10.11.6.43,59548,1417474662690 starting 2014-12-01 14:57:43,553 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1273): Serving as 10.11.6.43,59548,1417474662690, RpcServer on 10.11.6.43/10.11.6.43:59548, sessionid=0x14a0812ddeb0000 2014-12-01 14:57:43,554 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-12-01 14:57:43,554 DEBUG [M:0;10.11.6.43:59548] snapshot.RegionServerSnapshotManager(122): Start Snapshot Manager 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,554 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59548,1417474662690' 2014-12-01 14:57:43,554 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-12-01 14:57:43,555 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-12-01 14:57:43,556 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-12-01 14:57:43,556 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-12-01 14:57:43,556 DEBUG [M:0;10.11.6.43:59548] flush.RegionServerFlushTableProcedureManager(101): Start region server flush procedure manager 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,556 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59548,1417474662690' 2014-12-01 14:57:43,556 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-12-01 14:57:43,557 DEBUG [M:0;10.11.6.43:59548] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-12-01 14:57:43,558 DEBUG [M:0;10.11.6.43:59548] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-12-01 14:57:43,562 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.ZKUtil(683): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Unable to get data of znode /hbase/meta-region-server because node does not exist (not an error) 2014-12-01 14:57:43,562 INFO [10.11.6.43:59548.activeMasterManager] master.HMaster(730): Re-assigning hbase:meta, it was on null 2014-12-01 14:57:43,563 INFO [M:0;10.11.6.43:59548] quotas.RegionServerQuotaManager(62): Quota support disabled 2014-12-01 14:57:43,564 DEBUG [10.11.6.43:59548.activeMasterManager] master.AssignmentManager(1230): No previous transition plan found (or ignoring an existing plan) for hbase:meta,,1.1588230740; generated random plan=hri=hbase:meta,,1.1588230740, src=, dest=10.11.6.43,59548,1417474662690; 4 (online=4) available servers, forceNewPlan=false 2014-12-01 14:57:43,564 INFO [10.11.6.43:59548.activeMasterManager] master.AssignmentManager(1019): Assigning hbase:meta,,1.1588230740 to 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,565 INFO [10.11.6.43:59548.activeMasterManager] master.RegionStates(973): Transition {1588230740 state=OFFLINE, ts=1417474663562, server=null} to {1588230740 state=PENDING_OPEN, ts=1417474663564, server=10.11.6.43,59548,1417474662690} 2014-12-01 14:57:43,565 INFO [10.11.6.43:59548.activeMasterManager] zookeeper.MetaTableLocator(350): Setting hbase:meta region location in ZooKeeper as 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,570 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.MetaTableLocator(361): META region location doesn't existed, create it 2014-12-01 14:57:43,572 DEBUG [10.11.6.43:59548.activeMasterManager] master.ServerManager(825): New admin connection to 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,575 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1273): Serving as 10.11.6.43,59568,1417474663070, RpcServer on 10.11.6.43/10.11.6.43:59568, sessionid=0x14a0812ddeb0003 2014-12-01 14:57:43,575 INFO [SplitLogWorker-10.11.6.43:59568] regionserver.SplitLogWorker(134): SplitLogWorker 10.11.6.43,59568,1417474663070 starting 2014-12-01 14:57:43,576 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-12-01 14:57:43,576 DEBUG [RS:2;10.11.6.43:59568] snapshot.RegionServerSnapshotManager(122): Start Snapshot Manager 10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,577 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59568,1417474663070' 2014-12-01 14:57:43,577 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-12-01 14:57:43,578 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-12-01 14:57:43,579 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-12-01 14:57:43,579 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-12-01 14:57:43,579 DEBUG [RS:2;10.11.6.43:59568] flush.RegionServerFlushTableProcedureManager(101): Start region server flush procedure manager 10.11.6.43,59568,1417474663070 2014-12-01 14:57:43,579 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59568,1417474663070' 2014-12-01 14:57:43,579 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-12-01 14:57:43,580 DEBUG [RS:2;10.11.6.43:59568] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-12-01 14:57:43,580 DEBUG [RS:2;10.11.6.43:59568] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-12-01 14:57:43,580 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1273): Serving as 10.11.6.43,59559,1417474662986, RpcServer on 10.11.6.43/10.11.6.43:59559, sessionid=0x14a0812ddeb0002 2014-12-01 14:57:43,580 INFO [SplitLogWorker-10.11.6.43:59559] regionserver.SplitLogWorker(134): SplitLogWorker 10.11.6.43,59559,1417474662986 starting 2014-12-01 14:57:43,581 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-12-01 14:57:43,581 DEBUG [RS:1;10.11.6.43:59559] snapshot.RegionServerSnapshotManager(122): Start Snapshot Manager 10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,581 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59559,1417474662986' 2014-12-01 14:57:43,581 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-12-01 14:57:43,581 INFO [RS:2;10.11.6.43:59568] quotas.RegionServerQuotaManager(62): Quota support disabled 2014-12-01 14:57:43,582 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-12-01 14:57:43,582 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1273): Serving as 10.11.6.43,59551,1417474662907, RpcServer on 10.11.6.43/10.11.6.43:59551, sessionid=0x14a0812ddeb0001 2014-12-01 14:57:43,582 INFO [SplitLogWorker-10.11.6.43:59551] regionserver.SplitLogWorker(134): SplitLogWorker 10.11.6.43,59551,1417474662907 starting 2014-12-01 14:57:43,582 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(52): Procedure online-snapshot is starting 2014-12-01 14:57:43,582 DEBUG [RS:0;10.11.6.43:59551] snapshot.RegionServerSnapshotManager(122): Start Snapshot Manager 10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,583 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59551,1417474662907' 2014-12-01 14:57:43,583 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-12-01 14:57:43,583 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-12-01 14:57:43,583 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-12-01 14:57:43,583 DEBUG [RS:1;10.11.6.43:59559] flush.RegionServerFlushTableProcedureManager(101): Start region server flush procedure manager 10.11.6.43,59559,1417474662986 2014-12-01 14:57:43,583 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59559,1417474662986' 2014-12-01 14:57:43,583 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-12-01 14:57:43,583 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-12-01 14:57:43,584 DEBUG [RS:1;10.11.6.43:59559] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-12-01 14:57:43,584 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(54): Procedure online-snapshot is started 2014-12-01 14:57:43,584 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(52): Procedure flush-table-proc is starting 2014-12-01 14:57:43,584 DEBUG [RS:0;10.11.6.43:59551] flush.RegionServerFlushTableProcedureManager(101): Start region server flush procedure manager 10.11.6.43,59551,1417474662907 2014-12-01 14:57:43,584 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(349): Starting procedure member '10.11.6.43,59551,1417474662907' 2014-12-01 14:57:43,584 DEBUG [RS:1;10.11.6.43:59559] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-12-01 14:57:43,584 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(136): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-12-01 14:57:43,584 INFO [RS:1;10.11.6.43:59559] quotas.RegionServerQuotaManager(62): Quota support disabled 2014-12-01 14:57:43,585 DEBUG [RS:0;10.11.6.43:59551] procedure.ZKProcedureMemberRpcs(152): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-12-01 14:57:43,585 DEBUG [RS:0;10.11.6.43:59551] procedure.RegionServerProcedureManagerHost(54): Procedure flush-table-proc is started 2014-12-01 14:57:43,586 INFO [RS:0;10.11.6.43:59551] quotas.RegionServerQuotaManager(62): Quota support disabled 2014-12-01 14:57:43,594 INFO [10.11.6.43:59548.activeMasterManager] regionserver.RSRpcServices(1325): Open hbase:meta,,1.1588230740 2014-12-01 14:57:43,600 INFO [10.11.6.43:59548.activeMasterManager] master.ServerManager(629): AssignmentManager hasn't finished failover cleanup; waiting 2014-12-01 14:57:43,603 INFO [RS_OPEN_META-10.11.6.43:59548-0] wal.FSHLog(541): WAL configuration: blocksize=128 MB, rollsize=121.60 MB, prefix=10.11.6.43%2C59548%2C1417474662690..meta, suffix=.meta, logDir=hdfs://localhost:59532/user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690, archiveDir=hdfs://localhost:59532/user/tyu/hbase/oldWALs 2014-12-01 14:57:43,620 INFO [RS_OPEN_META-10.11.6.43:59548-0] wal.FSHLog(1458): Slow sync cost: 13 ms, current pipeline: [] 2014-12-01 14:57:43,621 INFO [RS_OPEN_META-10.11.6.43:59548-0] wal.FSHLog(939): New WAL /user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690/10.11.6.43%2C59548%2C1417474662690..meta.1417474663604.meta 2014-12-01 14:57:43,622 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] regionserver.HRegion(4764): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:57:43,645 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] coprocessor.CoprocessorHost(169): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2014-12-01 14:57:43,648 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] regionserver.HRegion(5883): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2014-12-01 14:57:43,652 INFO [RS_OPEN_META-10.11.6.43:59548-0] regionserver.RegionCoprocessorHost(243): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2014-12-01 14:57:43,657 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] regionserver.MetricsRegionSourceImpl(67): Creating new MetricsRegionSourceImpl for table meta 1588230740 2014-12-01 14:57:43,657 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] regionserver.HRegion(677): Instantiated hbase:meta,,1.1588230740 2014-12-01 14:57:43,663 INFO [StoreOpener-1588230740-1] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,664 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(93): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 604800000, major jitter 0.500000 2014-12-01 14:57:43,666 DEBUG [StoreOpener-1588230740-1] regionserver.HRegionFileSystem(197): No StoreFiles for: hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/info 2014-12-01 14:57:43,668 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] regionserver.HRegion(3388): Found 0 recovered edits file(s) under hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740 2014-12-01 14:57:43,671 INFO [RS_OPEN_META-10.11.6.43:59548-0] regionserver.HRegion(787): Onlined 1588230740; next sequenceid=2 2014-12-01 14:57:43,692 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1794): Post open deploy tasks for hbase:meta,,1.1588230740 2014-12-01 14:57:43,698 DEBUG [PostOpenDeployTasks:1588230740] master.AssignmentManager(2735): Got transition OPENED for {1588230740 state=PENDING_OPEN, ts=1417474663564, server=10.11.6.43,59548,1417474662690} from 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,698 INFO [PostOpenDeployTasks:1588230740] master.RegionStates(973): Transition {1588230740 state=PENDING_OPEN, ts=1417474663564, server=10.11.6.43,59548,1417474662690} to {1588230740 state=OPEN, ts=1417474663698, server=10.11.6.43,59548,1417474662690} 2014-12-01 14:57:43,698 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaTableLocator(350): Setting hbase:meta region location in ZooKeeper as 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,702 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2014-12-01 14:57:43,702 INFO [PostOpenDeployTasks:1588230740] master.RegionStates(397): Onlined 1588230740 on 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,703 INFO [10.11.6.43:59548.activeMasterManager] master.HMaster(751): hbase:meta assigned=1, location=10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,705 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer(1818): Finished post open deploy task for hbase:meta,,1.1588230740 2014-12-01 14:57:43,705 DEBUG [RS_OPEN_META-10.11.6.43:59548-0] handler.OpenRegionHandler(122): Opened hbase:meta,,1.1588230740 on 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,740 INFO [10.11.6.43:59548.activeMasterManager] master.AssignmentManager(529): Clean cluster startup. Assigning user regions 2014-12-01 14:57:43,740 INFO [10.11.6.43:59548.activeMasterManager] master.AssignmentManager(413): Joined the cluster in 37ms, failover=false 2014-12-01 14:57:43,746 INFO [10.11.6.43:59548.activeMasterManager] master.TableNamespaceManager(86): Namespace table not found. Creating... 2014-12-01 14:57:43,761 DEBUG [10.11.6.43:59548.activeMasterManager] lock.ZKInterProcessLockBase(226): Acquired a lock for /hbase/table-lock/hbase:namespace/write-master:595480000000000 2014-12-01 14:57:43,763 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] handler.CreateTableHandler(147): Create table hbase:namespace 2014-12-01 14:57:43,783 INFO [IPC Server handler 3 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,785 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:43,786 INFO [IPC Server handler 3 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741835_1011 size 317 2014-12-01 14:57:43,789 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] util.FSTableDescriptors(719): Wrote descriptor into: hdfs://localhost:59532/user/tyu/hbase/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2014-12-01 14:57:43,792 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(4571): creating HRegion hbase:namespace HTD == 'hbase:namespace', {NAME => 'info', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '10', TTL => 'FOREVER', MIN_VERSIONS => '0', CACHE_DATA_IN_L1 => 'true', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '8192', IN_MEMORY => 'true', BLOCKCACHE => 'true'} RootDir = hdfs://localhost:59532/user/tyu/hbase/.tmp Table name == hbase:namespace 2014-12-01 14:57:43,809 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,809 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,810 INFO [IPC Server handler 3 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,812 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(677): Instantiated hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,812 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1195): Closing hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.: disabling compactions & flushes 2014-12-01 14:57:43,812 DEBUG [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1222): Updates disabled for region hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,813 INFO [RegionOpenAndInitThread-hbase:namespace-1] regionserver.HRegion(1310): Closed hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,851 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] hbase.MetaTableAccessor(1154): Added 1 2014-12-01 14:57:43,853 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.AssignmentManager(671): Assigning 1 region(s) to 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,859 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.RegionStates(973): Transition {1128efef70222c58d461e5ef3438dfb3 state=OFFLINE, ts=1417474663852, server=null} to {1128efef70222c58d461e5ef3438dfb3 state=PENDING_OPEN, ts=1417474663859, server=10.11.6.43,59548,1417474662690} 2014-12-01 14:57:43,859 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.RegionStateStore(207): Updating row hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. with state=PENDING_OPEN&sn=10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,863 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] regionserver.RSRpcServices(1325): Open hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,864 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.AssignmentManager(830): Bulk assigning done for 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,865 DEBUG [RS_OPEN_REGION-10.11.6.43:59548-0] regionserver.HRegion(4764): Opening region: {ENCODED => 1128efef70222c58d461e5ef3438dfb3, NAME => 'hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:57:43,865 DEBUG [RS_OPEN_REGION-10.11.6.43:59548-0] regionserver.MetricsRegionSourceImpl(67): Creating new MetricsRegionSourceImpl for table namespace 1128efef70222c58d461e5ef3438dfb3 2014-12-01 14:57:43,866 DEBUG [RS_OPEN_REGION-10.11.6.43:59548-0] regionserver.HRegion(677): Instantiated hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,870 INFO [StoreOpener-1128efef70222c58d461e5ef3438dfb3-1] hfile.CacheConfig(260): blockCache=LruBlockCache{blockCount=0, currentSize=727696, freeSize=707690288, maxSize=708417984, heapSize=727696, minSize=672997056, minFactor=0.95, multiSize=336498528, multiFactor=0.5, singleSize=168249264, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2014-12-01 14:57:43,871 INFO [StoreOpener-1128efef70222c58d461e5ef3438dfb3-1] compactions.CompactionConfiguration(93): size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 604800000, major jitter 0.500000 2014-12-01 14:57:43,872 DEBUG [StoreOpener-1128efef70222c58d461e5ef3438dfb3-1] regionserver.HRegionFileSystem(197): No StoreFiles for: hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3/info 2014-12-01 14:57:43,874 DEBUG [RS_OPEN_REGION-10.11.6.43:59548-0] regionserver.HRegion(3388): Found 0 recovered edits file(s) under hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3 2014-12-01 14:57:43,877 INFO [RS_OPEN_REGION-10.11.6.43:59548-0] regionserver.HRegion(787): Onlined 1128efef70222c58d461e5ef3438dfb3; next sequenceid=2 2014-12-01 14:57:43,879 INFO [IPC Server handler 4 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|FINALIZED]]} size 0 2014-12-01 14:57:43,880 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:57:43,880 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:57:43,881 INFO [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] regionserver.HRegionServer(1794): Post open deploy tasks for hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,881 DEBUG [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] master.AssignmentManager(2735): Got transition OPENED for {1128efef70222c58d461e5ef3438dfb3 state=PENDING_OPEN, ts=1417474663859, server=10.11.6.43,59548,1417474662690} from 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,881 INFO [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] master.RegionStates(973): Transition {1128efef70222c58d461e5ef3438dfb3 state=PENDING_OPEN, ts=1417474663859, server=10.11.6.43,59548,1417474662690} to {1128efef70222c58d461e5ef3438dfb3 state=OPEN, ts=1417474663881, server=10.11.6.43,59548,1417474662690} 2014-12-01 14:57:43,881 INFO [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] master.RegionStateStore(207): Updating row hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. with state=OPEN&openSeqNum=2&server=10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,884 INFO [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] master.RegionStates(397): Onlined 1128efef70222c58d461e5ef3438dfb3 on 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,884 DEBUG [PostOpenDeployTasks:1128efef70222c58d461e5ef3438dfb3] regionserver.HRegionServer(1818): Finished post open deploy task for hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:57:43,884 DEBUG [RS_OPEN_REGION-10.11.6.43:59548-0] handler.OpenRegionHandler(122): Opened hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. on 10.11.6.43,59548,1417474662690 2014-12-01 14:57:43,884 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] util.FSTableDescriptors(719): Wrote descriptor into: hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/.tabledesc/.tableinfo.0000000002 2014-12-01 14:57:43,886 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(1109): BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:59536 127.0.0.1:59540 127.0.0.1:59533 2014-12-01 14:57:43,887 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] util.FSTableDescriptors(665): Deleted table descriptor at hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2014-12-01 14:57:43,887 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] util.FSTableDescriptors(630): Updated tableinfo=hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/.tabledesc/.tableinfo.0000000002 2014-12-01 14:57:43,887 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.TableStateManager(196): Table hbase:namespace written descriptor for state ENABLED 2014-12-01 14:57:43,887 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] master.TableStateManager(198): Table hbase:namespace updated state to ENABLED 2014-12-01 14:57:43,889 DEBUG [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] lock.ZKInterProcessLockBase(328): Released /hbase/table-lock/hbase:namespace/write-master:595480000000000 2014-12-01 14:57:43,889 INFO [MASTER_TABLE_OPERATIONS-10.11.6.43:59548-0] handler.CreateTableHandler(177): Table, hbase:namespace, creation successful 2014-12-01 14:57:43,968 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2014-12-01 14:57:43,970 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2014-12-01 14:57:43,974 DEBUG [hconnection-0x4fc98145-shared--pool17-t1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service ClientService, sasl=false 2014-12-01 14:57:43,975 DEBUG [hconnection-0x4fc98145-shared--pool17-t1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:43,976 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59614; # active connections: 4 2014-12-01 14:57:44,003 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-12-01 14:57:44,007 DEBUG [main-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-12-01 14:57:44,013 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2014-12-01 14:57:44,015 DEBUG [main-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node default with data: \x0A\x07default 2014-12-01 14:57:44,015 DEBUG [main-EventThread] hbase.ZKNamespaceManager(196): Updating namespace cache from node hbase with data: \x0A\x05hbase 2014-12-01 14:57:44,019 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(531): Node /hbase/namespace/default already exists 2014-12-01 14:57:44,020 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2014-12-01 14:57:44,021 DEBUG [10.11.6.43:59548.activeMasterManager] zookeeper.RecoverableZooKeeper(531): Node /hbase/namespace/hbase already exists 2014-12-01 14:57:44,022 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2014-12-01 14:57:44,023 INFO [10.11.6.43:59548.activeMasterManager] quotas.MasterQuotaManager(68): Quota support disabled 2014-12-01 14:57:44,023 INFO [10.11.6.43:59548.activeMasterManager] master.HMaster(662): Master has completed initialization 2014-12-01 14:57:44,029 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x4bdd45cc connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,032 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x4bdd45cc, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,033 DEBUG [main] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1572aa51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,033 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x4bdd45cc-0x14a0812ddeb000e connected 2014-12-01 14:57:44,035 DEBUG [htable-pool18-t1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service ClientService, sasl=false 2014-12-01 14:57:44,035 DEBUG [htable-pool18-t1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,035 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59616; # active connections: 5 2014-12-01 14:57:44,040 INFO [main] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000e 2014-12-01 14:57:44,041 DEBUG [main] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:57:44,042 DEBUG [RpcServer.reader=5,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59616 because read count=-1. Number of active connections: 5 2014-12-01 14:57:44,158 INFO [main] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x727d1539 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,162 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x727d1539, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,163 DEBUG [main] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9950602, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,164 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x727d1539-0x14a0812ddeb000f connected 2014-12-01 14:57:44,164 INFO [main] hbase.HBaseTestingUtility(930): Minicluster is up 2014-12-01 14:57:44,170 DEBUG [main] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:57:44,170 DEBUG [main] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,171 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59618; # active connections: 5 2014-12-01 14:57:44,181 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2014-12-01 14:57:44,182 INFO [B.defaultRpcServer.handler=1,queue=0,port=59548] master.MasterRpcServices(239): Client=tyu//10.11.6.43 set balanceSwitch=false 2014-12-01 14:57:44,222 INFO [main] hbase.ResourceChecker(148): before: util.TestHBaseFsck#testParallelHbck Thread=387, OpenFileDescriptor=658, MaxFileDescriptor=10240, SystemLoadAverage=180, ProcessCount=136, AvailableMemoryMB=5598, ConnectionCount=0 2014-12-01 14:57:44,230 WARN [IPC Server handler 3 on 59532] namenode.FSNamesystem(2776): DIR* NameSystem.startFile: /user/tyu/hbase/.tmp/hbase-hbck.lock failed to create file /user/tyu/hbase/.tmp/hbase-hbck.lock for DFSClient_NONMAPREDUCE_-240626247_1 for client 127.0.0.1 because current leaseholder is trying to recreate file. 2014-12-01 14:57:44,231 DEBUG [pool-87-thread-1] util.HBaseFsck(387): Launching hbck 2014-12-01 14:57:44,233 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x4ecdbfc1 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,235 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x4ecdbfc1, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,236 DEBUG [pool-87-thread-1] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@288077e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,236 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x4ecdbfc1-0x14a0812ddeb0010 connected 2014-12-01 14:57:44,237 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:57:44,238 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,238 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59620; # active connections: 6 Version: 2.0.0-SNAPSHOT 2014-12-01 14:57:44,254 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2014-12-01 14:57:44,254 INFO [B.defaultRpcServer.handler=1,queue=0,port=59548] master.MasterRpcServices(239): Client=tyu//10.11.6.43 set balanceSwitch=false Number of live region servers: 4 10.11.6.43,59551,1417474662907 10.11.6.43,59548,1417474662690 10.11.6.43,59568,1417474663070 10.11.6.43,59559,1417474662986 Number of dead region servers: 0 Master: 10.11.6.43,59548,1417474662690 Number of backup masters: 0 Average load: 0.0 Number of requests: 0 Number of regions: 0 Number of regions in transition: 0 2014-12-01 14:57:44,258 DEBUG [pool-88-thread-1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:57:44,259 DEBUG [pool-88-thread-1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59551 2014-12-01 14:57:44,259 DEBUG [pool-88-thread-3] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:57:44,259 DEBUG [pool-88-thread-3] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,259 DEBUG [pool-88-thread-4] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:57:44,259 DEBUG [RpcServer.listener,port=59551] ipc.RpcServer$Listener(784): RpcServer.listener,port=59551: connection from 10.11.6.43:59621; # active connections: 1 2014-12-01 14:57:44,260 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59622; # active connections: 7 2014-12-01 14:57:44,260 DEBUG [pool-88-thread-4] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59559 2014-12-01 14:57:44,260 DEBUG [pool-88-thread-2] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:57:44,261 DEBUG [pool-88-thread-2] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59568 2014-12-01 14:57:44,261 DEBUG [RpcServer.listener,port=59559] ipc.RpcServer$Listener(784): RpcServer.listener,port=59559: connection from 10.11.6.43:59623; # active connections: 1 2014-12-01 14:57:44,262 DEBUG [RpcServer.listener,port=59568] ipc.RpcServer$Listener(784): RpcServer.listener,port=59568: connection from 10.11.6.43:59624; # active connections: 1 RegionServer: 10.11.6.43,59559,1417474662986 number of regions: 0 RegionServer: 10.11.6.43,59568,1417474663070 number of regions: 0 RegionServer: 10.11.6.43,59551,1417474662907 number of regions: 0 RegionServer: 10.11.6.43,59548,1417474662690 number of regions: 2 hbase:meta,,1.1588230740 id: 1 encoded_name: 1588230740 start: end: hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. id: 1417474663746 encoded_name: 1128efef70222c58d461e5ef3438dfb3 start: end: 2014-12-01 14:57:44,265 DEBUG [10.11.6.43,59548,1417474662690.splitLogManagerTimeoutMonitor] zookeeper.ZKSplitLog(171): Garbage collecting all recovering region znodes 2014-12-01 14:57:44,266 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,268 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,269 INFO [pool-87-thread-1] util.HBaseFsck(520): Loading regionsinfo from the hbase:meta table 2014-12-01 14:57:44,270 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hbase Fsck-0x14a0812ddeb0011 connected 2014-12-01 14:57:44,272 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x3aacaf60 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,274 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x3aacaf60, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,275 DEBUG [pool-87-thread-1] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@905fa25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,276 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x3aacaf60-0x14a0812ddeb0012 connected 2014-12-01 14:57:44,277 DEBUG [htable-pool21-t1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service ClientService, sasl=false 2014-12-01 14:57:44,277 DEBUG [htable-pool21-t1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,278 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59627; # active connections: 8 2014-12-01 14:57:44,284 INFO [pool-87-thread-1] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0012 2014-12-01 14:57:44,285 DEBUG [pool-87-thread-1] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:57:44,285 DEBUG [RpcServer.reader=9,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59627 because read count=-1. Number of active connections: 8 Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 0 2014-12-01 14:57:44,387 INFO [pool-87-thread-1] util.HBaseFsck(2889): getHTableDescriptors == tableNames => [hbase:namespace] 2014-12-01 14:57:44,388 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x7bb8c61b connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,394 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x7bb8c61b, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,398 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x7bb8c61b-0x14a0812ddeb0013 connected 2014-12-01 14:57:44,398 DEBUG [pool-87-thread-1] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33983700, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,400 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:57:44,400 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,402 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59629; # active connections: 8 2014-12-01 14:57:44,410 INFO [pool-87-thread-1] client.ConnectionManager$HConnectionImplementation(2046): Closing master protocol: MasterService 2014-12-01 14:57:44,410 INFO [pool-87-thread-1] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0013 2014-12-01 14:57:44,411 DEBUG [pool-87-thread-1] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:57:44,412 DEBUG [RpcServer.reader=0,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59629 because read count=-1. Number of active connections: 8 Number of Tables: 1 Table: hbase:namespace rw families: 1 2014-12-01 14:57:44,523 DEBUG [pool-87-thread-1] util.HBaseFsck(1534): Loading region dirs from hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta 2014-12-01 14:57:44,524 DEBUG [pool-87-thread-1] util.HBaseFsck(1534): Loading region dirs from hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace 2014-12-01 14:57:44,526 DEBUG [pool-88-thread-4] util.HBaseFsck$WorkItemHdfsDir(3659): Loading region info from hdfs:hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740 2014-12-01 14:57:44,526 DEBUG [pool-88-thread-2] util.HBaseFsck$WorkItemHdfsDir(3659): Loading region info from hdfs:hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3 2014-12-01 14:57:44,534 DEBUG [pool-88-thread-1] util.HBaseFsck(965): HRegionInfo read: {ENCODED => 1128efef70222c58d461e5ef3438dfb3, NAME => 'hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:57:44,534 DEBUG [pool-88-thread-3] util.HBaseFsck(965): HRegionInfo read: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:57:44,546 DEBUG [pool-87-thread-1] util.FSTableDescriptors(223): Fetching table descriptors from the filesystem. 2014-12-01 14:57:44,556 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x245456eb connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,560 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x245456eb, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,561 DEBUG [pool-87-thread-1] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c3ac6c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:57:44,561 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x245456eb-0x14a0812ddeb0014 connected 2014-12-01 14:57:44,562 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:57:44,562 DEBUG [pool-87-thread-1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:57:44,562 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59632; # active connections: 8 2014-12-01 14:57:44,569 INFO [pool-87-thread-1] client.ConnectionManager$HConnectionImplementation(2046): Closing master protocol: MasterService 2014-12-01 14:57:44,569 INFO [pool-87-thread-1] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0014 2014-12-01 14:57:44,570 DEBUG [pool-87-thread-1] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:57:44,572 DEBUG [RpcServer.reader=1,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59632 because read count=-1. Number of active connections: 8 2014-12-01 14:57:44,674 DEBUG [pool-87-thread-1] util.HBaseFsck(2090): There are 2 region info entries 2014-12-01 14:57:44,674 DEBUG [pool-87-thread-1] util.FSTableDescriptors(223): Fetching table descriptors from the filesystem. 2014-12-01 14:57:44,690 INFO [pool-87-thread-1] util.HBaseFsck$TableInfo(2738): Handling overlap merges in parallel. set hbasefsck.overlap.merge.parallel to false to run serially. ---- Table 'hbase:meta': region split map : [ { meta => hbase:meta,,1.1588230740, hdfs => hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740, deployed => 10.11.6.43,59548,1417474662690;hbase:meta,,1.1588230740, replicaId => 0 }, ] null: ---- Table 'hbase:meta': overlap groups There are 0 overlap groups with 0 overlapping regions 2014-12-01 14:57:44,692 INFO [pool-87-thread-1] util.HBaseFsck$TableInfo(2738): Handling overlap merges in parallel. set hbasefsck.overlap.merge.parallel to false to run serially. ---- Table 'hbase:namespace': region split map : [ { meta => hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., hdfs => hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3, deployed => 10.11.6.43,59548,1417474662690;hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., replicaId => 0 }, ] null: ---- Table 'hbase:namespace': overlap groups There are 0 overlap groups with 0 overlapping regions 2014-12-01 14:57:44,695 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2014-12-01 14:57:44,696 INFO [B.defaultRpcServer.handler=0,queue=0,port=59548] master.MasterRpcServices(239): Client=tyu//10.11.6.43 set balanceSwitch=false 2014-12-01 14:57:44,713 INFO [pool-87-thread-1] zookeeper.RecoverableZooKeeper(121): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:57:44,716 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:57:44,717 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(388): hbase Fsck-0x14a0812ddeb0015 connected 2014-12-01 14:57:44,728 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|FINALIZED]]} size 0 2014-12-01 14:57:44,729 INFO [IPC Server handler 2 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|FINALIZED]]} size 0 2014-12-01 14:57:44,730 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|FINALIZED]]} size 0 2014-12-01 14:57:44,731 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(1109): BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:59540 127.0.0.1:59536 127.0.0.1:59533 Summary: hbase:meta is okay. Number of regions: 1 Deployed on: 10.11.6.43,59548,1417474662690 hbase:namespace is okay. Number of regions: 1 Deployed on: 10.11.6.43,59548,1417474662690 0 inconsistencies detected. Status: OK 2014-12-01 14:58:44,271 DEBUG [pool-87-thread-2] util.HBaseFsck(387): Launching hbck 2014-12-01 14:58:44,272 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x2111a4d1 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,277 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x2111a4d1, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,278 DEBUG [pool-87-thread-2] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14ae9dcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:58:44,279 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x2111a4d1-0x14a0812ddeb0016 connected 2014-12-01 14:58:44,280 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:58:44,280 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:58:44,281 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59647; # active connections: 8 Version: 2.0.0-SNAPSHOT 2014-12-01 14:58:44,285 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2014-12-01 14:58:44,286 INFO [B.defaultRpcServer.handler=1,queue=0,port=59548] master.MasterRpcServices(239): Client=tyu//10.11.6.43 set balanceSwitch=false Number of live region servers: 4 10.11.6.43,59551,1417474662907 10.11.6.43,59548,1417474662690 10.11.6.43,59568,1417474663070 10.11.6.43,59559,1417474662986 Number of dead region servers: 0 Master: 10.11.6.43,59548,1417474662690 Number of backup masters: 0 Average load: 0.5 Number of requests: 35 Number of regions: 2 Number of regions in transition: 0 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-5] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-4] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-5] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59551 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-2] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-4] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59568 2014-12-01 14:58:44,289 DEBUG [pool-88-thread-6] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service AdminService, sasl=false 2014-12-01 14:58:44,288 DEBUG [pool-88-thread-2] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59559 2014-12-01 14:58:44,290 DEBUG [pool-88-thread-6] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:58:44,290 DEBUG [RpcServer.listener,port=59551] ipc.RpcServer$Listener(784): RpcServer.listener,port=59551: connection from 10.11.6.43:59648; # active connections: 2 2014-12-01 14:58:44,291 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59651; # active connections: 9 2014-12-01 14:58:44,291 DEBUG [RpcServer.listener,port=59559] ipc.RpcServer$Listener(784): RpcServer.listener,port=59559: connection from 10.11.6.43:59650; # active connections: 2 2014-12-01 14:58:44,291 DEBUG [RpcServer.listener,port=59568] ipc.RpcServer$Listener(784): RpcServer.listener,port=59568: connection from 10.11.6.43:59649; # active connections: 2 RegionServer: 10.11.6.43,59551,1417474662907 number of regions: 0 RegionServer: 10.11.6.43,59559,1417474662986 number of regions: 0 RegionServer: 10.11.6.43,59548,1417474662690 number of regions: 2 hbase:meta,,1.1588230740 id: 1 encoded_name: 1588230740 start: end: hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. id: 1417474663746 encoded_name: 1128efef70222c58d461e5ef3438dfb3 start: end: RegionServer: 10.11.6.43,59568,1417474663070 number of regions: 0 2014-12-01 14:58:44,293 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,296 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,297 INFO [pool-87-thread-2] util.HBaseFsck(520): Loading regionsinfo from the hbase:meta table 2014-12-01 14:58:44,297 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hbase Fsck-0x14a0812ddeb0017 connected 2014-12-01 14:58:44,298 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x135a2763 connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,300 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x135a2763, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,301 DEBUG [pool-87-thread-2] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d3e018e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:58:44,301 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x135a2763-0x14a0812ddeb0018 connected 2014-12-01 14:58:44,302 DEBUG [htable-pool23-t1] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service ClientService, sasl=false 2014-12-01 14:58:44,302 DEBUG [htable-pool23-t1] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:58:44,303 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59654; # active connections: 10 2014-12-01 14:58:44,308 INFO [pool-87-thread-2] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0018 2014-12-01 14:58:44,309 DEBUG [pool-87-thread-2] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,309 DEBUG [RpcServer.reader=4,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59654 because read count=-1. Number of active connections: 10 Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 0 2014-12-01 14:58:44,410 INFO [pool-87-thread-2] util.HBaseFsck(2889): getHTableDescriptors == tableNames => [hbase:namespace] 2014-12-01 14:58:44,412 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x2c5114bf connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,416 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x2c5114bf, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,418 DEBUG [pool-87-thread-2] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@340324f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:58:44,418 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x2c5114bf-0x14a0812ddeb0019 connected 2014-12-01 14:58:44,420 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:58:44,420 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:58:44,420 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59656; # active connections: 10 2014-12-01 14:58:44,422 INFO [pool-87-thread-2] client.ConnectionManager$HConnectionImplementation(2046): Closing master protocol: MasterService 2014-12-01 14:58:44,422 INFO [pool-87-thread-2] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0019 2014-12-01 14:58:44,423 DEBUG [pool-87-thread-2] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,424 DEBUG [RpcServer.reader=5,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59656 because read count=-1. Number of active connections: 10 Number of Tables: 1 Table: hbase:namespace rw families: 1 2014-12-01 14:58:44,535 DEBUG [pool-87-thread-2] util.HBaseFsck(1534): Loading region dirs from hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta 2014-12-01 14:58:44,536 DEBUG [pool-87-thread-2] util.HBaseFsck(1534): Loading region dirs from hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace 2014-12-01 14:58:44,537 DEBUG [pool-88-thread-7] util.HBaseFsck$WorkItemHdfsDir(3659): Loading region info from hdfs:hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740 2014-12-01 14:58:44,537 DEBUG [pool-88-thread-8] util.HBaseFsck$WorkItemHdfsDir(3659): Loading region info from hdfs:hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3 2014-12-01 14:58:44,545 DEBUG [pool-88-thread-3] util.HBaseFsck(965): HRegionInfo read: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:58:44,545 DEBUG [pool-88-thread-1] util.HBaseFsck(965): HRegionInfo read: {ENCODED => 1128efef70222c58d461e5ef3438dfb3, NAME => 'hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.', STARTKEY => '', ENDKEY => ''} 2014-12-01 14:58:44,555 DEBUG [pool-87-thread-2] util.FSTableDescriptors(223): Fetching table descriptors from the filesystem. 2014-12-01 14:58:44,566 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hconnection-0x7ddcffec connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,570 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x7ddcffec, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,571 DEBUG [pool-87-thread-2] ipc.RpcClient(1331): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c4d674c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2014-12-01 14:58:44,571 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hconnection-0x7ddcffec-0x14a0812ddeb001a connected 2014-12-01 14:58:44,572 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(565): Use SIMPLE authentication for service MasterService, sasl=false 2014-12-01 14:58:44,572 DEBUG [pool-87-thread-2] ipc.RpcClient$Connection(931): Connecting to /10.11.6.43:59548 2014-12-01 14:58:44,572 DEBUG [RpcServer.listener,port=59548] ipc.RpcServer$Listener(784): RpcServer.listener,port=59548: connection from 10.11.6.43:59661; # active connections: 10 2014-12-01 14:58:44,573 INFO [pool-87-thread-2] client.ConnectionManager$HConnectionImplementation(2046): Closing master protocol: MasterService 2014-12-01 14:58:44,574 INFO [pool-87-thread-2] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb001a 2014-12-01 14:58:44,574 DEBUG [pool-87-thread-2] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,575 DEBUG [RpcServer.reader=6,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59661 because read count=-1. Number of active connections: 10 2014-12-01 14:58:44,675 DEBUG [pool-87-thread-2] util.HBaseFsck(2090): There are 2 region info entries 2014-12-01 14:58:44,677 DEBUG [pool-87-thread-2] util.FSTableDescriptors(223): Fetching table descriptors from the filesystem. 2014-12-01 14:58:44,689 INFO [pool-87-thread-2] util.HBaseFsck$TableInfo(2738): Handling overlap merges in parallel. set hbasefsck.overlap.merge.parallel to false to run serially. ---- Table 'hbase:meta': region split map : [ { meta => hbase:meta,,1.1588230740, hdfs => hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740, deployed => 10.11.6.43,59548,1417474662690;hbase:meta,,1.1588230740, replicaId => 0 }, ] null: ---- Table 'hbase:meta': overlap groups There are 0 overlap groups with 0 overlapping regions 2014-12-01 14:58:44,690 INFO [pool-87-thread-2] util.HBaseFsck$TableInfo(2738): Handling overlap merges in parallel. set hbasefsck.overlap.merge.parallel to false to run serially. ---- Table 'hbase:namespace': region split map : [ { meta => hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., hdfs => hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3, deployed => 10.11.6.43,59548,1417474662690;hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., replicaId => 0 }, ] null: ---- Table 'hbase:namespace': overlap groups There are 0 overlap groups with 0 overlapping regions 2014-12-01 14:58:44,693 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2014-12-01 14:58:44,694 INFO [B.defaultRpcServer.handler=1,queue=0,port=59548] master.MasterRpcServices(239): Client=tyu//10.11.6.43 set balanceSwitch=false 2014-12-01 14:58:44,710 INFO [pool-87-thread-2] zookeeper.RecoverableZooKeeper(121): Process identifier=hbase Fsck connecting to ZooKeeper ensemble=localhost:63165 2014-12-01 14:58:44,712 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2014-12-01 14:58:44,714 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(388): hbase Fsck-0x14a0812ddeb001b connected 2014-12-01 14:58:44,723 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:58:44,723 INFO [IPC Server handler 4 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:58:44,726 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:58:44,728 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(1109): BLOCK* addToInvalidates: blk_1073741839_1015 127.0.0.1:59533 127.0.0.1:59540 127.0.0.1:59536 Summary: hbase:meta is okay. Number of regions: 1 Deployed on: 10.11.6.43,59548,1417474662690 hbase:namespace is okay. Number of regions: 1 Deployed on: 10.11.6.43,59548,1417474662690 0 inconsistencies detected. Status: OK 2014-12-01 14:58:44,728 WARN [main] util.TestHBaseFsck(576): h1: org.apache.hadoop.hbase.util.HBaseFsck@72aa738e 2014-12-01 14:58:44,729 WARN [main] util.TestHBaseFsck(577): h2: org.apache.hadoop.hbase.util.HBaseFsck@186e2ce6 2014-12-01 14:58:44,763 INFO [main] hbase.ResourceChecker(172): after: util.TestHBaseFsck#testParallelHbck Thread=412 (was 387) Potentially hanging thread: pool-87-thread-2-SendThread(localhost:63165) sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59551 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: Async disk worker #0 for volume /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: Async disk worker #0 for volume /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59559 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59551 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: pool-88-thread-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-240626247_1 at /127.0.0.1:59658 [Waiting for operation #3] sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:235) java.io.BufferedInputStream.read(BufferedInputStream.java:254) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:212) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-88-thread-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59568 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: pool-88-thread-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-88-thread-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: Async disk worker #0 for volume /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-87-thread-1-SendThread(localhost:63165) sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Potentially hanging thread: pool-87-thread-1-SendThread(localhost:63165) sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Potentially hanging thread: pool-88-thread-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-88-thread-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: Async disk worker #0 for volume /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-88-thread-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-87-thread-2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59559 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: pool-88-thread-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: IPC Client (1970838861) connection to /10.11.6.43:59568 from tyu java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:765) org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:780) Potentially hanging thread: pool-87-thread-2-SendThread(localhost:63165) sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-240626247_1 at /127.0.0.1:59657 [Waiting for operation #4] sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:235) java.io.BufferedInputStream.read(BufferedInputStream.java:254) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:212) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-240626247_1 at /127.0.0.1:59659 [Waiting for operation #2] sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:235) java.io.BufferedInputStream.read(BufferedInputStream.java:254) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:212) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-87-thread-1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Potentially hanging thread: pool-88-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-87-thread-2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Potentially hanging thread: pool-88-thread-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) Potentially hanging thread: pool-87-thread-1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) Potentially hanging thread: Async disk worker #0 for volume /Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745) - Thread LEAK? -, OpenFileDescriptor=700 (was 658) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=10240 (was 10240), SystemLoadAverage=153 (was 180), ProcessCount=135 (was 136), AvailableMemoryMB=5647 (was 5598) - AvailableMemoryMB LEAK? -, ConnectionCount=0 (was 0) 2014-12-01 14:58:44,764 INFO [main] hbase.HBaseTestingUtility(972): Shutting down minicluster 2014-12-01 14:58:44,764 INFO [main] client.ConnectionManager$HConnectionImplementation(2046): Closing master protocol: MasterService 2014-12-01 14:58:44,764 INFO [main] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000f 2014-12-01 14:58:44,765 DEBUG [main] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,765 DEBUG [RpcServer.reader=6,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59618 because read count=-1. Number of active connections: 9 2014-12-01 14:58:44,866 DEBUG [main] util.JVMClusterUtil(243): Shutting down HBase Cluster 2014-12-01 14:58:44,866 INFO [main] regionserver.HRegionServer(1768): STOPPED: Cluster shutdown requested 2014-12-01 14:58:44,867 INFO [M:0;10.11.6.43:59548] regionserver.SplitLogWorker(164): Sending interrupt to stop the worker thread 2014-12-01 14:58:44,867 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(903): Stopping infoServer 2014-12-01 14:58:44,867 INFO [SplitLogWorker-10.11.6.43:59548] regionserver.SplitLogWorker(146): SplitLogWorker interrupted. Exiting. 2014-12-01 14:58:44,867 INFO [SplitLogWorker-10.11.6.43:59548] regionserver.SplitLogWorker(155): SplitLogWorker 10.11.6.43,59548,1417474662690 exiting 2014-12-01 14:58:44,870 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-12-01 14:58:44,870 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-12-01 14:58:44,870 INFO [main] regionserver.HRegionServer(1768): STOPPED: Shutdown requested 2014-12-01 14:58:44,870 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-12-01 14:58:44,870 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2014-12-01 14:58:44,872 DEBUG [main-EventThread] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:58:44,872 INFO [RS:0;10.11.6.43:59551] regionserver.SplitLogWorker(164): Sending interrupt to stop the worker thread 2014-12-01 14:58:44,872 INFO [main] regionserver.HRegionServer(1768): STOPPED: Shutdown requested 2014-12-01 14:58:44,873 DEBUG [main-EventThread] zookeeper.ZKUtil(426): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:58:44,872 DEBUG [main-EventThread] zookeeper.ZKUtil(426): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:58:44,872 INFO [SplitLogWorker-10.11.6.43:59551] regionserver.SplitLogWorker(146): SplitLogWorker interrupted. Exiting. 2014-12-01 14:58:44,872 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(903): Stopping infoServer 2014-12-01 14:58:44,872 DEBUG [main-EventThread] zookeeper.ZKUtil(426): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2014-12-01 14:58:44,873 INFO [SplitLogWorker-10.11.6.43:59551] regionserver.SplitLogWorker(155): SplitLogWorker 10.11.6.43,59551,1417474662907 exiting 2014-12-01 14:58:44,873 INFO [M:0;10.11.6.43:59548] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-12-01 14:58:44,873 INFO [RS:1;10.11.6.43:59559] regionserver.SplitLogWorker(164): Sending interrupt to stop the worker thread 2014-12-01 14:58:44,873 INFO [main] regionserver.HRegionServer(1768): STOPPED: Shutdown requested 2014-12-01 14:58:44,875 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(903): Stopping infoServer 2014-12-01 14:58:44,875 INFO [SplitLogWorker-10.11.6.43:59559] regionserver.SplitLogWorker(146): SplitLogWorker interrupted. Exiting. 2014-12-01 14:58:44,876 INFO [RS:2;10.11.6.43:59568] regionserver.SplitLogWorker(164): Sending interrupt to stop the worker thread 2014-12-01 14:58:44,877 INFO [SplitLogWorker-10.11.6.43:59559] regionserver.SplitLogWorker(155): SplitLogWorker 10.11.6.43,59559,1417474662986 exiting 2014-12-01 14:58:44,877 INFO [SplitLogWorker-10.11.6.43:59568] regionserver.SplitLogWorker(146): SplitLogWorker interrupted. Exiting. 2014-12-01 14:58:44,877 INFO [RS:0;10.11.6.43:59551] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-12-01 14:58:44,877 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(903): Stopping infoServer 2014-12-01 14:58:44,878 INFO [SplitLogWorker-10.11.6.43:59568] regionserver.SplitLogWorker(155): SplitLogWorker 10.11.6.43,59568,1417474663070 exiting 2014-12-01 14:58:44,879 INFO [RS:1;10.11.6.43:59559] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-12-01 14:58:44,881 INFO [RS:2;10.11.6.43:59568] log.Slf4jLog(67): Stopped SelectChannelConnector@0.0.0.0:0 2014-12-01 14:58:44,978 INFO [M:0;10.11.6.43:59548] snapshot.RegionServerSnapshotManager(134): Stopping RegionServerSnapshotManager gracefully. 2014-12-01 14:58:44,978 INFO [master//10.11.6.43:0.nonceCleaner] hbase.Chore(100): master//10.11.6.43:0.nonceCleaner exiting 2014-12-01 14:58:44,978 INFO [master//10.11.6.43:0.compactionChecker] hbase.Chore(100): master//10.11.6.43:0.compactionChecker exiting 2014-12-01 14:58:44,978 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.1 exiting 2014-12-01 14:58:44,978 INFO [M:0;10.11.6.43:59548] flush.RegionServerFlushTableProcedureManager(113): Stopping region server flush procedure manager gracefully. 2014-12-01 14:58:44,978 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.0 exiting 2014-12-01 14:58:44,979 INFO [RS:0;10.11.6.43:59551] snapshot.RegionServerSnapshotManager(134): Stopping RegionServerSnapshotManager gracefully. 2014-12-01 14:58:44,980 INFO [regionserver//10.11.6.43:0.nonceCleaner] hbase.Chore(100): regionserver//10.11.6.43:0.nonceCleaner exiting 2014-12-01 14:58:44,980 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.1 exiting 2014-12-01 14:58:44,980 INFO [regionserver//10.11.6.43:0.compactionChecker] hbase.Chore(100): regionserver//10.11.6.43:0.compactionChecker exiting 2014-12-01 14:58:44,979 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.0 exiting 2014-12-01 14:58:44,980 DEBUG [RS_CLOSE_REGION-10.11.6.43:59548-0] handler.CloseRegionHandler(90): Processing close of hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:58:44,980 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(955): stopping server 10.11.6.43,59548,1417474662690 2014-12-01 14:58:44,980 INFO [RS:0;10.11.6.43:59551] flush.RegionServerFlushTableProcedureManager(113): Stopping region server flush procedure manager gracefully. 2014-12-01 14:58:44,981 DEBUG [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegion(1195): Closing hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.: disabling compactions & flushes 2014-12-01 14:58:44,981 DEBUG [M:0;10.11.6.43:59548] zookeeper.MetaTableLocator(456): Stopping MetaTableLocator 2014-12-01 14:58:44,981 DEBUG [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegion(1222): Updates disabled for region hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:58:44,981 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.1 exiting 2014-12-01 14:58:44,981 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.0 exiting 2014-12-01 14:58:44,981 INFO [regionserver//10.11.6.43:0.compactionChecker] hbase.Chore(100): regionserver//10.11.6.43:0.compactionChecker exiting 2014-12-01 14:58:44,981 INFO [regionserver//10.11.6.43:0.nonceCleaner] hbase.Chore(100): regionserver//10.11.6.43:0.nonceCleaner exiting 2014-12-01 14:58:44,981 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(955): stopping server 10.11.6.43,59551,1417474662907 2014-12-01 14:58:44,982 DEBUG [RS:0;10.11.6.43:59551] zookeeper.MetaTableLocator(456): Stopping MetaTableLocator 2014-12-01 14:58:44,981 INFO [RS:1;10.11.6.43:59559] snapshot.RegionServerSnapshotManager(134): Stopping RegionServerSnapshotManager gracefully. 2014-12-01 14:58:44,982 INFO [RS:0;10.11.6.43:59551] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0005 2014-12-01 14:58:44,982 INFO [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegion(1794): Started memstore flush for hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., current region memstore size 344 B 2014-12-01 14:58:44,981 INFO [M:0;10.11.6.43:59548] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0006 2014-12-01 14:58:44,982 INFO [RS:1;10.11.6.43:59559] flush.RegionServerFlushTableProcedureManager(113): Stopping region server flush procedure manager gracefully. 2014-12-01 14:58:44,983 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(955): stopping server 10.11.6.43,59559,1417474662986 2014-12-01 14:58:44,983 DEBUG [RS:1;10.11.6.43:59559] zookeeper.MetaTableLocator(456): Stopping MetaTableLocator 2014-12-01 14:58:44,983 INFO [RS:1;10.11.6.43:59559] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0004 2014-12-01 14:58:44,983 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.0 exiting 2014-12-01 14:58:44,983 INFO [RS:2;10.11.6.43:59568] snapshot.RegionServerSnapshotManager(134): Stopping RegionServerSnapshotManager gracefully. 2014-12-01 14:58:44,983 INFO [regionserver//10.11.6.43:0.compactionChecker] hbase.Chore(100): regionserver//10.11.6.43:0.compactionChecker exiting 2014-12-01 14:58:44,983 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher$FlushHandler(246): MemStoreFlusher.1 exiting 2014-12-01 14:58:44,983 INFO [regionserver//10.11.6.43:0.nonceCleaner] hbase.Chore(100): regionserver//10.11.6.43:0.nonceCleaner exiting 2014-12-01 14:58:44,984 INFO [RS:2;10.11.6.43:59568] flush.RegionServerFlushTableProcedureManager(113): Stopping region server flush procedure manager gracefully. 2014-12-01 14:58:44,984 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(955): stopping server 10.11.6.43,59568,1417474663070 2014-12-01 14:58:44,984 DEBUG [RS:2;10.11.6.43:59568] zookeeper.MetaTableLocator(456): Stopping MetaTableLocator 2014-12-01 14:58:44,984 INFO [RS:2;10.11.6.43:59568] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0007 2014-12-01 14:58:44,984 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,985 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(983): stopping server 10.11.6.43,59551,1417474662907; all regions closed. 2014-12-01 14:58:44,985 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,985 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,985 DEBUG [RS:0;10.11.6.43:59551] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/10.11.6.43,59551,1417474662907 2014-12-01 14:58:44,985 DEBUG [RpcServer.reader=4,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59614 because read count=-1. Number of active connections: 8 2014-12-01 14:58:44,985 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(983): stopping server 10.11.6.43,59559,1417474662986; all regions closed. 2014-12-01 14:58:44,985 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:44,986 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(983): stopping server 10.11.6.43,59568,1417474663070; all regions closed. 2014-12-01 14:58:44,986 DEBUG [RS:1;10.11.6.43:59559] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/10.11.6.43,59559,1417474662986 2014-12-01 14:58:44,987 DEBUG [RS:2;10.11.6.43:59568] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:44,994 INFO [IPC Server handler 9 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:44,994 INFO [IPC Server handler 6 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:44,995 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:44,997 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|RBW]]} size 83 2014-12-01 14:58:44,998 INFO [IPC Server handler 2 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:44,999 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741832_1008 size 91 2014-12-01 14:58:45,000 INFO [IPC Server handler 2 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741831_1007 size 91 2014-12-01 14:58:45,003 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741833_1009 size 91 2014-12-01 14:58:45,003 INFO [IPC Server handler 8 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741831_1007 size 91 2014-12-01 14:58:45,007 DEBUG [RS:0;10.11.6.43:59551] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:58:45,008 INFO [RS:0;10.11.6.43:59551] wal.FSHLog(1075): Closed WAL: FSHLog 10.11.6.43%2C59551%2C1417474662907.default:(num 1417474663446) 2014-12-01 14:58:45,008 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,008 DEBUG [RS:2;10.11.6.43:59568] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:58:45,008 DEBUG [RpcServer.reader=2,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59583 because read count=-1. Number of active connections: 7 2014-12-01 14:58:45,008 INFO [RS:2;10.11.6.43:59568] wal.FSHLog(1075): Closed WAL: FSHLog 10.11.6.43%2C59568%2C1417474663070.default:(num 1417474663446) 2014-12-01 14:58:45,009 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,009 DEBUG [RpcServer.reader=3,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59584 because read count=-1. Number of active connections: 6 2014-12-01 14:58:45,012 DEBUG [RS:1;10.11.6.43:59559] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:58:45,012 INFO [RS:1;10.11.6.43:59559] wal.FSHLog(1075): Closed WAL: FSHLog 10.11.6.43%2C59559%2C1417474662986.default:(num 1417474663446) 2014-12-01 14:58:45,012 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,012 DEBUG [RpcServer.reader=1,port=59548] ipc.RpcServer$Listener(816): RpcServer.listener,port=59548: DISCONNECTING client 10.11.6.43:59582 because read count=-1. Number of active connections: 5 2014-12-01 14:58:45,046 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 0 2014-12-01 14:58:45,047 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:58:45,048 INFO [IPC Server handler 5 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:58:45,049 INFO [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=8, memsize=344, hasBloomFilter=true, into tmp file hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3/.tmp/20028dc591b14cb5ad42bc098b1c0d37 2014-12-01 14:58:45,086 INFO [M:0;10.11.6.43:59548] regionserver.CompactSplitThread(380): Waiting for Split Thread to finish... 2014-12-01 14:58:45,087 INFO [M:0;10.11.6.43:59548] regionserver.CompactSplitThread(380): Waiting for Merge Thread to finish... 2014-12-01 14:58:45,087 INFO [M:0;10.11.6.43:59548] regionserver.CompactSplitThread(380): Waiting for Large Compaction Thread to finish... 2014-12-01 14:58:45,087 INFO [M:0;10.11.6.43:59548] regionserver.CompactSplitThread(380): Waiting for Small Compaction Thread to finish... 2014-12-01 14:58:45,087 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1162): Waiting on 2 regions to close 2014-12-01 14:58:45,089 DEBUG [M:0;10.11.6.43:59548] regionserver.HRegionServer(1166): {1128efef70222c58d461e5ef3438dfb3=hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3., 1588230740=hbase:meta,,1.1588230740} 2014-12-01 14:58:45,089 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] handler.CloseRegionHandler(90): Processing close of hbase:meta,,1.1588230740 2014-12-01 14:58:45,089 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegion(1195): Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-12-01 14:58:45,089 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegion(1222): Updates disabled for region hbase:meta,,1.1588230740 2014-12-01 14:58:45,089 INFO [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegion(1794): Started memstore flush for hbase:meta,,1.1588230740, current region memstore size 1.67 KB 2014-12-01 14:58:45,095 DEBUG [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3/.tmp/20028dc591b14cb5ad42bc098b1c0d37 as hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3/info/20028dc591b14cb5ad42bc098b1c0d37 2014-12-01 14:58:45,105 INFO [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HStore(924): Added hdfs://localhost:59532/user/tyu/hbase/data/hbase/namespace/1128efef70222c58d461e5ef3438dfb3/info/20028dc591b14cb5ad42bc098b1c0d37, entries=2, sequenceid=8, filesize=4.9 K 2014-12-01 14:58:45,105 INFO [IPC Server handler 6 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:58:45,106 INFO [IPC Server handler 1 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED]]} size 0 2014-12-01 14:58:45,107 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b3c83cf0-42a6-4db3-b93b-4a493f9ebece:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-127cf42a-40ab-4c91-b40c-04f9ea0dbc90:NORMAL:127.0.0.1:59536|FINALIZED], ReplicaUnderConstruction[[DISK]DS-e0af5538-74ad-4501-be0f-92d1576a5756:NORMAL:127.0.0.1:59540|FINALIZED]]} size 0 2014-12-01 14:58:45,108 INFO [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegion(2003): Finished memstore flush of ~344 B/344, currentsize=0 B/0 for region hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. in 126ms, sequenceid=8, compaction requested=false 2014-12-01 14:58:45,108 INFO [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.DefaultStoreFlusher(87): Flushed, sequenceid=10, memsize=1.7 K, hasBloomFilter=false, into tmp file hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/.tmp/4487218cc71242889b3b3a7f5f45619a 2014-12-01 14:58:45,108 INFO [RS:0;10.11.6.43:59551] regionserver.Leases(146): RS:0;10.11.6.43:59551 closing leases 2014-12-01 14:58:45,109 INFO [RS:0;10.11.6.43:59551] regionserver.Leases(149): RS:0;10.11.6.43:59551 closed leases 2014-12-01 14:58:45,110 INFO [RS:2;10.11.6.43:59568] regionserver.Leases(146): RS:2;10.11.6.43:59568 closing leases 2014-12-01 14:58:45,111 INFO [RS:2;10.11.6.43:59568] regionserver.Leases(149): RS:2;10.11.6.43:59568 closed leases 2014-12-01 14:58:45,111 INFO [StoreCloserThread-hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3.-1] regionserver.HStore(830): Closed info 2014-12-01 14:58:45,113 INFO [RS:1;10.11.6.43:59559] regionserver.Leases(146): RS:1;10.11.6.43:59559 closing leases 2014-12-01 14:58:45,113 INFO [RS:1;10.11.6.43:59559] regionserver.Leases(149): RS:1;10.11.6.43:59559 closed leases 2014-12-01 14:58:45,115 INFO [RS_CLOSE_REGION-10.11.6.43:59548-0] regionserver.HRegion(1310): Closed hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:58:45,115 DEBUG [RS_CLOSE_REGION-10.11.6.43:59548-0] handler.CloseRegionHandler(122): Closed hbase:namespace,,1417474663746.1128efef70222c58d461e5ef3438dfb3. 2014-12-01 14:58:45,124 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegionFileSystem(377): Committing store file hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/.tmp/4487218cc71242889b3b3a7f5f45619a as hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/info/4487218cc71242889b3b3a7f5f45619a 2014-12-01 14:58:45,134 INFO [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HStore(924): Added hdfs://localhost:59532/user/tyu/hbase/data/hbase/meta/1588230740/info/4487218cc71242889b3b3a7f5f45619a, entries=7, sequenceid=10, filesize=5.5 K 2014-12-01 14:58:45,136 INFO [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegion(2003): Finished memstore flush of ~1.67 KB/1712, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 46ms, sequenceid=10, compaction requested=false 2014-12-01 14:58:45,137 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore(830): Closed info 2014-12-01 14:58:45,138 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] coprocessor.CoprocessorHost(259): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2014-12-01 14:58:45,138 INFO [RS_CLOSE_META-10.11.6.43:59548-0] regionserver.HRegion(1310): Closed hbase:meta,,1.1588230740 2014-12-01 14:58:45,139 DEBUG [RS_CLOSE_META-10.11.6.43:59548-0] handler.CloseRegionHandler(122): Closed hbase:meta,,1.1588230740 2014-12-01 14:58:45,290 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(983): stopping server 10.11.6.43,59548,1417474662690; all regions closed. 2014-12-01 14:58:45,290 DEBUG [M:0;10.11.6.43:59548] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690 2014-12-01 14:58:45,295 INFO [IPC Server handler 4 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW]]} size 83 2014-12-01 14:58:45,296 INFO [IPC Server handler 2 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW]]} size 83 2014-12-01 14:58:45,297 INFO [IPC Server handler 3 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW], ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW]]} size 83 2014-12-01 14:58:45,302 DEBUG [M:0;10.11.6.43:59548] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:58:45,302 INFO [M:0;10.11.6.43:59548] wal.FSHLog(1075): Closed WAL: FSHLog 10.11.6.43%2C59548%2C1417474662690..meta:.meta(num 1417474663604) 2014-12-01 14:58:45,302 DEBUG [M:0;10.11.6.43:59548] wal.FSHLog(1114): Closing WAL writer in /user/tyu/hbase/WALs/10.11.6.43,59548,1417474662690 2014-12-01 14:58:45,306 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59533 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:45,307 INFO [IPC Server handler 0 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59540 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:45,308 INFO [IPC Server handler 7 on 59532] blockmanagement.BlockManager(2473): BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59536 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0136952d-dd4c-4d5a-84e2-df2ac1d3119a:NORMAL:127.0.0.1:59536|RBW], ReplicaUnderConstruction[[DISK]DS-98f55cfa-eecc-466b-bbf7-775da6f4f6b8:NORMAL:127.0.0.1:59540|RBW], ReplicaUnderConstruction[[DISK]DS-506f875f-1ac9-49d8-9daf-ad78c098d008:NORMAL:127.0.0.1:59533|RBW]]} size 83 2014-12-01 14:58:45,314 DEBUG [M:0;10.11.6.43:59548] wal.FSHLog(1072): Moved 1 WAL file(s) to /user/tyu/hbase/oldWALs 2014-12-01 14:58:45,314 INFO [M:0;10.11.6.43:59548] wal.FSHLog(1075): Closed WAL: FSHLog 10.11.6.43%2C59548%2C1417474662690.default:(num 1417474663398) 2014-12-01 14:58:45,314 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,314 INFO [M:0;10.11.6.43:59548] regionserver.Leases(146): M:0;10.11.6.43:59548 closing leases 2014-12-01 14:58:45,314 INFO [M:0;10.11.6.43:59548] regionserver.Leases(149): M:0;10.11.6.43:59548 closed leases 2014-12-01 14:58:45,353 INFO [10.11.6.43,59548,1417474662690.splitLogManagerTimeoutMonitor] hbase.Chore(100): 10.11.6.43,59548,1417474662690.splitLogManagerTimeoutMonitor exiting 2014-12-01 14:58:45,516 INFO [master//10.11.6.43:0.periodicFlusher] hbase.Chore(100): master//10.11.6.43:0.periodicFlusher exiting 2014-12-01 14:58:45,516 INFO [master//10.11.6.43:0.logRoller] regionserver.LogRoller(156): LogRoller exiting. 2014-12-01 14:58:45,518 INFO [master//10.11.6.43:0.leaseChecker] regionserver.Leases(146): master//10.11.6.43:0.leaseChecker closing leases 2014-12-01 14:58:45,518 INFO [master//10.11.6.43:0.leaseChecker] regionserver.Leases(149): master//10.11.6.43:0.leaseChecker closed leases 2014-12-01 14:58:45,592 INFO [regionserver//10.11.6.43:0.logRoller] regionserver.LogRoller(156): LogRoller exiting. 2014-12-01 14:58:45,595 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(146): regionserver//10.11.6.43:0.leaseChecker closing leases 2014-12-01 14:58:45,596 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(149): regionserver//10.11.6.43:0.leaseChecker closed leases 2014-12-01 14:58:45,595 INFO [regionserver//10.11.6.43:0.periodicFlusher] hbase.Chore(100): regionserver//10.11.6.43:0.periodicFlusher exiting 2014-12-01 14:58:45,596 INFO [RS:2;10.11.6.43:59568] regionserver.CompactSplitThread(380): Waiting for Split Thread to finish... 2014-12-01 14:58:45,597 INFO [RS:2;10.11.6.43:59568] regionserver.CompactSplitThread(380): Waiting for Merge Thread to finish... 2014-12-01 14:58:45,597 INFO [RS:2;10.11.6.43:59568] regionserver.CompactSplitThread(380): Waiting for Large Compaction Thread to finish... 2014-12-01 14:58:45,597 INFO [RS:2;10.11.6.43:59568] regionserver.CompactSplitThread(380): Waiting for Small Compaction Thread to finish... 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.logRoller] regionserver.LogRoller(156): LogRoller exiting. 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(146): regionserver//10.11.6.43:0.leaseChecker closing leases 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(146): regionserver//10.11.6.43:0.leaseChecker closing leases 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.periodicFlusher] hbase.Chore(100): regionserver//10.11.6.43:0.periodicFlusher exiting 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.periodicFlusher] hbase.Chore(100): regionserver//10.11.6.43:0.periodicFlusher exiting 2014-12-01 14:58:45,599 INFO [regionserver//10.11.6.43:0.logRoller] regionserver.LogRoller(156): LogRoller exiting. 2014-12-01 14:58:45,600 INFO [RS:1;10.11.6.43:59559] regionserver.CompactSplitThread(380): Waiting for Split Thread to finish... 2014-12-01 14:58:45,600 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(149): regionserver//10.11.6.43:0.leaseChecker closed leases 2014-12-01 14:58:45,600 INFO [regionserver//10.11.6.43:0.leaseChecker] regionserver.Leases(149): regionserver//10.11.6.43:0.leaseChecker closed leases 2014-12-01 14:58:45,600 INFO [RS:1;10.11.6.43:59559] regionserver.CompactSplitThread(380): Waiting for Merge Thread to finish... 2014-12-01 14:58:45,600 INFO [RS:0;10.11.6.43:59551] regionserver.CompactSplitThread(380): Waiting for Split Thread to finish... 2014-12-01 14:58:45,601 INFO [RS:2;10.11.6.43:59568] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000b 2014-12-01 14:58:45,601 INFO [RS:1;10.11.6.43:59559] regionserver.CompactSplitThread(380): Waiting for Large Compaction Thread to finish... 2014-12-01 14:58:45,601 INFO [RS:1;10.11.6.43:59559] regionserver.CompactSplitThread(380): Waiting for Small Compaction Thread to finish... 2014-12-01 14:58:45,601 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:45,601 INFO [RS:0;10.11.6.43:59551] regionserver.CompactSplitThread(380): Waiting for Merge Thread to finish... 2014-12-01 14:58:45,602 INFO [RS:0;10.11.6.43:59551] regionserver.CompactSplitThread(380): Waiting for Large Compaction Thread to finish... 2014-12-01 14:58:45,602 INFO [RS:0;10.11.6.43:59551] regionserver.CompactSplitThread(380): Waiting for Small Compaction Thread to finish... 2014-12-01 14:58:45,602 DEBUG [RS:2;10.11.6.43:59568] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,603 INFO [RS:2;10.11.6.43:59568] ipc.RpcServer(2126): Stopping server on 59568 2014-12-01 14:58:45,603 INFO [RpcServer.listener,port=59568] ipc.RpcServer$Listener(720): RpcServer.listener,port=59568: stopping 2014-12-01 14:58:45,603 INFO [RpcServer.responder] ipc.RpcServer$Responder(962): RpcServer.responder: stopped 2014-12-01 14:58:45,604 INFO [RpcServer.responder] ipc.RpcServer$Responder(865): RpcServer.responder: stopping 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:58:45,605 INFO [RS:1;10.11.6.43:59559] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000d 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:45,605 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59568,1417474663070 2014-12-01 14:58:45,606 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59568-0x14a0812ddeb0003, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-12-01 14:58:45,606 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-12-01 14:58:45,606 INFO [RS:0;10.11.6.43:59551] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000c 2014-12-01 14:58:45,606 DEBUG [RS:1;10.11.6.43:59559] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,606 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:58:45,606 INFO [main-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [10.11.6.43,59568,1417474663070] 2014-12-01 14:58:45,607 INFO [RS:1;10.11.6.43:59559] ipc.RpcServer(2126): Stopping server on 59559 2014-12-01 14:58:45,607 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1027): stopping server 10.11.6.43,59568,1417474663070; zookeeper connection closed. 2014-12-01 14:58:45,608 INFO [RS:2;10.11.6.43:59568] regionserver.HRegionServer(1030): RS:2;10.11.6.43:59568 exiting 2014-12-01 14:58:45,608 INFO [main-EventThread] master.ServerManager(561): Cluster shutdown set; 10.11.6.43,59568,1417474663070 expired; onlineServers=3 2014-12-01 14:58:45,607 INFO [RpcServer.listener,port=59559] ipc.RpcServer$Listener(720): RpcServer.listener,port=59559: stopping 2014-12-01 14:58:45,608 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76250246] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(190): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76250246 2014-12-01 14:58:45,608 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2014-12-01 14:58:45,609 DEBUG [RS:0;10.11.6.43:59551] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,608 INFO [RpcServer.responder] ipc.RpcServer$Responder(962): RpcServer.responder: stopped 2014-12-01 14:58:45,609 INFO [RpcServer.responder] ipc.RpcServer$Responder(865): RpcServer.responder: stopping 2014-12-01 14:58:45,609 INFO [RS:0;10.11.6.43:59551] ipc.RpcServer(2126): Stopping server on 59551 2014-12-01 14:58:45,609 INFO [RpcServer.listener,port=59551] ipc.RpcServer$Listener(720): RpcServer.listener,port=59551: stopping 2014-12-01 14:58:45,610 INFO [RpcServer.responder] ipc.RpcServer$Responder(962): RpcServer.responder: stopped 2014-12-01 14:58:45,610 INFO [RpcServer.responder] ipc.RpcServer$Responder(865): RpcServer.responder: stopping 2014-12-01 14:58:45,610 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:58:45,610 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:58:45,610 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59559,1417474662986 2014-12-01 14:58:45,610 INFO [main-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [10.11.6.43,59559,1417474662986] 2014-12-01 14:58:45,611 INFO [main-EventThread] master.ServerManager(561): Cluster shutdown set; 10.11.6.43,59559,1417474662986 expired; onlineServers=2 2014-12-01 14:58:45,611 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59559-0x14a0812ddeb0002, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:58:45,611 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): regionserver:59551-0x14a0812ddeb0001, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:58:45,611 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59551,1417474662907 2014-12-01 14:58:45,611 INFO [main-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [10.11.6.43,59551,1417474662907] 2014-12-01 14:58:45,612 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1027): stopping server 10.11.6.43,59559,1417474662986; zookeeper connection closed. 2014-12-01 14:58:45,612 INFO [main-EventThread] master.ServerManager(561): Cluster shutdown set; 10.11.6.43,59551,1417474662907 expired; onlineServers=1 2014-12-01 14:58:45,612 INFO [RS:1;10.11.6.43:59559] regionserver.HRegionServer(1030): RS:1;10.11.6.43:59559 exiting 2014-12-01 14:58:45,613 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1027): stopping server 10.11.6.43,59551,1417474662907; zookeeper connection closed. 2014-12-01 14:58:45,613 INFO [RS:0;10.11.6.43:59551] regionserver.HRegionServer(1030): RS:0;10.11.6.43:59551 exiting 2014-12-01 14:58:45,613 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@e4f7e3a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(190): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@e4f7e3a 2014-12-01 14:58:45,613 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ee505ed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(190): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ee505ed 2014-12-01 14:58:45,613 INFO [main] util.JVMClusterUtil(319): Shutdown of 1 master(s) and 3 regionserver(s) complete 2014-12-01 14:58:45,691 INFO [RS_OPEN_META-10.11.6.43:59548-0-MetaLogRoller] regionserver.LogRoller(156): LogRoller exiting. 2014-12-01 14:58:45,694 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/replication/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:58:45,694 INFO [M:0;10.11.6.43:59548] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb000a 2014-12-01 14:58:45,695 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,695 INFO [10.11.6.43,59548,1417474662690-BalancerChore] hbase.Chore(100): 10.11.6.43,59548,1417474662690-BalancerChore exiting 2014-12-01 14:58:45,695 DEBUG [M:0;10.11.6.43:59548] master.HMaster(914): Stopping service threads 2014-12-01 14:58:45,695 INFO [10.11.6.43,59548,1417474662690-ClusterStatusChore] hbase.Chore(100): 10.11.6.43,59548,1417474662690-ClusterStatusChore exiting 2014-12-01 14:58:45,695 INFO [CatalogJanitor-10.11.6.43:59548] hbase.Chore(100): CatalogJanitor-10.11.6.43:59548 exiting 2014-12-01 14:58:45,696 INFO [10.11.6.43:59548.oldLogCleaner] hbase.Chore(100): 10.11.6.43:59548.oldLogCleaner exiting 2014-12-01 14:58:45,696 INFO [10.11.6.43:59548.archivedHFileCleaner] hbase.Chore(100): 10.11.6.43:59548.archivedHFileCleaner exiting 2014-12-01 14:58:45,696 INFO [10.11.6.43:59548.oldLogCleaner] master.ReplicationLogCleaner(135): Stopping replicationLogCleaner-0x14a0812ddeb0009, quorum=localhost:63165, baseZNode=/hbase 2014-12-01 14:58:45,698 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2014-12-01 14:58:45,698 INFO [M:0;10.11.6.43:59548] client.ConnectionManager$HConnectionImplementation(1668): Closing zookeeper sessionid=0x14a0812ddeb0008 2014-12-01 14:58:45,698 DEBUG [main-EventThread] zookeeper.ZKUtil(426): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2014-12-01 14:58:45,699 DEBUG [M:0;10.11.6.43:59548] ipc.RpcClient(1436): Stopping rpc client 2014-12-01 14:58:45,699 INFO [M:0;10.11.6.43:59548] flush.MasterFlushTableProcedureManager(78): stop: server shutting down. 2014-12-01 14:58:45,699 INFO [M:0;10.11.6.43:59548] ipc.RpcServer(2126): Stopping server on 59548 2014-12-01 14:58:45,699 INFO [RpcServer.listener,port=59548] ipc.RpcServer$Listener(720): RpcServer.listener,port=59548: stopping 2014-12-01 14:58:45,699 INFO [RpcServer.responder] ipc.RpcServer$Responder(962): RpcServer.responder: stopped 2014-12-01 14:58:45,700 INFO [RpcServer.responder] ipc.RpcServer$Responder(865): RpcServer.responder: stopping 2014-12-01 14:58:45,700 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(304): master:59548-0x14a0812ddeb0000, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/10.11.6.43,59548,1417474662690 2014-12-01 14:58:45,701 INFO [main-EventThread] zookeeper.RegionServerTracker(118): RegionServer ephemeral node deleted, processing expiration [10.11.6.43,59548,1417474662690] 2014-12-01 14:58:45,701 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1027): stopping server 10.11.6.43,59548,1417474662690; zookeeper connection closed. 2014-12-01 14:58:45,702 INFO [M:0;10.11.6.43:59548] regionserver.HRegionServer(1030): M:0;10.11.6.43:59548 exiting 2014-12-01 14:58:45,703 INFO [main] zookeeper.MiniZooKeeperCluster(244): Shutdown MiniZK cluster with all ZK servers 2014-12-01 14:58:45,704 WARN [main] datanode.DirectoryScanner(376): DirectoryScanner: shutdown has been called 2014-12-01 14:58:45,705 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x4ecdbfc1-0x14a0812ddeb0010, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck-0x14a0812ddeb001b, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(393): hbase Fsck-0x14a0812ddeb001b, quorum=localhost:63165, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(304): hbase Fsck-0x14a0812ddeb0015, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(304): hconnection-0x2111a4d1-0x14a0812ddeb0016, quorum=localhost:63165, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2014-12-01 14:58:45,804 DEBUG [pool-87-thread-2-EventThread] zookeeper.ZooKeeperWatcher(393): hconnection-0x2111a4d1-0x14a0812ddeb0016, quorum=localhost:63165, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-12-01 14:58:45,804 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(393): hbase Fsck-0x14a0812ddeb0015, quorum=localhost:63165, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-12-01 14:58:45,803 DEBUG [pool-87-thread-1-EventThread] zookeeper.ZooKeeperWatcher(393): hconnection-0x4ecdbfc1-0x14a0812ddeb0010, quorum=localhost:63165, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2014-12-01 14:58:45,809 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data5/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(738): BPOfferService for Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 7768e998-7c86-4d6c-a3c8-3ae9df3f13d9) service to localhost/127.0.0.1:59532 interrupted 2014-12-01 14:58:45,809 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data5/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data6/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(861): Ending block pool service for: Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 7768e998-7c86-4d6c-a3c8-3ae9df3f13d9) service to localhost/127.0.0.1:59532 2014-12-01 14:58:45,811 WARN [main] datanode.DirectoryScanner(376): DirectoryScanner: shutdown has been called 2014-12-01 14:58:45,813 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2014-12-01 14:58:45,918 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data3/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(738): BPOfferService for Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 15c3c1fa-ed60-4106-a5be-c2df060414d1) service to localhost/127.0.0.1:59532 interrupted 2014-12-01 14:58:45,918 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data3/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data4/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(861): Ending block pool service for: Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 15c3c1fa-ed60-4106-a5be-c2df060414d1) service to localhost/127.0.0.1:59532 2014-12-01 14:58:45,919 WARN [main] datanode.DirectoryScanner(376): DirectoryScanner: shutdown has been called 2014-12-01 14:58:45,921 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2014-12-01 14:58:46,026 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data1/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(738): BPOfferService for Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 6a6985a0-336e-4771-8b7b-c07d6e1fabc3) service to localhost/127.0.0.1:59532 interrupted 2014-12-01 14:58:46,026 WARN [DataNode: [[[DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data1/, [DISK]file:/Users/tyu/trunk/hbase-server/target/test-data/49fd97f0-7278-4a9f-b8cf-0b2a42e25401/dfscluster_411f533a-f2a7-4cbb-9022-49ed70677408/dfs/data/data2/]] heartbeating to localhost/127.0.0.1:59532] datanode.BPServiceActor(861): Ending block pool service for: Block pool BP-692421505-10.11.6.43-1417474659991 (Datanode Uuid 6a6985a0-336e-4771-8b7b-c07d6e1fabc3) service to localhost/127.0.0.1:59532 2014-12-01 14:58:46,034 WARN [org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@19dc8aa9] blockmanagement.DecommissionManager$Monitor(78): Monitor interrupted: java.lang.InterruptedException: sleep interrupted 2014-12-01 14:58:46,042 INFO [main] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2014-12-01 14:58:46,164 INFO [main] hbase.HBaseTestingUtility(985): Minicluster is down 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(111): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@13cd9466 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(133): Shutdown hook finished. 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(111): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@13cd9466 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(133): Shutdown hook finished. 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(111): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@13cd9466 2014-12-01 14:58:46,167 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(133): Shutdown hook finished. 2014-12-01 14:58:46,168 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(111): Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@13cd9466 2014-12-01 14:58:46,168 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(120): Starting fs shutdown hook thread. 2014-12-01 14:58:46,168 INFO [Thread-1] regionserver.ShutdownHook$ShutdownHookThread(133): Shutdown hook finished.